Jul 30 16:42:36 devstack cinder-volume[77358]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 30 16:42:36 devstack cinder-volume[77358]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 30 16:42:36 devstack cinder-volume[77358]: we strongly recommend against using it for new projects. Jul 30 16:42:36 devstack cinder-volume[77358]: If you are already using Eventlet, we recommend migrating to a different Jul 30 16:42:36 devstack cinder-volume[77358]: framework. For more detail see Jul 30 16:42:36 devstack cinder-volume[77358]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 30 16:42:36 devstack cinder-volume[77358]: import eventlet # noqa Jul 30 16:42:39 devstack cinder-volume[77358]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=77358) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 30 16:42:39 devstack cinder-volume[77358]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=77358) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 30 16:42:39 devstack cinder-volume[77358]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=77358) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 30 16:42:40 devstack cinder-volume[77358]: INFO dbcounter [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] Registered counter for database cinder Jul 30 16:42:40 devstack cinder-volume[77358]: DEBUG oslo_db.sqlalchemy.engines [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77358) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 30 16:42:40 devstack cinder-volume[77358]: DEBUG dbcounter [-] [77358] Writer thread running {{(pid=77358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 30 16:42:40 devstack cinder-volume[77358]: INFO cinder.rpc [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 30 16:42:40 devstack cinder-volume[77358]: INFO cinder.rpc [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 30 16:42:40 devstack cinder-volume[77358]: DEBUG oslo_db.sqlalchemy.engines [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77358) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 30 16:42:40 devstack cinder-volume[77358]: INFO cinder.volume.manager [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] Determined volume DB was empty at startup. Jul 30 16:42:40 devstack cinder-volume[77358]: DEBUG cinder.volume.manager [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=77358) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 30 16:42:40 devstack cinder-volume[77358]: INFO cinder.volume.manager [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 30 16:42:40 devstack cinder-volume[77358]: WARNING stevedore.named [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 30 16:42:40 devstack cinder-volume[77358]: WARNING castellan.key_manager [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 30 16:42:40 devstack cinder-volume[77358]: WARNING cinder.keymgr.conf_key_mgr [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 30 16:42:40 devstack cinder-volume[77358]: DEBUG cinder.volume.drivers.lvm [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=77358) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Jul 30 16:42:40 devstack cinder-volume[77358]: DEBUG oslo_concurrency.processutils [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=77358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_concurrency.processutils [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] CMD "cinder-rtstool verify" returned: 0 in 0.457s {{(pid=77358) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_db.sqlalchemy.engines [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77358) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 30 16:42:41 devstack cinder-volume[77358]: INFO cinder.rpc [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 30 16:42:41 devstack cinder-volume[77358]: INFO cinder.rpc [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 30 16:42:41 devstack cinder-volume[77358]: WARNING stevedore.named [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 30 16:42:41 devstack cinder-volume[77358]: WARNING castellan.key_manager [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 30 16:42:41 devstack cinder-volume[77358]: INFO cinder.volume.manager [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_db.sqlalchemy.engines [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77358) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 30 16:42:41 devstack cinder-volume[77358]: INFO oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] Starting 1 workers Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] Started child 77505 {{(pid=77358) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] Full set of CONF: {{(pid=77358) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] ******************************************************************************** {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] Configuration options gathered from: {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] ================================================================================ {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 30 16:42:41 devstack cinder-volume[77505]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] allow_availability_zone_fallback = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] allow_compression_on_image_upload = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] allowed_direct_url_schemes = [] {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] api_rate_limit = True {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] auth_strategy = keystone {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] az_cache_duration = 3600 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_availability_zone = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_host = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_name = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_stats_polling_interval = 60 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backup_api_class = cinder.backup.api.API {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backup_name_template = backup-%s {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backup_use_same_host = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backup_use_temp_snapshot = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] chap_password = **** {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] chap_username = {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] cinder_internal_tenant_project_id = 8827ced88ee9415db99d9d82f721ce9c {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] cinder_internal_tenant_user_id = 28c4be5e6208447d955e84a1b8a10e5e {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] cloned_volume_same_az = True {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] cluster = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] compression_format = gzip {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] compute_api_class = cinder.compute.nova.API {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] config_dir = [] {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] config_source = [] {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] control_exchange = openstack {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] debug = True {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] default_availability_zone = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] default_group_type = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] default_volume_type = lvmdriver-1 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] disk_geometry = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] driver_client_cert = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] driver_client_cert_key = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] driver_data_namespace = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] driver_ssl_cert_path = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] driver_ssl_cert_verify = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] driver_use_ssl = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] enable_force_upload = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] enable_new_services = True {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] enable_unsupported_driver = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] enabled_backends = ['lvmdriver-1'] {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] enforce_multipath_for_image_xfer = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] filter_function = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] glance_api_insecure = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] glance_api_servers = ['http://192.168.122.111/image'] {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] glance_api_ssl_compression = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] glance_ca_certificates_file = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] glance_catalog_info = image:glance:publicURL {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] glance_certfile = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] glance_keyfile = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] glance_num_retries = 3 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] glance_request_timeout = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] goodness_function = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] graceful_shutdown_timeout = 5 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] group_api_class = cinder.group.api.API {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] host = devstack {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] image_compress_on_upload = True {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] image_conversion_address_space_limit = 1 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] image_conversion_cpu_limit = 60 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77505]: INFO cinder.volume.manager [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] image_conversion_disable = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] image_upload_use_cinder_backend = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] image_upload_use_internal_tenant = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] image_volume_cache_enabled = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] image_volume_cache_max_count = 0 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] image_volume_cache_max_size_gb = 0 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] init_host_max_objects_retrieval = 0 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] instance_format = [instance: %(uuid)s] {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] iscsi_target_flags = {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] iscsi_write_cache = on {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] iser_helper = tgtadm {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] iser_ip_address = 192.168.122.111 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] iser_port = 3260 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] log_color = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] log_config_append = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] log_dir = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] log_file = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] log_options = True {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] log_rotate_interval = 1 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] log_rotate_interval_type = days {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] log_rotation_type = none {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] max_age = 0 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] max_logfile_count = 30 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] max_logfile_size_mb = 200 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] max_over_subscription_ratio = 20.0 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] message_reap_interval = 86400 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] message_ttl = 2592000 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] migration_create_volume_timeout_secs = 300 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] monkey_patch = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] monkey_patch_modules = [] {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] my_ip = 192.168.122.111 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] no_snapshot_gb_quota = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] num_iser_scan_tries = 3 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] num_shell_tries = 3 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] num_volume_device_scan_tries = 3 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] nvmeof_conn_info_version = 1 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] nvmet_ns_id = 10 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] nvmet_port_id = 1 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] osapi_max_limit = 1000 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] osapi_volume_ext_list = [] {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] osapi_volume_listen = 0.0.0.0 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] osapi_volume_listen_port = 8776 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] osapi_volume_use_ssl = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] osapi_volume_workers = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] per_volume_size_limit = -1 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] periodic_fuzzy_delay = 60 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] periodic_interval = 60 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] project_id_regex = [0-9a-f\-]+ {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] public_endpoint = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] publish_errors = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] quota_backup_gigabytes = 1000 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] quota_backups = 10 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] quota_gigabytes = 1000 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] quota_groups = 10 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] quota_snapshots = 10 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] quota_volumes = 10 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] rate_limit_burst = 0 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] rate_limit_except_level = CRITICAL {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] rate_limit_interval = 0 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] reinit_driver_count = 3 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] replication_device = **** {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] report_discard_supported = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] report_interval = 120 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] reservation_clean_interval = 86400 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] reservation_expire = 86400 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] reserved_image_namespaces = [] {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] reserved_percentage = 0 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] rpc_response_timeout = 120 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] run_external_periodic_tasks = True {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] scst_target_driver = iscsi {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] scst_target_iqn_name = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] service_down_time = 720 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] shell_completion = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] snapshot_name_template = snapshot-%s {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] snapshot_same_host = True {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] split_loggers = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] state_path = /opt/stack/data/cinder {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] storage_availability_zone = nova {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] storage_protocol = iSCSI {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] syslog_log_facility = LOG_USER {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] target_helper = lioadm {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] target_ip_address = 192.168.122.111 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] target_port = 3260 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] target_protocol = iscsi {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] target_secondary_ip_addresses = [] {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] trace_flags = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] transfer_api_class = cinder.transfer.api.API {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] transport_url = **** {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] until_refresh = 0 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] use_chap_auth = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] use_default_quota_class = True {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] use_journal = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] use_json = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] use_multipath_for_image_xfer = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] use_stderr = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] use_syslog = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] verify_glance_signatures = enabled {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] volume_api_class = cinder.volume.api.API {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] volume_backend_name = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] volume_clear = zero {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] volume_clear_ionice = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] volume_clear_size = 0 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] volume_copy_bps_limit = 0 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] volume_dd_blocksize = 1M {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] volume_name_template = volume-%s {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] volume_service_inithost_offload = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] volume_usage_audit_period = month {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] zoning_mode = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_concurrency.disable_process_locking = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] keystone_authtoken.auth_section = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] keystone_authtoken.auth_type = password {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] keystone_authtoken.auth_version = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] keystone_authtoken.cache = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] keystone_authtoken.certfile = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] keystone_authtoken.delay_auth_decision = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] keystone_authtoken.http_connect_timeout = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] keystone_authtoken.include_service_catalog = True {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] keystone_authtoken.insecure = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] keystone_authtoken.interface = public {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] keystone_authtoken.keyfile = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] keystone_authtoken.memcache_password = {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] keystone_authtoken.memcache_username = {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] keystone_authtoken.region_name = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack sudo[77511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] keystone_authtoken.service_token_roles_required = True {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] keystone_authtoken.service_type = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] keystone_authtoken.token_cache_time = 300 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.111/identity {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] cache.backend = dogpile.cache.null {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack sudo[77511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] cache.backend_argument = **** {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] cache.backend_expiration_time = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] cache.config_prefix = cache.oslo {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] cache.debug_cache_backend = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] cache.enable_retry_client = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] cache.enable_socket_keepalive = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] cache.enabled = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] cache.expiration_time = 600 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] cache.hashclient_retry_attempts = 2 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] cache.memcache_dead_retry = 300 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] cache.memcache_pool_maxsize = 10 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] cache.memcache_sasl_enabled = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] cache.password = **** {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] cache.proxies = [] {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] cache.redis_db = 0 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] cache.redis_sentinel_service_name = mymaster {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] cache.redis_server = localhost:6379 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] cache.retry_attempts = 2 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] cache.retry_delay = 0.0 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] cache.socket_keepalive_count = 1 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] cache.socket_keepalive_idle = 1 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] cache.socket_keepalive_interval = 1 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] cache.socket_timeout = 1.0 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] cache.tls_allowed_ciphers = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] cache.tls_cafile = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] cache.tls_certfile = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] cache.tls_enabled = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] cache.tls_keyfile = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] cache.username = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] coordination.backend_url = **** {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] database.asyncio_connection = **** {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] database.asyncio_slave_connection = **** {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] database.backend = sqlalchemy {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] database.connection = **** {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] database.connection_debug = 0 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] database.connection_parameters = {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] database.connection_recycle_time = 3600 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] database.connection_trace = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] database.db_inc_retry_interval = True {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] database.db_max_retries = 20 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] database.db_max_retry_interval = 10 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] database.db_retry_interval = 1 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] database.max_overflow = 50 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] database.max_pool_size = 5 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] database.max_retries = 10 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] database.mysql_wsrep_sync_wait = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] database.pool_timeout = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] database.retry_interval = 10 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] database.slave_connection = **** {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] database.sqlite_synchronous = True {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] database.synchronous_reader = True {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] database.use_db_reconnect = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] profiler.connection_string = messaging:// {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] profiler.enabled = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] profiler.es_doc_type = notification {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] profiler.es_scroll_size = 10000 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] profiler.es_scroll_time = 2m {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] profiler.filter_error_trace = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] profiler.hmac_keys = **** {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] profiler.sentinel_service_name = mymaster {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] profiler.socket_timeout = 0.1 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] profiler.trace_requests = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] profiler.trace_sqlalchemy = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] profiler_jaeger.process_tags = {} {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] profiler_jaeger.service_name_prefix = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] profiler_otlp.service_name_prefix = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_policy.enforce_new_defaults = True {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_policy.policy_default_rule = default {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_policy.policy_file = policy.yaml {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_policy.remote_timeout = 60.0 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] privsep_osbrick.group = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] privsep_osbrick.helper_command = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] privsep_osbrick.user = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] cinder_sys_admin.group = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] cinder_sys_admin.helper_command = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] cinder_sys_admin.user = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] service_user.auth_section = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] service_user.auth_type = password {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] service_user.cafile = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] service_user.certfile = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] service_user.collect_timing = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] service_user.insecure = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] service_user.keyfile = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] service_user.send_service_user_token = True {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] service_user.split_loggers = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] service_user.timeout = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] glance.auth_section = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] glance.auth_type = password {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] glance.certfile = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] glance.collect_timing = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] glance.insecure = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] glance.keyfile = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] glance.region_name = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] glance.split_loggers = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] glance.timeout = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.backend_availability_zone = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.chap_password = **** {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.chap_username = {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.disk_geometry = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.driver_client_cert = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.driver_client_cert_key = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.driver_data_namespace = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.driver_use_ssl = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.enable_unsupported_driver = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.extra_capabilities = {} {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.filter_function = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.goodness_function = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.iscsi_target_flags = {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.iscsi_write_cache = on {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.iser_helper = tgtadm {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.iser_ip_address = 192.168.122.111 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.iser_port = 3260 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.lvm_mirrors = 0 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.lvm_share_target = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.lvm_type = auto {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.num_shell_tries = 3 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.nvmet_port_id = 1 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.replication_device = **** {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.report_discard_supported = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.reserved_percentage = 0 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.scst_target_driver = iscsi {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.scst_target_iqn_name = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.storage_protocol = iSCSI {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.target_helper = tgtadm {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.target_ip_address = 192.168.122.111 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.target_port = 3260 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.target_protocol = iscsi {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.trace_flags = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.unique_fqdn_network = True {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.use_chap_auth = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.volume_backend_name = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.volume_clear = zero {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.volume_clear_ionice = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.volume_clear_size = 0 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.volume_group = cinder-volumes {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_reports.file_event_handler = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_reports.log_dir = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.backend_availability_zone = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.backend_host = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.chap_password = **** {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.chap_username = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.chiscsi_conf = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.disk_geometry = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.driver_client_cert = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.driver_client_cert_key = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.driver_data_namespace = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.driver_use_ssl = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.extra_capabilities = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.filter_function = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.goodness_function = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.iscsi_target_flags = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.iscsi_write_cache = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.iser_helper = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.iser_ip_address = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.iser_port = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.iser_target_prefix = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.lvm_conf_file = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.lvm_mirrors = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.lvm_share_target = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.lvm_type = auto {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.num_shell_tries = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.nvmet_ns_id = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.nvmet_port_id = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.replication_device = **** {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.report_discard_supported = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.reserved_percentage = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.scst_target_driver = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.storage_protocol = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.target_helper = lioadm {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.target_ip_address = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.target_port = 3260 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.target_protocol = iscsi {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.trace_flags = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.unique_fqdn_network = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.use_chap_auth = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.volume_clear = zero {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.volume_clear_ionice = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.volume_clear_size = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] lvmdriver-1.volumes_dir = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_messaging_rabbit.ssl = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_messaging_rabbit.ssl_version = {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_messaging_notifications.driver = [] {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_messaging_notifications.retry = -1 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] oslo_messaging_notifications.transport_url = **** {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] key_manager.fixed_key = **** {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] barbican.barbican_api_version = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] barbican.barbican_endpoint = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] barbican.barbican_endpoint_type = public {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] barbican.barbican_region_name = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] barbican.cafile = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] barbican.certfile = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] barbican.collect_timing = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] barbican.insecure = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] barbican.keyfile = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] barbican.number_of_retries = 60 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] barbican.retry_delay = 1 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] barbican.send_service_user_token = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] barbican.split_loggers = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] barbican.timeout = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] barbican.verify_ssl = True {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] barbican.verify_ssl_path = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] barbican_service_user.auth_section = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] barbican_service_user.auth_type = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] barbican_service_user.cafile = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] barbican_service_user.certfile = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] barbican_service_user.collect_timing = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] barbican_service_user.insecure = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] barbican_service_user.keyfile = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] barbican_service_user.split_loggers = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] barbican_service_user.timeout = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] vault.approle_role_id = **** {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] vault.approle_secret_id = **** {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] vault.auth_method = approle {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] vault.auth_path = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] vault.kv_mountpoint = secret {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] vault.kv_path = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] vault.kv_version = 2 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] vault.namespace = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] vault.root_token_id = **** {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] vault.ssl_ca_crt_file = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] vault.timeout = 60.0 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] vault.token_file = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] vault.token_role = None {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] vault.use_ssl = False {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:42:41 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] ******************************************************************************** {{(pid=77358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 30 16:42:41 devstack sudo[77511]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:41 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.443s {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:41 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:41 devstack sudo[77601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 30 16:42:41 devstack sudo[77601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:42 devstack sudo[77601]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:42 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.279s {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:42 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 16:42:42 devstack cinder-volume[77505]: INFO cinder.brick.local_dev.lvm [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 30 16:42:42 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:42 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:42 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:42 devstack sudo[77714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 30 16:42:42 devstack sudo[77714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:42 devstack sudo[77714]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:42 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:42 devstack cinder-volume[77505]: DEBUG cinder.brick.local_dev.lvm [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=77505) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Jul 30 16:42:42 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:42 devstack sudo[77807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 30 16:42:42 devstack sudo[77807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:43 devstack sudo[77807]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:43 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.506s {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:43 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:43 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:43 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:43 devstack sudo[78032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 30 16:42:43 devstack sudo[78032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:43 devstack sudo[78032]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:43 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.331s {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:43 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:43 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:43 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:43 devstack sudo[78118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 30 16:42:43 devstack sudo[78118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:43 devstack sudo[78118]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:43 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.256s {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:43 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:43 devstack sudo[78125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 30 16:42:43 devstack sudo[78125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:43 devstack sudo[78125]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:43 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.297s {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:43 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:43 devstack sudo[78204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 30 16:42:43 devstack sudo[78204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:44 devstack sudo[78204]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:44 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:44 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:44 devstack sudo[78209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:42:44 devstack sudo[78209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:44 devstack sudo[78209]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:44 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.294s {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:44 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:44 devstack sudo[78273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 30 16:42:44 devstack sudo[78273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:44 devstack sudo[78273]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:44 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.298s {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:44 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:44 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:44 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:44 devstack sudo[78300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 30 16:42:44 devstack sudo[78300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:45 devstack sudo[78300]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:45 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.290s {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:45 devstack cinder-volume[77505]: INFO cinder.volume.drivers.lvm [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 30 16:42:45 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:45 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:45 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:45 devstack sudo[78310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 30 16:42:45 devstack sudo[78310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:45 devstack sudo[78310]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:45 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:45 devstack cinder-volume[77505]: DEBUG cinder.volume.drivers.lvm [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] Updating volume stats {{(pid=77505) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 30 16:42:45 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:45 devstack sudo[78313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 30 16:42:45 devstack sudo[78313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:45 devstack sudo[78313]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:45 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:45 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:45 devstack sudo[78316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:42:45 devstack sudo[78316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:45 devstack sudo[78316]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:45 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:45 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:45 devstack sudo[78319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 30 16:42:45 devstack sudo[78319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:46 devstack sudo[78319]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:46 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:46 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:46 devstack sudo[78322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:42:46 devstack sudo[78322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:46 devstack sudo[78322]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:46 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:46 devstack cinder-volume[77505]: INFO cinder.volume.driver [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] Driver hasn't implemented _init_vendor_properties() Jul 30 16:42:46 devstack cinder-volume[77505]: DEBUG cinder.volume.driver [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=77505) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 30 16:42:46 devstack cinder-volume[77505]: DEBUG oslo_db.sqlalchemy.engines [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77505) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 30 16:42:46 devstack cinder-volume[77505]: DEBUG dbcounter [-] [77505] Writer thread running {{(pid=77505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 30 16:42:46 devstack cinder-volume[77505]: DEBUG cinder.db.api [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] Building query based on filter {{(pid=77505) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 30 16:42:46 devstack cinder-volume[77505]: DEBUG cinder.image.image_utils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=77505) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 30 16:42:46 devstack cinder-volume[77505]: INFO cinder.keymgr.migration [None req-69bb852e-431a-474b-a258-2515461a3f66 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 30 16:42:46 devstack cinder-volume[77505]: DEBUG cinder.volume.drivers.lvm [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] Updating volume stats {{(pid=77505) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 30 16:42:46 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:46 devstack sudo[78325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 30 16:42:46 devstack sudo[78325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:46 devstack sudo[78325]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:46 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:46 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:46 devstack sudo[78330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:42:46 devstack sudo[78330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:47 devstack sudo[78330]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:47 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:47 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:47 devstack sudo[78334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 30 16:42:47 devstack sudo[78334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:47 devstack sudo[78334]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:47 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.312s {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:47 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:47 devstack sudo[78337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:42:47 devstack sudo[78337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:47 devstack sudo[78337]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:47 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:47 devstack cinder-volume[77505]: DEBUG cinder.manager [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] Notifying Schedulers of capabilities ... {{(pid=77505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:42:47 devstack cinder-volume[77505]: INFO cinder.volume.manager [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] Driver initialization completed successfully. Jul 30 16:42:47 devstack cinder-volume[77505]: INFO cinder.manager [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] Initiating service 2 cleanup Jul 30 16:42:47 devstack cinder-volume[77505]: INFO cinder.manager [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] Service 2 cleanup completed. Jul 30 16:42:47 devstack cinder-volume[77505]: DEBUG cinder.service [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] Creating RPC server for service cinder-volume {{(pid=77505) start /opt/stack/cinder/cinder/service.py:231}} Jul 30 16:42:47 devstack cinder-volume[77505]: DEBUG cinder.service [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=77505) start /opt/stack/cinder/cinder/service.py:237}} Jul 30 16:42:47 devstack cinder-volume[77505]: INFO cinder.volume.manager [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 30 16:42:47 devstack cinder-volume[77505]: DEBUG cinder.volume.drivers.lvm [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] Updating volume stats {{(pid=77505) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 30 16:42:47 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:48 devstack sudo[78348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 30 16:42:48 devstack sudo[78348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:48 devstack sudo[78348]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:48 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:48 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:48 devstack sudo[78351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:42:48 devstack sudo[78351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:48 devstack sudo[78351]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:48 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:48 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:48 devstack sudo[78357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 30 16:42:48 devstack sudo[78357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:48 devstack sudo[78357]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:48 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:48 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:48 devstack sudo[78360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:42:48 devstack sudo[78360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:49 devstack sudo[78360]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:49 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:49 devstack cinder-volume[77505]: INFO cinder.volume.manager [None req-bda6420f-2468-4933-a144-e4e2ca5ade8b None None] Driver post RPC initialization completed successfully. Jul 30 16:42:51 devstack cinder-volume[77358]: DEBUG dbcounter [-] [77358] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:42:59 devstack cinder-volume[77505]: DEBUG dbcounter [-] [77505] Writing DB stats cinder:SELECT=2 {{(pid=77505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:42:59 devstack cinder-volume[77505]: DEBUG dbcounter [-] [77505] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=77505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:43:46 devstack cinder-volume[77505]: DEBUG oslo_service.periodic_task [None req-e70fde0e-e0e1-4b75-9312-e8431ae7169e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:43:46 devstack cinder-volume[77505]: DEBUG cinder.volume.drivers.lvm [None req-e70fde0e-e0e1-4b75-9312-e8431ae7169e None None] Updating volume stats {{(pid=77505) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 30 16:43:46 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-e70fde0e-e0e1-4b75-9312-e8431ae7169e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:46 devstack sudo[80329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 30 16:43:46 devstack sudo[80329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:46 devstack sudo[80329]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:46 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-e70fde0e-e0e1-4b75-9312-e8431ae7169e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:46 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-e70fde0e-e0e1-4b75-9312-e8431ae7169e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:46 devstack sudo[80332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:43:46 devstack sudo[80332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:46 devstack sudo[80332]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:46 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-e70fde0e-e0e1-4b75-9312-e8431ae7169e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:46 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-e70fde0e-e0e1-4b75-9312-e8431ae7169e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:46 devstack sudo[80335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 30 16:43:46 devstack sudo[80335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:46 devstack sudo[80335]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:46 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-e70fde0e-e0e1-4b75-9312-e8431ae7169e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.283s {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:46 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-e70fde0e-e0e1-4b75-9312-e8431ae7169e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:46 devstack sudo[80338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:43:46 devstack sudo[80338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:47 devstack sudo[80338]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:47 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-e70fde0e-e0e1-4b75-9312-e8431ae7169e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:47 devstack cinder-volume[77505]: DEBUG cinder.manager [None req-e70fde0e-e0e1-4b75-9312-e8431ae7169e None None] Notifying Schedulers of capabilities ... {{(pid=77505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:43:47 devstack cinder-volume[77505]: DEBUG oslo_service.periodic_task [None req-e70fde0e-e0e1-4b75-9312-e8431ae7169e None None] Running periodic task VolumeManager._thread_info {{(pid=77505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:43:47 devstack cinder-volume[77505]: DEBUG cinder.volume.manager [None req-e70fde0e-e0e1-4b75-9312-e8431ae7169e None None] thread count: 6 {{(pid=77505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:43:47 devstack cinder-volume[77505]: DEBUG cinder.volume.manager [None req-e70fde0e-e0e1-4b75-9312-e8431ae7169e None None] thread info: [<_MainThread(MainThread, started 137080878157952)>, , , , , ] {{(pid=77505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:44:46 devstack cinder-volume[77505]: DEBUG oslo_service.periodic_task [None req-e70fde0e-e0e1-4b75-9312-e8431ae7169e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:44:46 devstack cinder-volume[77505]: DEBUG cinder.volume.drivers.lvm [None req-e70fde0e-e0e1-4b75-9312-e8431ae7169e None None] Updating volume stats {{(pid=77505) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 30 16:44:46 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-e70fde0e-e0e1-4b75-9312-e8431ae7169e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:46 devstack sudo[83595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 30 16:44:46 devstack sudo[83595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:46 devstack sudo[83595]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:46 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-e70fde0e-e0e1-4b75-9312-e8431ae7169e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:46 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-e70fde0e-e0e1-4b75-9312-e8431ae7169e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:46 devstack sudo[83598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:44:46 devstack sudo[83598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:46 devstack sudo[83598]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:46 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-e70fde0e-e0e1-4b75-9312-e8431ae7169e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:46 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-e70fde0e-e0e1-4b75-9312-e8431ae7169e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:46 devstack sudo[83601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 30 16:44:46 devstack sudo[83601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:46 devstack sudo[83601]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:46 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-e70fde0e-e0e1-4b75-9312-e8431ae7169e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:46 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-e70fde0e-e0e1-4b75-9312-e8431ae7169e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:46 devstack sudo[83606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:44:46 devstack sudo[83606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:47 devstack sudo[83606]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:47 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-e70fde0e-e0e1-4b75-9312-e8431ae7169e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.241s {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:47 devstack cinder-volume[77505]: DEBUG cinder.manager [None req-e70fde0e-e0e1-4b75-9312-e8431ae7169e None None] Notifying Schedulers of capabilities ... {{(pid=77505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:44:59 devstack cinder-volume[77505]: DEBUG dbcounter [-] [77505] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=77505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:45:46 devstack cinder-volume[77505]: DEBUG oslo_service.periodic_task [None req-e70fde0e-e0e1-4b75-9312-e8431ae7169e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:45:46 devstack cinder-volume[77505]: DEBUG cinder.volume.drivers.lvm [None req-e70fde0e-e0e1-4b75-9312-e8431ae7169e None None] Updating volume stats {{(pid=77505) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 30 16:45:46 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-e70fde0e-e0e1-4b75-9312-e8431ae7169e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:46 devstack sudo[85463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 30 16:45:46 devstack sudo[85463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:46 devstack sudo[85463]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:46 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-e70fde0e-e0e1-4b75-9312-e8431ae7169e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:46 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-e70fde0e-e0e1-4b75-9312-e8431ae7169e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:46 devstack sudo[85473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:45:46 devstack sudo[85473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:46 devstack sudo[85473]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:46 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-e70fde0e-e0e1-4b75-9312-e8431ae7169e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:46 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-e70fde0e-e0e1-4b75-9312-e8431ae7169e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:46 devstack sudo[85489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 30 16:45:46 devstack sudo[85489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:46 devstack sudo[85489]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:46 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-e70fde0e-e0e1-4b75-9312-e8431ae7169e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:46 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-e70fde0e-e0e1-4b75-9312-e8431ae7169e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:46 devstack sudo[85494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:45:46 devstack sudo[85494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:47 devstack sudo[85494]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:47 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-e70fde0e-e0e1-4b75-9312-e8431ae7169e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.300s {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:47 devstack cinder-volume[77505]: DEBUG cinder.manager [None req-e70fde0e-e0e1-4b75-9312-e8431ae7169e None None] Notifying Schedulers of capabilities ... {{(pid=77505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:45:47 devstack cinder-volume[77505]: DEBUG oslo_service.periodic_task [None req-e70fde0e-e0e1-4b75-9312-e8431ae7169e None None] Running periodic task VolumeManager._thread_info {{(pid=77505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:45:47 devstack cinder-volume[77505]: DEBUG cinder.volume.manager [None req-e70fde0e-e0e1-4b75-9312-e8431ae7169e None None] thread count: 6 {{(pid=77505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:45:47 devstack cinder-volume[77505]: DEBUG cinder.volume.manager [None req-e70fde0e-e0e1-4b75-9312-e8431ae7169e None None] thread info: [<_MainThread(MainThread, started 137080878157952)>, , , , , ] {{(pid=77505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:46:46 devstack cinder-volume[77505]: DEBUG oslo_service.periodic_task [None req-e70fde0e-e0e1-4b75-9312-e8431ae7169e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:46:46 devstack cinder-volume[77505]: DEBUG cinder.volume.drivers.lvm [None req-e70fde0e-e0e1-4b75-9312-e8431ae7169e None None] Updating volume stats {{(pid=77505) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 30 16:46:46 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-e70fde0e-e0e1-4b75-9312-e8431ae7169e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:46 devstack sudo[86730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 30 16:46:46 devstack sudo[86730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:46 devstack sudo[86730]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:46 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-e70fde0e-e0e1-4b75-9312-e8431ae7169e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:46 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-e70fde0e-e0e1-4b75-9312-e8431ae7169e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:46 devstack sudo[86733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:46:46 devstack sudo[86733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:46 devstack sudo[86733]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:46 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-e70fde0e-e0e1-4b75-9312-e8431ae7169e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.304s {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:46 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-e70fde0e-e0e1-4b75-9312-e8431ae7169e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:46 devstack sudo[86736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 30 16:46:46 devstack sudo[86736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:46 devstack sudo[86736]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:46 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-e70fde0e-e0e1-4b75-9312-e8431ae7169e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.304s {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:46 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-e70fde0e-e0e1-4b75-9312-e8431ae7169e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:46 devstack sudo[86762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:46:46 devstack sudo[86762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:47 devstack sudo[86762]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:47 devstack cinder-volume[77505]: DEBUG oslo_concurrency.processutils [None req-e70fde0e-e0e1-4b75-9312-e8431ae7169e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=77505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:47 devstack cinder-volume[77505]: DEBUG cinder.manager [None req-e70fde0e-e0e1-4b75-9312-e8431ae7169e None None] Notifying Schedulers of capabilities ... {{(pid=77505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:46:47 devstack cinder-volume[77505]: DEBUG oslo_service.periodic_task [None req-e70fde0e-e0e1-4b75-9312-e8431ae7169e None None] Running periodic task VolumeManager._thread_info {{(pid=77505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:46:47 devstack cinder-volume[77505]: DEBUG cinder.volume.manager [None req-e70fde0e-e0e1-4b75-9312-e8431ae7169e None None] thread count: 6 {{(pid=77505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:46:47 devstack cinder-volume[77505]: DEBUG cinder.volume.manager [None req-e70fde0e-e0e1-4b75-9312-e8431ae7169e None None] thread info: [<_MainThread(MainThread, started 137080878157952)>, , , , , ] {{(pid=77505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:46:59 devstack cinder-volume[77505]: DEBUG dbcounter [-] [77505] Writing DB stats cinder:SELECT=1 {{(pid=77505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:46:59 devstack cinder-volume[77505]: DEBUG dbcounter [-] [77505] Writing DB stats cinder:UPDATE=1 {{(pid=77505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:47:25 devstack cinder-volume[77358]: INFO oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] Caught SIGTERM, stopping children Jul 30 16:47:25 devstack cinder-volume[77358]: DEBUG oslo_concurrency.lockutils [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] Acquiring lock "singleton_lock" {{(pid=77358) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 30 16:47:25 devstack cinder-volume[77358]: DEBUG oslo_concurrency.lockutils [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] Acquired lock "singleton_lock" {{(pid=77358) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 30 16:47:25 devstack cinder-volume[77358]: DEBUG oslo_concurrency.lockutils [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] Releasing lock "singleton_lock" {{(pid=77358) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 30 16:47:25 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] Stop services. {{(pid=77358) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 30 16:47:25 devstack cinder-volume[77358]: DEBUG oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] Killing children. {{(pid=77358) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 30 16:47:25 devstack cinder-volume[77358]: INFO oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] Waiting on 1 children to exit Jul 30 16:47:27 devstack cinder-volume[77505]: DEBUG oslo_concurrency.lockutils [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] Acquiring lock "singleton_lock" {{(pid=77505) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 30 16:47:27 devstack cinder-volume[77505]: DEBUG oslo_concurrency.lockutils [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] Acquired lock "singleton_lock" {{(pid=77505) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 30 16:47:27 devstack cinder-volume[77505]: DEBUG oslo_concurrency.lockutils [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] Releasing lock "singleton_lock" {{(pid=77505) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 30 16:47:27 devstack cinder-volume[77505]: WARNING amqp [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 30 16:47:28 devstack cinder-volume[77505]: WARNING amqp [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 30 16:47:28 devstack cinder-volume[77358]: INFO oslo_service.backend._eventlet.service [None req-ee6bfa4a-a5fe-402a-9edb-29920ed95c1d None None] Child 77505 exited with status 0 Jul 30 16:47:28 devstack cinder-volume[87630]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 30 16:47:28 devstack cinder-volume[87630]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 30 16:47:28 devstack cinder-volume[87630]: we strongly recommend against using it for new projects. Jul 30 16:47:28 devstack cinder-volume[87630]: If you are already using Eventlet, we recommend migrating to a different Jul 30 16:47:28 devstack cinder-volume[87630]: framework. For more detail see Jul 30 16:47:28 devstack cinder-volume[87630]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 30 16:47:28 devstack cinder-volume[87630]: import eventlet # noqa Jul 30 16:47:30 devstack cinder-volume[87630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87630) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 30 16:47:30 devstack cinder-volume[87630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87630) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 30 16:47:30 devstack cinder-volume[87630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87630) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 30 16:47:31 devstack cinder-volume[87630]: INFO dbcounter [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] Registered counter for database cinder Jul 30 16:47:31 devstack cinder-volume[87630]: DEBUG oslo_db.sqlalchemy.engines [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87630) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 30 16:47:31 devstack cinder-volume[87630]: DEBUG dbcounter [-] [87630] Writer thread running {{(pid=87630) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 30 16:47:31 devstack cinder-volume[87630]: INFO cinder.rpc [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 30 16:47:31 devstack cinder-volume[87630]: INFO cinder.rpc [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 30 16:47:31 devstack cinder-volume[87630]: DEBUG oslo_db.sqlalchemy.engines [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87630) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 30 16:47:31 devstack cinder-volume[87630]: INFO cinder.volume.manager [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] Determined volume DB was empty at startup. Jul 30 16:47:31 devstack cinder-volume[87630]: DEBUG cinder.volume.manager [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87630) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 30 16:47:31 devstack cinder-volume[87630]: INFO cinder.volume.manager [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 30 16:47:31 devstack cinder-volume[87630]: WARNING stevedore.named [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 30 16:47:31 devstack cinder-volume[87630]: WARNING castellan.key_manager [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 30 16:47:31 devstack cinder-volume[87630]: WARNING cinder.keymgr.conf_key_mgr [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 30 16:47:31 devstack cinder-volume[87630]: INFO cinder.volume.manager [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_db.sqlalchemy.engines [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87630) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 30 16:47:32 devstack cinder-volume[87630]: INFO oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] Starting 1 workers Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] Started child 87894 {{(pid=87630) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] Full set of CONF: {{(pid=87630) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] ******************************************************************************** {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] Configuration options gathered from: {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] ================================================================================ {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] allow_availability_zone_fallback = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] allow_compression_on_image_upload = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] allowed_direct_url_schemes = [] {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] api_rate_limit = True {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] auth_strategy = keystone {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_availability_zone = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_host = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_name = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_stats_polling_interval = 60 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backup_api_class = cinder.backup.api.API {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backup_name_template = backup-%s {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backup_use_same_host = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87894]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backup_use_temp_snapshot = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] chap_password = **** {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] chap_username = {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] cinder_internal_tenant_project_id = 8827ced88ee9415db99d9d82f721ce9c {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] cinder_internal_tenant_user_id = 28c4be5e6208447d955e84a1b8a10e5e {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] cluster = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] compression_format = gzip {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] compute_api_class = cinder.compute.nova.API {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] config_dir = [] {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] config_source = [] {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] control_exchange = openstack {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] debug = True {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] default_availability_zone = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] default_group_type = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] default_volume_type = QuobyteHD {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] disk_geometry = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] driver_client_cert = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] driver_client_cert_key = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] driver_data_namespace = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] driver_ssl_cert_path = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] driver_ssl_cert_verify = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] driver_use_ssl = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] enable_new_services = True {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] enable_unsupported_driver = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] enabled_backends = ['QuobyteHD'] {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] enforce_multipath_for_image_xfer = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] filter_function = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] glance_api_insecure = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] glance_api_servers = ['http://192.168.122.111/image'] {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] glance_api_ssl_compression = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] glance_ca_certificates_file = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] glance_catalog_info = image:glance:publicURL {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] glance_certfile = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] glance_keyfile = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] glance_num_retries = 3 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] glance_request_timeout = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] goodness_function = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] graceful_shutdown_timeout = 5 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] group_api_class = cinder.group.api.API {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] host = devstack {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] image_compress_on_upload = True {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] image_conversion_address_space_limit = 1 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] image_conversion_cpu_limit = 60 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] image_conversion_disable = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] image_upload_use_cinder_backend = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] image_upload_use_internal_tenant = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] image_volume_cache_enabled = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] image_volume_cache_max_count = 0 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] image_volume_cache_max_size_gb = 0 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] init_host_max_objects_retrieval = 0 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] instance_format = [instance: %(uuid)s] {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] iscsi_target_flags = {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] iscsi_write_cache = on {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] iser_helper = tgtadm {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] iser_ip_address = 192.168.122.111 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] iser_port = 3260 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] log_color = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] log_config_append = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] log_dir = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] log_file = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] log_options = True {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] log_rotate_interval = 1 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] log_rotate_interval_type = days {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] log_rotation_type = none {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] max_age = 0 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] max_logfile_count = 30 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] max_logfile_size_mb = 200 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] max_over_subscription_ratio = 20.0 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] message_reap_interval = 86400 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] message_ttl = 2592000 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] migration_create_volume_timeout_secs = 300 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] monkey_patch = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] monkey_patch_modules = [] {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] my_ip = 192.168.122.111 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] no_snapshot_gb_quota = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] num_iser_scan_tries = 3 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] num_shell_tries = 3 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] num_volume_device_scan_tries = 3 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] nvmeof_conn_info_version = 1 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] nvmet_ns_id = 10 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] nvmet_port_id = 1 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] osapi_max_limit = 1000 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] osapi_volume_ext_list = [] {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] osapi_volume_listen_port = 8776 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] osapi_volume_use_ssl = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] osapi_volume_workers = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] per_volume_size_limit = -1 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] periodic_fuzzy_delay = 60 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] periodic_interval = 60 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] public_endpoint = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] publish_errors = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] quota_backup_gigabytes = 1000 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] quota_backups = 10 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] quota_gigabytes = 1000 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] quota_groups = 10 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] quota_snapshots = 10 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] quota_volumes = 10 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] rate_limit_burst = 0 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] rate_limit_except_level = CRITICAL {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] rate_limit_interval = 0 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] reinit_driver_count = 3 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] replication_device = **** {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] report_discard_supported = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] report_interval = 120 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] reservation_clean_interval = 86400 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] reservation_expire = 86400 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] reserved_image_namespaces = [] {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] reserved_percentage = 0 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] rpc_response_timeout = 120 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] run_external_periodic_tasks = True {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] scst_target_driver = iscsi {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] scst_target_iqn_name = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] service_down_time = 720 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] shell_completion = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] snapshot_name_template = snapshot-%s {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] split_loggers = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] state_path = /opt/stack/data/cinder {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] storage_availability_zone = nova {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] storage_protocol = iSCSI {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] syslog_log_facility = LOG_USER {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] target_helper = lioadm {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] target_ip_address = 192.168.122.111 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] target_port = 3260 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] target_protocol = iscsi {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] target_secondary_ip_addresses = [] {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] trace_flags = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] transport_url = **** {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] until_refresh = 0 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] use_chap_auth = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] use_default_quota_class = True {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] use_journal = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] use_json = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] use_multipath_for_image_xfer = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] use_stderr = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] use_syslog = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] verify_glance_signatures = enabled {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] volume_api_class = cinder.volume.api.API {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] volume_backend_name = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] volume_clear = zero {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] volume_clear_ionice = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] volume_clear_size = 0 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] volume_copy_bps_limit = 0 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] volume_dd_blocksize = 1M {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] volume_name_template = volume-%s {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] volume_service_inithost_offload = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87894]: INFO cinder.volume.manager [None req-14b0cd27-d39b-487b-aef0-2f88d54d30c0 None None] Starting volume driver QuobyteDriver (1.2) Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] volume_usage_audit_period = month {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87894]: DEBUG cinder.volume.drivers.remotefs [None req-14b0cd27-d39b-487b-aef0-2f88d54d30c0 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87894) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] zoning_mode = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_concurrency.disable_process_locking = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] keystone_authtoken.auth_section = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] keystone_authtoken.auth_type = password {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] keystone_authtoken.auth_version = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] keystone_authtoken.cache = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] keystone_authtoken.certfile = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] keystone_authtoken.include_service_catalog = True {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] keystone_authtoken.insecure = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] keystone_authtoken.interface = public {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] keystone_authtoken.keyfile = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] keystone_authtoken.memcache_password = {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] keystone_authtoken.memcache_username = {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] keystone_authtoken.region_name = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] keystone_authtoken.service_type = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.111/identity {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] cache.backend = dogpile.cache.null {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] cache.backend_argument = **** {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] cache.backend_expiration_time = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] cache.config_prefix = cache.oslo {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] cache.debug_cache_backend = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] cache.enable_retry_client = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] cache.enable_socket_keepalive = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] cache.enabled = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] cache.expiration_time = 600 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] cache.hashclient_retry_attempts = 2 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] cache.memcache_dead_retry = 300 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] cache.memcache_pool_maxsize = 10 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] cache.memcache_sasl_enabled = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] cache.password = **** {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] cache.proxies = [] {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] cache.redis_db = 0 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] cache.redis_server = localhost:6379 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] cache.retry_attempts = 2 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] cache.retry_delay = 0.0 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] cache.socket_keepalive_count = 1 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] cache.socket_keepalive_idle = 1 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] cache.socket_keepalive_interval = 1 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] cache.socket_timeout = 1.0 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] cache.tls_allowed_ciphers = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] cache.tls_cafile = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] cache.tls_certfile = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] cache.tls_enabled = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] cache.tls_keyfile = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] cache.username = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] coordination.backend_url = **** {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] database.asyncio_connection = **** {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] database.asyncio_slave_connection = **** {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] database.backend = sqlalchemy {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] database.connection = **** {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] database.connection_debug = 0 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] database.connection_parameters = {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] database.connection_recycle_time = 3600 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] database.connection_trace = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] database.db_inc_retry_interval = True {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] database.db_max_retries = 20 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] database.db_max_retry_interval = 10 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] database.db_retry_interval = 1 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] database.max_overflow = 50 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] database.max_pool_size = 5 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] database.max_retries = 10 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] database.mysql_wsrep_sync_wait = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] database.pool_timeout = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] database.retry_interval = 10 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] database.slave_connection = **** {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] database.sqlite_synchronous = True {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] database.synchronous_reader = True {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] database.use_db_reconnect = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] profiler.connection_string = messaging:// {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] profiler.enabled = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] profiler.es_doc_type = notification {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] profiler.es_scroll_size = 10000 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] profiler.es_scroll_time = 2m {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] profiler.filter_error_trace = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] profiler.hmac_keys = **** {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] profiler.sentinel_service_name = mymaster {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] profiler.socket_timeout = 0.1 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] profiler.trace_requests = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] profiler.trace_sqlalchemy = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] profiler_jaeger.process_tags = {} {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] profiler_jaeger.service_name_prefix = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] profiler_otlp.service_name_prefix = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_policy.enforce_new_defaults = True {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_policy.policy_default_rule = default {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_policy.policy_file = policy.yaml {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] privsep_osbrick.group = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] privsep_osbrick.helper_command = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] privsep_osbrick.user = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] cinder_sys_admin.group = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] cinder_sys_admin.helper_command = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] cinder_sys_admin.user = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] service_user.auth_section = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] service_user.auth_type = password {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] service_user.cafile = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] service_user.certfile = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] service_user.collect_timing = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] service_user.insecure = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] service_user.keyfile = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] service_user.send_service_user_token = True {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] service_user.split_loggers = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] service_user.timeout = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] glance.auth_section = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] glance.auth_type = password {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] glance.certfile = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] glance.collect_timing = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] glance.insecure = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] glance.keyfile = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] glance.region_name = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] glance.split_loggers = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] glance.timeout = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.backend_availability_zone = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.chap_password = **** {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.chap_username = {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.disk_geometry = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.driver_client_cert = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.driver_client_cert_key = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.driver_data_namespace = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.driver_use_ssl = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.extra_capabilities = {} {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.filter_function = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.goodness_function = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.iscsi_target_flags = {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.iscsi_write_cache = on {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.iser_helper = tgtadm {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.iser_ip_address = 192.168.122.111 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.iser_port = 3260 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.nas_host = {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.nas_login = admin {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.nas_mount_options = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.nas_password = **** {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.nas_private_key = {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.nas_share_path = {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.num_shell_tries = 3 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.quobyte_volume_url = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.replication_device = **** {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.report_discard_supported = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.reserved_percentage = 0 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.target_helper = tgtadm {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.target_ip_address = 192.168.122.111 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.target_port = 3260 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.target_protocol = iscsi {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.trace_flags = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.unique_fqdn_network = True {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.use_chap_auth = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.volume_backend_name = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.volume_clear = zero {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.volume_clear_ionice = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.volume_clear_size = 0 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_reports.file_event_handler = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_reports.log_dir = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.backend_availability_zone = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.backend_host = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.chap_password = **** {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.chap_username = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.chiscsi_conf = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.disk_geometry = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.driver_client_cert = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.driver_data_namespace = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.driver_use_ssl = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.extra_capabilities = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.filter_function = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.goodness_function = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.iser_helper = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.iser_ip_address = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.iser_port = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.iser_target_prefix = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.nas_host = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.nas_login = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.nas_mount_options = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.nas_password = **** {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.nas_private_key = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.nas_share_path = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.nas_ssh_port = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.num_shell_tries = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.nvmet_port_id = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.replication_device = **** {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.report_discard_supported = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.reserved_percentage = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.scst_target_driver = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.storage_protocol = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.target_helper = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.target_ip_address = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.target_port = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.target_prefix = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.target_protocol = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.trace_flags = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.use_chap_auth = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.volume_clear = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.volume_clear_size = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] QuobyteHD.volumes_dir = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87894]: DEBUG cinder.volume.drivers.quobyte [None req-14b0cd27-d39b-487b-aef0-2f88d54d30c0 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87894) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 30 16:47:32 devstack cinder-volume[87894]: WARNING cinder.volume.drivers.quobyte [None req-14b0cd27-d39b-487b-aef0-2f88d54d30c0 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87894]: WARNING cinder.volume.drivers.quobyte [None req-14b0cd27-d39b-487b-aef0-2f88d54d30c0 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_messaging_rabbit.ssl = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_messaging_notifications.driver = [] {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_messaging_notifications.retry = -1 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87894]: DEBUG oslo_concurrency.processutils [None req-14b0cd27-d39b-487b-aef0-2f88d54d30c0 None None] Running cmd (subprocess): mount.quobyte {{(pid=87894) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] key_manager.fixed_key = **** {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] barbican.barbican_api_version = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] barbican.barbican_endpoint = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] barbican.barbican_endpoint_type = public {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] barbican.barbican_region_name = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] barbican.cafile = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] barbican.certfile = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] barbican.collect_timing = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] barbican.insecure = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] barbican.keyfile = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] barbican.number_of_retries = 60 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] barbican.retry_delay = 1 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] barbican.send_service_user_token = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] barbican.split_loggers = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] barbican.timeout = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] barbican.verify_ssl = True {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] barbican.verify_ssl_path = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] barbican_service_user.auth_section = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] barbican_service_user.auth_type = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] barbican_service_user.cafile = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] barbican_service_user.certfile = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] barbican_service_user.collect_timing = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] barbican_service_user.insecure = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] barbican_service_user.keyfile = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] barbican_service_user.split_loggers = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] barbican_service_user.timeout = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] vault.approle_role_id = **** {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] vault.approle_secret_id = **** {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] vault.auth_method = approle {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] vault.auth_path = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] vault.kv_mountpoint = secret {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] vault.kv_path = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] vault.kv_version = 2 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] vault.namespace = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] vault.root_token_id = **** {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] vault.ssl_ca_crt_file = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] vault.timeout = 60.0 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] vault.token_file = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] vault.token_role = None {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] vault.use_ssl = False {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:32 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] ******************************************************************************** {{(pid=87630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 30 16:47:32 devstack quobyte-client[87907]: Reading configuration file: /etc/quobyte/client.cfg Jul 30 16:47:32 devstack quobyte-client[87907]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 30 16:47:32 devstack cinder-volume[87894]: DEBUG oslo_concurrency.processutils [None req-14b0cd27-d39b-487b-aef0-2f88d54d30c0 None None] CMD "mount.quobyte" returned: 1 in 0.083s {{(pid=87894) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:32 devstack cinder-volume[87894]: DEBUG oslo_concurrency.lockutils [None req-14b0cd27-d39b-487b-aef0-2f88d54d30c0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87894) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:32 devstack cinder-volume[87894]: DEBUG oslo_concurrency.lockutils [None req-14b0cd27-d39b-487b-aef0-2f88d54d30c0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87894) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:32 devstack cinder-volume[87894]: DEBUG cinder.volume.drivers.quobyte [None req-14b0cd27-d39b-487b-aef0-2f88d54d30c0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=87894) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:32 devstack cinder-volume[87894]: INFO cinder.volume.drivers.quobyte [None req-14b0cd27-d39b-487b-aef0-2f88d54d30c0 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 ... Jul 30 16:47:32 devstack cinder-volume[87894]: DEBUG oslo_concurrency.processutils [None req-14b0cd27-d39b-487b-aef0-2f88d54d30c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 -c /etc/quobyte/client-cinder.cfg {{(pid=87894) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:32 devstack sudo[87908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 -c /etc/quobyte/client-cinder.cfg Jul 30 16:47:32 devstack sudo[87908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:32 devstack sudo[87908]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:32 devstack cinder-volume[87894]: DEBUG oslo_concurrency.processutils [None req-14b0cd27-d39b-487b-aef0-2f88d54d30c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.460s {{(pid=87894) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:32 devstack cinder-volume[87894]: INFO cinder.volume.drivers.quobyte [None req-14b0cd27-d39b-487b-aef0-2f88d54d30c0 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 succeeded Jul 30 16:47:32 devstack cinder-volume[87894]: DEBUG cinder.volume.drivers.quobyte [None req-14b0cd27-d39b-487b-aef0-2f88d54d30c0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=87894) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:32 devstack cinder-volume[87894]: DEBUG oslo_concurrency.lockutils [None req-14b0cd27-d39b-487b-aef0-2f88d54d30c0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.481s {{(pid=87894) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:32 devstack cinder-volume[87894]: DEBUG oslo_concurrency.processutils [None req-14b0cd27-d39b-487b-aef0-2f88d54d30c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=87894) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:32 devstack sudo[88012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:47:32 devstack sudo[88012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:33 devstack sudo[88012]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:33 devstack cinder-volume[87894]: DEBUG oslo_concurrency.processutils [None req-14b0cd27-d39b-487b-aef0-2f88d54d30c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.332s {{(pid=87894) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:33 devstack cinder-volume[87894]: INFO cinder.volume.driver [None req-14b0cd27-d39b-487b-aef0-2f88d54d30c0 None None] Driver hasn't implemented _init_vendor_properties() Jul 30 16:47:33 devstack cinder-volume[87894]: DEBUG cinder.volume.driver [None req-14b0cd27-d39b-487b-aef0-2f88d54d30c0 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6732902526855, 'free_capacity_gb': 1775.6732902526855, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87894) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 30 16:47:33 devstack cinder-volume[87894]: DEBUG oslo_db.sqlalchemy.engines [None req-14b0cd27-d39b-487b-aef0-2f88d54d30c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87894) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 30 16:47:33 devstack cinder-volume[87894]: DEBUG dbcounter [-] [87894] Writer thread running {{(pid=87894) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 30 16:47:33 devstack cinder-volume[87894]: DEBUG cinder.db.api [None req-14b0cd27-d39b-487b-aef0-2f88d54d30c0 None None] Building query based on filter {{(pid=87894) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 30 16:47:33 devstack cinder-volume[87894]: DEBUG cinder.image.image_utils [None req-14b0cd27-d39b-487b-aef0-2f88d54d30c0 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87894) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 30 16:47:33 devstack cinder-volume[87894]: INFO cinder.keymgr.migration [None req-2bc0165b-92a7-4bdd-93c3-3c2ebd334b33 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 30 16:47:33 devstack cinder-volume[87894]: DEBUG oslo_concurrency.lockutils [None req-14b0cd27-d39b-487b-aef0-2f88d54d30c0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87894) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:33 devstack cinder-volume[87894]: DEBUG oslo_concurrency.lockutils [None req-14b0cd27-d39b-487b-aef0-2f88d54d30c0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87894) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:33 devstack cinder-volume[87894]: DEBUG cinder.volume.drivers.quobyte [None req-14b0cd27-d39b-487b-aef0-2f88d54d30c0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=87894) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:33 devstack cinder-volume[87894]: DEBUG cinder.volume.drivers.quobyte [None req-14b0cd27-d39b-487b-aef0-2f88d54d30c0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=87894) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:33 devstack cinder-volume[87894]: DEBUG oslo_concurrency.lockutils [None req-14b0cd27-d39b-487b-aef0-2f88d54d30c0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87894) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:33 devstack cinder-volume[87894]: DEBUG oslo_concurrency.processutils [None req-14b0cd27-d39b-487b-aef0-2f88d54d30c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=87894) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:33 devstack sudo[88032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:47:33 devstack sudo[88032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:33 devstack sudo[88032]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:33 devstack cinder-volume[87894]: DEBUG oslo_concurrency.processutils [None req-14b0cd27-d39b-487b-aef0-2f88d54d30c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.244s {{(pid=87894) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:33 devstack cinder-volume[87894]: DEBUG cinder.manager [None req-14b0cd27-d39b-487b-aef0-2f88d54d30c0 None None] Notifying Schedulers of capabilities ... {{(pid=87894) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:47:33 devstack cinder-volume[87894]: INFO cinder.volume.manager [None req-14b0cd27-d39b-487b-aef0-2f88d54d30c0 None None] Driver initialization completed successfully. Jul 30 16:47:33 devstack cinder-volume[87894]: INFO cinder.manager [None req-14b0cd27-d39b-487b-aef0-2f88d54d30c0 None None] Initiating service 3 cleanup Jul 30 16:47:33 devstack cinder-volume[87894]: INFO cinder.manager [None req-14b0cd27-d39b-487b-aef0-2f88d54d30c0 None None] Service 3 cleanup completed. Jul 30 16:47:33 devstack cinder-volume[87894]: DEBUG cinder.service [None req-14b0cd27-d39b-487b-aef0-2f88d54d30c0 None None] Creating RPC server for service cinder-volume {{(pid=87894) start /opt/stack/cinder/cinder/service.py:231}} Jul 30 16:47:33 devstack cinder-volume[87894]: DEBUG cinder.service [None req-14b0cd27-d39b-487b-aef0-2f88d54d30c0 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87894) start /opt/stack/cinder/cinder/service.py:237}} Jul 30 16:47:33 devstack cinder-volume[87894]: INFO cinder.volume.manager [None req-14b0cd27-d39b-487b-aef0-2f88d54d30c0 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 30 16:47:33 devstack cinder-volume[87894]: DEBUG oslo_concurrency.lockutils [None req-14b0cd27-d39b-487b-aef0-2f88d54d30c0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87894) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:33 devstack cinder-volume[87894]: DEBUG oslo_concurrency.lockutils [None req-14b0cd27-d39b-487b-aef0-2f88d54d30c0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87894) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:33 devstack cinder-volume[87894]: DEBUG cinder.volume.drivers.quobyte [None req-14b0cd27-d39b-487b-aef0-2f88d54d30c0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=87894) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:33 devstack cinder-volume[87894]: DEBUG cinder.volume.drivers.quobyte [None req-14b0cd27-d39b-487b-aef0-2f88d54d30c0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=87894) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:33 devstack cinder-volume[87894]: DEBUG oslo_concurrency.lockutils [None req-14b0cd27-d39b-487b-aef0-2f88d54d30c0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87894) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:33 devstack cinder-volume[87894]: DEBUG oslo_concurrency.processutils [None req-14b0cd27-d39b-487b-aef0-2f88d54d30c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=87894) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:33 devstack sudo[88043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:47:33 devstack sudo[88043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:34 devstack sudo[88043]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:34 devstack cinder-volume[87894]: DEBUG oslo_concurrency.processutils [None req-14b0cd27-d39b-487b-aef0-2f88d54d30c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.298s {{(pid=87894) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:34 devstack cinder-volume[87894]: INFO cinder.volume.manager [None req-14b0cd27-d39b-487b-aef0-2f88d54d30c0 None None] Driver post RPC initialization completed successfully. Jul 30 16:47:38 devstack cinder-volume[87630]: INFO oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] Caught SIGTERM, stopping children Jul 30 16:47:38 devstack cinder-volume[87630]: DEBUG oslo_concurrency.lockutils [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] Acquiring lock "singleton_lock" {{(pid=87630) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 30 16:47:38 devstack cinder-volume[87630]: DEBUG oslo_concurrency.lockutils [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] Acquired lock "singleton_lock" {{(pid=87630) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 30 16:47:38 devstack cinder-volume[87630]: DEBUG oslo_concurrency.lockutils [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] Releasing lock "singleton_lock" {{(pid=87630) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 30 16:47:38 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] Stop services. {{(pid=87630) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 30 16:47:38 devstack cinder-volume[87630]: DEBUG oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] Killing children. {{(pid=87630) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 30 16:47:38 devstack cinder-volume[87630]: INFO oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] Waiting on 1 children to exit Jul 30 16:47:42 devstack cinder-volume[87894]: DEBUG oslo_concurrency.lockutils [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] Acquiring lock "singleton_lock" {{(pid=87894) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 30 16:47:42 devstack cinder-volume[87894]: DEBUG oslo_concurrency.lockutils [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] Acquired lock "singleton_lock" {{(pid=87894) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 30 16:47:42 devstack cinder-volume[87894]: DEBUG oslo_concurrency.lockutils [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] Releasing lock "singleton_lock" {{(pid=87894) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 30 16:47:42 devstack cinder-volume[87894]: WARNING amqp [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 30 16:47:42 devstack cinder-volume[87894]: WARNING amqp [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 30 16:47:42 devstack cinder-volume[87630]: INFO oslo_service.backend._eventlet.service [None req-1add48ef-37c6-4ea3-9cac-4734c629b025 None None] Child 87894 exited with status 0 Jul 30 16:47:42 devstack cinder-volume[88333]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 30 16:47:42 devstack cinder-volume[88333]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 30 16:47:42 devstack cinder-volume[88333]: we strongly recommend against using it for new projects. Jul 30 16:47:42 devstack cinder-volume[88333]: If you are already using Eventlet, we recommend migrating to a different Jul 30 16:47:42 devstack cinder-volume[88333]: framework. For more detail see Jul 30 16:47:42 devstack cinder-volume[88333]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 30 16:47:42 devstack cinder-volume[88333]: import eventlet # noqa Jul 30 16:47:45 devstack cinder-volume[88333]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=88333) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 30 16:47:45 devstack cinder-volume[88333]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=88333) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 30 16:47:45 devstack cinder-volume[88333]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=88333) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 30 16:47:46 devstack cinder-volume[88333]: INFO dbcounter [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] Registered counter for database cinder Jul 30 16:47:46 devstack cinder-volume[88333]: DEBUG oslo_db.sqlalchemy.engines [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88333) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG dbcounter [-] [88333] Writer thread running {{(pid=88333) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 30 16:47:47 devstack cinder-volume[88333]: INFO cinder.rpc [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 30 16:47:47 devstack cinder-volume[88333]: INFO cinder.rpc [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_db.sqlalchemy.engines [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88333) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 30 16:47:47 devstack cinder-volume[88333]: INFO cinder.volume.manager [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] Determined volume DB was empty at startup. Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG cinder.volume.manager [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] Cinder Volume DB check: vol_db_empty=True {{(pid=88333) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 30 16:47:47 devstack cinder-volume[88333]: WARNING stevedore.named [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 30 16:47:47 devstack cinder-volume[88333]: WARNING castellan.key_manager [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 30 16:47:47 devstack cinder-volume[88333]: WARNING cinder.keymgr.conf_key_mgr [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 30 16:47:47 devstack cinder-volume[88333]: INFO cinder.volume.manager [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_db.sqlalchemy.engines [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88333) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 30 16:47:47 devstack cinder-volume[88333]: INFO oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] Starting 1 workers Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] Started child 88591 {{(pid=88333) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] Full set of CONF: {{(pid=88333) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] ******************************************************************************** {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] Configuration options gathered from: {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] ================================================================================ {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 30 16:47:47 devstack cinder-volume[88591]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] allow_availability_zone_fallback = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] allow_compression_on_image_upload = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] allowed_direct_url_schemes = [] {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] api_rate_limit = True {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] auth_strategy = keystone {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_availability_zone = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_host = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_name = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_stats_polling_interval = 60 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backup_api_class = cinder.backup.api.API {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backup_name_template = backup-%s {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backup_use_same_host = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backup_use_temp_snapshot = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] chap_password = **** {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] chap_username = {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] cinder_internal_tenant_project_id = 8827ced88ee9415db99d9d82f721ce9c {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] cinder_internal_tenant_user_id = 28c4be5e6208447d955e84a1b8a10e5e {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] cluster = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] compression_format = gzip {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] compute_api_class = cinder.compute.nova.API {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] config_dir = [] {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] config_source = [] {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] control_exchange = openstack {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] debug = True {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] default_availability_zone = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] default_group_type = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] default_volume_type = QuobyteHD {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] disk_geometry = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] driver_client_cert = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] driver_client_cert_key = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] driver_data_namespace = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] driver_ssl_cert_path = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] driver_ssl_cert_verify = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] driver_use_ssl = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] enable_new_services = True {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] enable_unsupported_driver = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] enabled_backends = ['QuobyteHD'] {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] enforce_multipath_for_image_xfer = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] filter_function = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] glance_api_insecure = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] glance_api_servers = ['http://192.168.122.111/image'] {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] glance_api_ssl_compression = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] glance_ca_certificates_file = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] glance_catalog_info = image:glance:publicURL {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] glance_certfile = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] glance_keyfile = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] glance_num_retries = 3 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] glance_request_timeout = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] goodness_function = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] graceful_shutdown_timeout = 5 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] group_api_class = cinder.group.api.API {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] host = devstack {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] image_compress_on_upload = True {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] image_conversion_address_space_limit = 1 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] image_conversion_cpu_limit = 60 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] image_conversion_disable = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] image_upload_use_cinder_backend = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] image_upload_use_internal_tenant = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] image_volume_cache_enabled = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] image_volume_cache_max_count = 0 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] image_volume_cache_max_size_gb = 0 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] init_host_max_objects_retrieval = 0 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] instance_format = [instance: %(uuid)s] {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] iscsi_target_flags = {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] iscsi_write_cache = on {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] iser_helper = tgtadm {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] iser_ip_address = 192.168.122.111 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] iser_port = 3260 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] log_color = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] log_config_append = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] log_dir = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] log_file = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] log_options = True {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] log_rotate_interval = 1 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] log_rotate_interval_type = days {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] log_rotation_type = none {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] max_age = 0 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-f5c71c79-548c-4c5c-b0f0-49503952d4ac None None] Starting volume driver QuobyteDriver (1.2) Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] max_logfile_count = 30 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] max_logfile_size_mb = 200 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] max_over_subscription_ratio = 20.0 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-f5c71c79-548c-4c5c-b0f0-49503952d4ac None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88591) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] message_reap_interval = 86400 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] message_ttl = 2592000 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] migration_create_volume_timeout_secs = 300 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] monkey_patch = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] monkey_patch_modules = [] {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] my_ip = 192.168.122.111 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] no_snapshot_gb_quota = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] num_iser_scan_tries = 3 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] num_shell_tries = 3 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] num_volume_device_scan_tries = 3 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] nvmeof_conn_info_version = 1 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] nvmet_ns_id = 10 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] nvmet_port_id = 1 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] osapi_max_limit = 1000 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] osapi_volume_ext_list = [] {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] osapi_volume_listen = 0.0.0.0 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] osapi_volume_listen_port = 8776 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] osapi_volume_use_ssl = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] osapi_volume_workers = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] per_volume_size_limit = -1 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] periodic_fuzzy_delay = 60 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] periodic_interval = 60 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] project_id_regex = [0-9a-f\-]+ {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] public_endpoint = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] publish_errors = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] quota_backup_gigabytes = 1000 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] quota_backups = 10 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] quota_gigabytes = 1000 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] quota_groups = 10 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] quota_snapshots = 10 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] quota_volumes = 10 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] rate_limit_burst = 0 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] rate_limit_except_level = CRITICAL {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] rate_limit_interval = 0 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] reinit_driver_count = 3 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] replication_device = **** {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] report_discard_supported = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] report_interval = 120 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] reservation_clean_interval = 86400 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] reservation_expire = 86400 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] reserved_image_namespaces = [] {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] reserved_percentage = 0 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] rpc_response_timeout = 120 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] run_external_periodic_tasks = True {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] scst_target_driver = iscsi {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] scst_target_iqn_name = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] service_down_time = 720 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] shell_completion = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] snapshot_name_template = snapshot-%s {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] split_loggers = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] state_path = /opt/stack/data/cinder {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] storage_availability_zone = nova {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] storage_protocol = iSCSI {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] syslog_log_facility = LOG_USER {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] target_helper = lioadm {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] target_ip_address = 192.168.122.111 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] target_port = 3260 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] target_protocol = iscsi {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] target_secondary_ip_addresses = [] {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] trace_flags = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] transfer_api_class = cinder.transfer.api.API {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] transport_url = **** {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] until_refresh = 0 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] use_chap_auth = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] use_default_quota_class = True {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] use_journal = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] use_json = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] use_multipath_for_image_xfer = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] use_stderr = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] use_syslog = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] verify_glance_signatures = enabled {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] volume_api_class = cinder.volume.api.API {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] volume_backend_name = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] volume_clear = zero {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] volume_clear_ionice = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] volume_clear_size = 0 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] volume_copy_bps_limit = 0 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] volume_dd_blocksize = 1M {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] volume_name_template = volume-%s {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] volume_service_inithost_offload = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] volume_usage_audit_period = month {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] zoning_mode = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_concurrency.disable_process_locking = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] os_brick.lightos_discovery_client_address = localhost {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] os_brick.wait_mpath_device_interval = 1 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] keystone_authtoken.auth_section = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] keystone_authtoken.auth_type = password {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] keystone_authtoken.auth_version = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] keystone_authtoken.cache = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] keystone_authtoken.certfile = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] keystone_authtoken.delay_auth_decision = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] keystone_authtoken.http_connect_timeout = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] keystone_authtoken.include_service_catalog = True {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] keystone_authtoken.insecure = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] keystone_authtoken.interface = public {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] keystone_authtoken.keyfile = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] keystone_authtoken.memcache_password = {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] keystone_authtoken.memcache_secret_key = **** {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] keystone_authtoken.memcache_security_strategy = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] keystone_authtoken.memcache_username = {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] keystone_authtoken.region_name = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] keystone_authtoken.service_token_roles_required = True {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] keystone_authtoken.service_type = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] keystone_authtoken.token_cache_time = 300 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.111/identity {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] cache.backend = dogpile.cache.null {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] cache.backend_argument = **** {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] cache.backend_expiration_time = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] cache.config_prefix = cache.oslo {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] cache.debug_cache_backend = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] cache.enable_retry_client = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] cache.enable_socket_keepalive = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] cache.enabled = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] cache.expiration_time = 600 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] cache.hashclient_dead_timeout = 60.0 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] cache.hashclient_retry_attempts = 2 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] cache.hashclient_retry_timeout = 1.0 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] cache.memcache_dead_retry = 300 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] cache.memcache_pool_maxsize = 10 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] cache.memcache_pool_unused_timeout = 60 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] cache.memcache_sasl_enabled = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] cache.memcache_servers = ['localhost:11211'] {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] cache.password = **** {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] cache.proxies = [] {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] cache.redis_db = 0 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] cache.redis_sentinel_service_name = mymaster {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] cache.redis_server = localhost:6379 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] cache.retry_attempts = 2 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] cache.retry_delay = 0.0 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] cache.socket_keepalive_count = 1 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] cache.socket_keepalive_idle = 1 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] cache.socket_keepalive_interval = 1 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] cache.socket_timeout = 1.0 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] cache.tls_allowed_ciphers = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] cache.tls_cafile = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] cache.tls_certfile = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] cache.tls_enabled = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] cache.tls_keyfile = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] cache.username = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] coordination.backend_url = **** {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] database.asyncio_connection = **** {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] database.asyncio_slave_connection = **** {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] database.backend = sqlalchemy {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] database.connection = **** {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] database.connection_debug = 0 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] database.connection_parameters = {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] database.connection_recycle_time = 3600 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] database.connection_trace = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] database.db_inc_retry_interval = True {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] database.db_max_retries = 20 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] database.db_max_retry_interval = 10 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] database.db_retry_interval = 1 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] database.max_overflow = 50 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] database.max_pool_size = 5 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] database.max_retries = 10 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] database.mysql_sql_mode = TRADITIONAL {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] database.mysql_wsrep_sync_wait = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] database.pool_timeout = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] database.retry_interval = 10 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] database.slave_connection = **** {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] database.sqlite_synchronous = True {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] database.synchronous_reader = True {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] database.use_db_reconnect = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f5c71c79-548c-4c5c-b0f0-49503952d4ac None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88591) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_messaging_metrics.metrics_process_name = {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.quobyte [None req-f5c71c79-548c-4c5c-b0f0-49503952d4ac None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] profiler.connection_string = messaging:// {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.quobyte [None req-f5c71c79-548c-4c5c-b0f0-49503952d4ac None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] profiler.enabled = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] profiler.es_doc_type = notification {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] profiler.es_scroll_size = 10000 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] profiler.es_scroll_time = 2m {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] profiler.filter_error_trace = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f5c71c79-548c-4c5c-b0f0-49503952d4ac None None] Running cmd (subprocess): mount.quobyte {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] profiler.hmac_keys = **** {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] profiler.sentinel_service_name = mymaster {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] profiler.socket_timeout = 0.1 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] profiler.trace_requests = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] profiler.trace_sqlalchemy = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] profiler_jaeger.process_tags = {} {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] profiler_jaeger.service_name_prefix = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] profiler_otlp.service_name_prefix = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_policy.enforce_new_defaults = True {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_policy.policy_default_rule = default {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_policy.policy_file = policy.yaml {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_policy.remote_timeout = 60.0 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] privsep_osbrick.capabilities = [21, 2] {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] privsep_osbrick.group = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] privsep_osbrick.helper_command = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] privsep_osbrick.log_daemon_traceback = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] privsep_osbrick.thread_pool_size = 4 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] privsep_osbrick.user = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] cinder_sys_admin.group = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] cinder_sys_admin.helper_command = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] cinder_sys_admin.user = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] service_user.auth_section = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] service_user.auth_type = password {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] service_user.cafile = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] service_user.certfile = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] service_user.collect_timing = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] service_user.insecure = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] service_user.keyfile = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] service_user.send_service_user_token = True {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] service_user.split_loggers = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] service_user.timeout = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] glance.auth_section = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] glance.auth_type = password {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] glance.certfile = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] glance.collect_timing = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] glance.insecure = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] glance.keyfile = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] glance.region_name = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] glance.split_loggers = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] glance.timeout = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.backend_availability_zone = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.chap_password = **** {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.chap_username = {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.disk_geometry = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.driver_client_cert = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.driver_client_cert_key = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.driver_data_namespace = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.driver_ssl_cert_path = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.driver_use_ssl = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.enable_unsupported_driver = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.extra_capabilities = {} {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.filter_function = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.goodness_function = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.image_volume_cache_enabled = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.iscsi_target_flags = {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.iscsi_write_cache = on {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.iser_helper = tgtadm {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.iser_ip_address = 192.168.122.111 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.iser_port = 3260 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.nas_host = {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.nas_login = admin {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.nas_mount_options = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.nas_password = **** {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.nas_private_key = {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.nas_secure_file_operations = auto {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.nas_share_path = {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.nas_ssh_port = 22 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.nas_volume_prov_type = thin {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.num_shell_tries = 3 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.nvmet_ns_id = 10 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.nvmet_port_id = 1 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.quobyte_client_cfg = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.quobyte_volume_url = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.replication_device = **** {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.report_discard_supported = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.reserved_percentage = 0 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.scst_target_driver = iscsi {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.scst_target_iqn_name = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.storage_protocol = iSCSI {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.target_helper = tgtadm {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.target_ip_address = 192.168.122.111 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.target_port = 3260 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.target_protocol = iscsi {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.trace_flags = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.unique_fqdn_network = True {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.use_chap_auth = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.volume_backend_name = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.volume_clear = zero {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.volume_clear_ionice = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.volume_clear_size = 0 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_reports.file_event_handler = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_reports.file_event_handler_interval = 1 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_reports.log_dir = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.backend_availability_zone = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.backend_host = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.chap_password = **** {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.chap_username = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.chiscsi_conf = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack quobyte-client[88592]: Reading configuration file: /etc/quobyte/client.cfg Jul 30 16:47:47 devstack quobyte-client[88592]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.disk_geometry = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.driver_client_cert = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.driver_client_cert_key = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.driver_data_namespace = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.driver_use_ssl = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.enable_unsupported_driver = True {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.extra_capabilities = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.filter_function = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f5c71c79-548c-4c5c-b0f0-49503952d4ac None None] CMD "mount.quobyte" returned: 1 in 0.061s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.goodness_function = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f5c71c79-548c-4c5c-b0f0-49503952d4ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f5c71c79-548c-4c5c-b0f0-49503952d4ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:47 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f5c71c79-548c-4c5c-b0f0-49503952d4ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.iscsi_target_flags = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.iscsi_write_cache = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.iser_helper = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.iser_ip_address = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.iser_port = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.iser_target_prefix = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f5c71c79-548c-4c5c-b0f0-49503952d4ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.nas_host = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f5c71c79-548c-4c5c-b0f0-49503952d4ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.nas_login = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.nas_mount_options = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f5c71c79-548c-4c5c-b0f0-49503952d4ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.nas_password = **** {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.nas_private_key = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.nas_secure_file_operations = false {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.nas_share_path = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.nas_ssh_port = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.nas_volume_prov_type = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.num_iser_scan_tries = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.num_shell_tries = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.nvmet_ns_id = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.nvmet_port_id = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.replication_device = **** {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.report_discard_supported = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.reserved_percentage = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.scst_target_driver = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.scst_target_iqn_name = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.storage_protocol = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.target_helper = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.target_ip_address = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.target_port = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.target_prefix = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.target_protocol = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.trace_flags = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.unique_fqdn_network = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.use_chap_auth = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.volume_clear = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.volume_clear_ionice = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.volume_clear_size = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.volume_dd_blocksize = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] QuobyteHD.volumes_dir = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_messaging_rabbit.hostname = devstack {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack sudo[88593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack sudo[88593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_messaging_rabbit.ssl = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_messaging_rabbit.ssl_version = {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_messaging_notifications.driver = [] {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_messaging_notifications.retry = -1 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] oslo_messaging_notifications.transport_url = **** {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] key_manager.fixed_key = **** {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] barbican.barbican_api_version = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] barbican.barbican_endpoint = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] barbican.barbican_endpoint_type = public {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] barbican.barbican_region_name = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] barbican.cafile = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] barbican.certfile = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] barbican.collect_timing = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] barbican.insecure = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] barbican.keyfile = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] barbican.number_of_retries = 60 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] barbican.retry_delay = 1 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] barbican.send_service_user_token = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] barbican.split_loggers = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] barbican.timeout = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] barbican.verify_ssl = True {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] barbican.verify_ssl_path = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] barbican_service_user.auth_section = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] barbican_service_user.auth_type = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] barbican_service_user.cafile = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] barbican_service_user.certfile = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] barbican_service_user.collect_timing = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] barbican_service_user.insecure = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] barbican_service_user.keyfile = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] barbican_service_user.split_loggers = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] barbican_service_user.timeout = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] vault.approle_role_id = **** {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] vault.approle_secret_id = **** {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] vault.auth_method = approle {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] vault.auth_path = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] vault.kv_mountpoint = secret {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] vault.kv_path = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] vault.kv_version = 2 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] vault.namespace = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] vault.root_token_id = **** {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] vault.ssl_ca_crt_file = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] vault.timeout = 60.0 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] vault.token_file = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] vault.token_role = None {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] vault.use_ssl = False {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:47:47 devstack cinder-volume[88333]: DEBUG oslo_service.backend._eventlet.service [None req-67d9eccf-8c32-455f-97f7-faa907f9c6cb None None] ******************************************************************************** {{(pid=88333) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 30 16:47:47 devstack sudo[88593]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f5c71c79-548c-4c5c-b0f0-49503952d4ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.241s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:47 devstack cinder-volume[88591]: INFO cinder.volume.driver [None req-f5c71c79-548c-4c5c-b0f0-49503952d4ac None None] Driver hasn't implemented _init_vendor_properties() Jul 30 16:47:47 devstack cinder-volume[88591]: DEBUG cinder.volume.driver [None req-f5c71c79-548c-4c5c-b0f0-49503952d4ac None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6732902526855, 'free_capacity_gb': 1775.6732902526855, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88591) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 30 16:47:47 devstack cinder-volume[88591]: DEBUG oslo_db.sqlalchemy.engines [None req-f5c71c79-548c-4c5c-b0f0-49503952d4ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88591) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 30 16:47:47 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writer thread running {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 30 16:47:47 devstack cinder-volume[88591]: DEBUG cinder.db.api [None req-f5c71c79-548c-4c5c-b0f0-49503952d4ac None None] Building query based on filter {{(pid=88591) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 30 16:47:47 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-f5c71c79-548c-4c5c-b0f0-49503952d4ac None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88591) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 30 16:47:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f5c71c79-548c-4c5c-b0f0-49503952d4ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f5c71c79-548c-4c5c-b0f0-49503952d4ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:47 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f5c71c79-548c-4c5c-b0f0-49503952d4ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:47 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f5c71c79-548c-4c5c-b0f0-49503952d4ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f5c71c79-548c-4c5c-b0f0-49503952d4ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f5c71c79-548c-4c5c-b0f0-49503952d4ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:47 devstack cinder-volume[88591]: INFO cinder.keymgr.migration [None req-8851819f-9cc7-4b52-aa5f-36e73c359f09 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 30 16:47:47 devstack sudo[88596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:47:47 devstack sudo[88596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:48 devstack sudo[88596]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f5c71c79-548c-4c5c-b0f0-49503952d4ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.228s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:48 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-f5c71c79-548c-4c5c-b0f0-49503952d4ac None None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:47:48 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-f5c71c79-548c-4c5c-b0f0-49503952d4ac None None] Driver initialization completed successfully. Jul 30 16:47:48 devstack cinder-volume[88591]: INFO cinder.manager [None req-f5c71c79-548c-4c5c-b0f0-49503952d4ac None None] Initiating service 3 cleanup Jul 30 16:47:48 devstack cinder-volume[88591]: INFO cinder.manager [None req-f5c71c79-548c-4c5c-b0f0-49503952d4ac None None] Service 3 cleanup completed. Jul 30 16:47:48 devstack cinder-volume[88591]: DEBUG cinder.service [None req-f5c71c79-548c-4c5c-b0f0-49503952d4ac None None] Creating RPC server for service cinder-volume {{(pid=88591) start /opt/stack/cinder/cinder/service.py:231}} Jul 30 16:47:48 devstack cinder-volume[88591]: DEBUG cinder.service [None req-f5c71c79-548c-4c5c-b0f0-49503952d4ac None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88591) start /opt/stack/cinder/cinder/service.py:237}} Jul 30 16:47:48 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-f5c71c79-548c-4c5c-b0f0-49503952d4ac None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 30 16:47:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f5c71c79-548c-4c5c-b0f0-49503952d4ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f5c71c79-548c-4c5c-b0f0-49503952d4ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:48 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f5c71c79-548c-4c5c-b0f0-49503952d4ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:48 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f5c71c79-548c-4c5c-b0f0-49503952d4ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f5c71c79-548c-4c5c-b0f0-49503952d4ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f5c71c79-548c-4c5c-b0f0-49503952d4ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:48 devstack sudo[88601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:47:48 devstack sudo[88601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:48 devstack sudo[88601]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f5c71c79-548c-4c5c-b0f0-49503952d4ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.272s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:48 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-f5c71c79-548c-4c5c-b0f0-49503952d4ac None None] Driver post RPC initialization completed successfully. Jul 30 16:47:57 devstack cinder-volume[88333]: DEBUG dbcounter [-] [88333] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=88333) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:47:58 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:SELECT=2 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:47:58 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:48:12 devstack cinder-volume[88591]: DEBUG oslo_service.periodic_task [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running periodic task VolumeManager._thread_info {{(pid=88591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:48:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] thread count: 6 {{(pid=88591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:48:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] thread info: [<_MainThread(MainThread, started 140677178003584)>, , , , , ] {{(pid=88591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:49:10 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b58c8e6-0dbd-4974-9837-0f832ca6e61e tempest-DeleteServersTestJSON-294110885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:49:11 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8b58c8e6-0dbd-4974-9837-0f832ca6e61e tempest-DeleteServersTestJSON-294110885 None] Flow 'volume_create_manager' (b2e680a2-8cfc-412d-a081-61fea5c44dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:49:11 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8b58c8e6-0dbd-4974-9837-0f832ca6e61e tempest-DeleteServersTestJSON-294110885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b14363c-98fe-4f4a-a424-098d056a08bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:49:11 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8b58c8e6-0dbd-4974-9837-0f832ca6e61e tempest-DeleteServersTestJSON-294110885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b14363c-98fe-4f4a-a424-098d056a08bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:49:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1073204906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5900c9cf-9b49-4694-86db-812f4e2e372b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ba42d5089534e1da37177d0bd3256a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:49:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:49:11Z,use_quota=True,user_id='061efab065444955849c20f0533ede4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:49:11 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8b58c8e6-0dbd-4974-9837-0f832ca6e61e tempest-DeleteServersTestJSON-294110885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a6a20ce-c912-4df9-b4fd-7ae59ef79e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:49:11 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8b58c8e6-0dbd-4974-9837-0f832ca6e61e tempest-DeleteServersTestJSON-294110885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a6a20ce-c912-4df9-b4fd-7ae59ef79e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:49:11 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8b58c8e6-0dbd-4974-9837-0f832ca6e61e tempest-DeleteServersTestJSON-294110885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a3afe4d-4b2f-4f8b-87e1-2d0052bfb668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:49:11 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8b58c8e6-0dbd-4974-9837-0f832ca6e61e tempest-DeleteServersTestJSON-294110885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a3afe4d-4b2f-4f8b-87e1-2d0052bfb668) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5900c9cf-9b49-4694-86db-812f4e2e372b', 'volume_name': 'volume-5900c9cf-9b49-4694-86db-812f4e2e372b', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:49:11 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8b58c8e6-0dbd-4974-9837-0f832ca6e61e tempest-DeleteServersTestJSON-294110885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8b851ce-c696-422f-a9c0-dda3131157bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:49:11 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8b58c8e6-0dbd-4974-9837-0f832ca6e61e tempest-DeleteServersTestJSON-294110885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8b851ce-c696-422f-a9c0-dda3131157bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:49:11 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8b58c8e6-0dbd-4974-9837-0f832ca6e61e tempest-DeleteServersTestJSON-294110885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceff532a-c95b-4d93-bfd8-f6ae2f082a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:49:11 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-8b58c8e6-0dbd-4974-9837-0f832ca6e61e tempest-DeleteServersTestJSON-294110885 None] Volume 5900c9cf-9b49-4694-86db-812f4e2e372b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5900c9cf-9b49-4694-86db-812f4e2e372b', 'volume_size': 1} Jul 30 16:49:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8b58c8e6-0dbd-4974-9837-0f832ca6e61e tempest-DeleteServersTestJSON-294110885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:49:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8b58c8e6-0dbd-4974-9837-0f832ca6e61e tempest-DeleteServersTestJSON-294110885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:49:11 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-8b58c8e6-0dbd-4974-9837-0f832ca6e61e tempest-DeleteServersTestJSON-294110885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:49:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1073204906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5900c9cf-9b49-4694-86db-812f4e2e372b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ba42d5089534e1da37177d0bd3256a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:49:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:49:11Z,use_quota=True,user_id='061efab065444955849c20f0533ede4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:49:11 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-8b58c8e6-0dbd-4974-9837-0f832ca6e61e tempest-DeleteServersTestJSON-294110885 None] Creating volume 5900c9cf-9b49-4694-86db-812f4e2e372b {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:49:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8b58c8e6-0dbd-4974-9837-0f832ca6e61e tempest-DeleteServersTestJSON-294110885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:49:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8b58c8e6-0dbd-4974-9837-0f832ca6e61e tempest-DeleteServersTestJSON-294110885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:49:11 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-8b58c8e6-0dbd-4974-9837-0f832ca6e61e tempest-DeleteServersTestJSON-294110885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:49:11 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-8b58c8e6-0dbd-4974-9837-0f832ca6e61e tempest-DeleteServersTestJSON-294110885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:49:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8b58c8e6-0dbd-4974-9837-0f832ca6e61e tempest-DeleteServersTestJSON-294110885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:49:11 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-8b58c8e6-0dbd-4974-9837-0f832ca6e61e tempest-DeleteServersTestJSON-294110885 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:49:11 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-8b58c8e6-0dbd-4974-9837-0f832ca6e61e tempest-DeleteServersTestJSON-294110885 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:49:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8b58c8e6-0dbd-4974-9837-0f832ca6e61e tempest-DeleteServersTestJSON-294110885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5900c9cf-9b49-4694-86db-812f4e2e372b 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:11 devstack sudo[89217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5900c9cf-9b49-4694-86db-812f4e2e372b 1073741824 Jul 30 16:49:11 devstack sudo[89217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:12 devstack cinder-volume[88591]: DEBUG oslo_service.periodic_task [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:49:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:49:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:49:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:49:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:49:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:49:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:12 devstack sudo[89536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:49:12 devstack sudo[89536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:13 devstack sudo[89217]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8b58c8e6-0dbd-4974-9837-0f832ca6e61e tempest-DeleteServersTestJSON-294110885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5900c9cf-9b49-4694-86db-812f4e2e372b 1073741824" returned: 0 in 1.648s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8b58c8e6-0dbd-4974-9837-0f832ca6e61e tempest-DeleteServersTestJSON-294110885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5900c9cf-9b49-4694-86db-812f4e2e372b {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:13 devstack sudo[89539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5900c9cf-9b49-4694-86db-812f4e2e372b Jul 30 16:49:13 devstack sudo[89539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:13 devstack sudo[89536]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.927s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:13 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:49:13 devstack cinder-volume[88591]: DEBUG oslo_service.periodic_task [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running periodic task VolumeManager._thread_info {{(pid=88591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:49:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] thread count: 6 {{(pid=88591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:49:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] thread info: [<_MainThread(MainThread, started 140677178003584)>, , , , , ] {{(pid=88591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:49:14 devstack sudo[89539]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8b58c8e6-0dbd-4974-9837-0f832ca6e61e tempest-DeleteServersTestJSON-294110885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5900c9cf-9b49-4694-86db-812f4e2e372b" returned: 0 in 1.037s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:14 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-8b58c8e6-0dbd-4974-9837-0f832ca6e61e tempest-DeleteServersTestJSON-294110885 None] <== create_volume: return (2852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:49:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8b58c8e6-0dbd-4974-9837-0f832ca6e61e tempest-DeleteServersTestJSON-294110885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.854s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:49:14 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8b58c8e6-0dbd-4974-9837-0f832ca6e61e tempest-DeleteServersTestJSON-294110885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceff532a-c95b-4d93-bfd8-f6ae2f082a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5900c9cf-9b49-4694-86db-812f4e2e372b', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:49:14 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8b58c8e6-0dbd-4974-9837-0f832ca6e61e tempest-DeleteServersTestJSON-294110885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ec23e5f-df16-4110-af1a-cc28bd0cc2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:49:14 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-8b58c8e6-0dbd-4974-9837-0f832ca6e61e tempest-DeleteServersTestJSON-294110885 None] Volume volume-5900c9cf-9b49-4694-86db-812f4e2e372b (5900c9cf-9b49-4694-86db-812f4e2e372b): created successfully Jul 30 16:49:14 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8b58c8e6-0dbd-4974-9837-0f832ca6e61e tempest-DeleteServersTestJSON-294110885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ec23e5f-df16-4110-af1a-cc28bd0cc2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:49:14 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8b58c8e6-0dbd-4974-9837-0f832ca6e61e tempest-DeleteServersTestJSON-294110885 None] Flow 'volume_create_manager' (b2e680a2-8cfc-412d-a081-61fea5c44dbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:49:14 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-8b58c8e6-0dbd-4974-9837-0f832ca6e61e tempest-DeleteServersTestJSON-294110885 None] Created volume successfully. Jul 30 16:49:22 devstack cinder-volume[88591]: WARNING py.warnings [req-a35a082e-7e80-4729-b96c-d43fac96d2b4 req-838e6d4c-ddbd-4297-8f53-78fabc38fd1d tempest-DeleteServersTestJSON-294110885 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Jul 30 16:49:22 devstack cinder-volume[88591]: .first() Jul 30 16:49:22 devstack cinder-volume[88591]: Jul 30 16:49:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-a35a082e-7e80-4729-b96c-d43fac96d2b4 req-838e6d4c-ddbd-4297-8f53-78fabc38fd1d tempest-DeleteServersTestJSON-294110885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:49:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-a35a082e-7e80-4729-b96c-d43fac96d2b4 req-838e6d4c-ddbd-4297-8f53-78fabc38fd1d tempest-DeleteServersTestJSON-294110885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:49:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-a35a082e-7e80-4729-b96c-d43fac96d2b4 req-838e6d4c-ddbd-4297-8f53-78fabc38fd1d tempest-DeleteServersTestJSON-294110885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.048s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:49:22 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-a35a082e-7e80-4729-b96c-d43fac96d2b4 req-838e6d4c-ddbd-4297-8f53-78fabc38fd1d tempest-DeleteServersTestJSON-294110885 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202', 'name': 'volume-5900c9cf-9b49-4694-86db-812f4e2e372b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '86c87519-c189-4342-ad4b-cc1b6347a3ac', 'enforce_multipath': True} {{(pid=88591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:49:22 devstack cinder-volume[88591]: INFO cinder.volume.manager [req-a35a082e-7e80-4729-b96c-d43fac96d2b4 req-838e6d4c-ddbd-4297-8f53-78fabc38fd1d tempest-DeleteServersTestJSON-294110885 None] attachment_update completed successfully. Jul 30 16:49:26 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c95490c-6634-4e1a-955f-c7cf2b57abc4 tempest-ServerRescueNegativeTestJSON-1366830861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:49:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5c95490c-6634-4e1a-955f-c7cf2b57abc4 tempest-ServerRescueNegativeTestJSON-1366830861 None] Flow 'volume_create_manager' (3438849b-a7fa-496e-b260-5a845b77e9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:49:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5c95490c-6634-4e1a-955f-c7cf2b57abc4 tempest-ServerRescueNegativeTestJSON-1366830861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7740493a-4194-4699-b278-9892907d4a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:49:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5c95490c-6634-4e1a-955f-c7cf2b57abc4 tempest-ServerRescueNegativeTestJSON-1366830861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7740493a-4194-4699-b278-9892907d4a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:49:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1150335536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54e168ed-ce2e-412a-ab51-a18c714f4db1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d88e4f8a11404f35947dfbcc51f9e373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:49:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:49:26Z,use_quota=True,user_id='23dd29a1acd147b98156ee92908477ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:49:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5c95490c-6634-4e1a-955f-c7cf2b57abc4 tempest-ServerRescueNegativeTestJSON-1366830861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b78b0ba7-5ef9-464f-87e6-7593158cb7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:49:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5c95490c-6634-4e1a-955f-c7cf2b57abc4 tempest-ServerRescueNegativeTestJSON-1366830861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b78b0ba7-5ef9-464f-87e6-7593158cb7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:49:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5c95490c-6634-4e1a-955f-c7cf2b57abc4 tempest-ServerRescueNegativeTestJSON-1366830861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (987f8661-4586-400b-bc86-b453b0617982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:49:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5c95490c-6634-4e1a-955f-c7cf2b57abc4 tempest-ServerRescueNegativeTestJSON-1366830861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (987f8661-4586-400b-bc86-b453b0617982) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54e168ed-ce2e-412a-ab51-a18c714f4db1', 'volume_name': 'volume-54e168ed-ce2e-412a-ab51-a18c714f4db1', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:49:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5c95490c-6634-4e1a-955f-c7cf2b57abc4 tempest-ServerRescueNegativeTestJSON-1366830861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8205c030-fc3b-4310-b2af-3741adeb23fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:49:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5c95490c-6634-4e1a-955f-c7cf2b57abc4 tempest-ServerRescueNegativeTestJSON-1366830861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8205c030-fc3b-4310-b2af-3741adeb23fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:49:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5c95490c-6634-4e1a-955f-c7cf2b57abc4 tempest-ServerRescueNegativeTestJSON-1366830861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (311e5825-5bf7-4ba0-b396-da91d7c21966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:49:26 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-5c95490c-6634-4e1a-955f-c7cf2b57abc4 tempest-ServerRescueNegativeTestJSON-1366830861 None] Volume 54e168ed-ce2e-412a-ab51-a18c714f4db1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54e168ed-ce2e-412a-ab51-a18c714f4db1', 'volume_size': 1} Jul 30 16:49:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5c95490c-6634-4e1a-955f-c7cf2b57abc4 tempest-ServerRescueNegativeTestJSON-1366830861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:49:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5c95490c-6634-4e1a-955f-c7cf2b57abc4 tempest-ServerRescueNegativeTestJSON-1366830861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:49:26 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-5c95490c-6634-4e1a-955f-c7cf2b57abc4 tempest-ServerRescueNegativeTestJSON-1366830861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:49:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1150335536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54e168ed-ce2e-412a-ab51-a18c714f4db1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d88e4f8a11404f35947dfbcc51f9e373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:49:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:49:26Z,use_quota=True,user_id='23dd29a1acd147b98156ee92908477ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:49:26 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-5c95490c-6634-4e1a-955f-c7cf2b57abc4 tempest-ServerRescueNegativeTestJSON-1366830861 None] Creating volume 54e168ed-ce2e-412a-ab51-a18c714f4db1 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:49:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5c95490c-6634-4e1a-955f-c7cf2b57abc4 tempest-ServerRescueNegativeTestJSON-1366830861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:49:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5c95490c-6634-4e1a-955f-c7cf2b57abc4 tempest-ServerRescueNegativeTestJSON-1366830861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:49:26 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-5c95490c-6634-4e1a-955f-c7cf2b57abc4 tempest-ServerRescueNegativeTestJSON-1366830861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:49:26 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-5c95490c-6634-4e1a-955f-c7cf2b57abc4 tempest-ServerRescueNegativeTestJSON-1366830861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:49:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5c95490c-6634-4e1a-955f-c7cf2b57abc4 tempest-ServerRescueNegativeTestJSON-1366830861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:49:26 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-5c95490c-6634-4e1a-955f-c7cf2b57abc4 tempest-ServerRescueNegativeTestJSON-1366830861 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:49:26 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-5c95490c-6634-4e1a-955f-c7cf2b57abc4 tempest-ServerRescueNegativeTestJSON-1366830861 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:49:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5c95490c-6634-4e1a-955f-c7cf2b57abc4 tempest-ServerRescueNegativeTestJSON-1366830861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-54e168ed-ce2e-412a-ab51-a18c714f4db1 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:26 devstack sudo[90187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-54e168ed-ce2e-412a-ab51-a18c714f4db1 1073741824 Jul 30 16:49:26 devstack sudo[90187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:27 devstack sudo[90187]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5c95490c-6634-4e1a-955f-c7cf2b57abc4 tempest-ServerRescueNegativeTestJSON-1366830861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-54e168ed-ce2e-412a-ab51-a18c714f4db1 1073741824" returned: 0 in 1.223s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5c95490c-6634-4e1a-955f-c7cf2b57abc4 tempest-ServerRescueNegativeTestJSON-1366830861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-54e168ed-ce2e-412a-ab51-a18c714f4db1 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:28 devstack sudo[90195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-54e168ed-ce2e-412a-ab51-a18c714f4db1 Jul 30 16:49:28 devstack sudo[90195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:28 devstack sudo[90195]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5c95490c-6634-4e1a-955f-c7cf2b57abc4 tempest-ServerRescueNegativeTestJSON-1366830861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-54e168ed-ce2e-412a-ab51-a18c714f4db1" returned: 0 in 0.526s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:28 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-5c95490c-6634-4e1a-955f-c7cf2b57abc4 tempest-ServerRescueNegativeTestJSON-1366830861 None] <== create_volume: return (1873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:49:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5c95490c-6634-4e1a-955f-c7cf2b57abc4 tempest-ServerRescueNegativeTestJSON-1366830861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.881s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:49:28 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5c95490c-6634-4e1a-955f-c7cf2b57abc4 tempest-ServerRescueNegativeTestJSON-1366830861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (311e5825-5bf7-4ba0-b396-da91d7c21966) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54e168ed-ce2e-412a-ab51-a18c714f4db1', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:49:28 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5c95490c-6634-4e1a-955f-c7cf2b57abc4 tempest-ServerRescueNegativeTestJSON-1366830861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6e58c23-8378-4ee6-b4ae-2f90c626b639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:49:28 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-5c95490c-6634-4e1a-955f-c7cf2b57abc4 tempest-ServerRescueNegativeTestJSON-1366830861 None] Volume volume-54e168ed-ce2e-412a-ab51-a18c714f4db1 (54e168ed-ce2e-412a-ab51-a18c714f4db1): created successfully Jul 30 16:49:28 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5c95490c-6634-4e1a-955f-c7cf2b57abc4 tempest-ServerRescueNegativeTestJSON-1366830861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6e58c23-8378-4ee6-b4ae-2f90c626b639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:49:28 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5c95490c-6634-4e1a-955f-c7cf2b57abc4 tempest-ServerRescueNegativeTestJSON-1366830861 None] Flow 'volume_create_manager' (3438849b-a7fa-496e-b260-5a845b77e9d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:49:28 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-5c95490c-6634-4e1a-955f-c7cf2b57abc4 tempest-ServerRescueNegativeTestJSON-1366830861 None] Created volume successfully. Jul 30 16:49:33 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba1cff0d-95bb-4e9a-bda4-1279bc5fff1d tempest-VolumesAdminNegativeTest-1969758975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:49:33 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ba1cff0d-95bb-4e9a-bda4-1279bc5fff1d tempest-VolumesAdminNegativeTest-1969758975 None] Flow 'volume_create_manager' (fd52346f-99c1-4ce4-baf8-e8df448a69a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:49:33 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ba1cff0d-95bb-4e9a-bda4-1279bc5fff1d tempest-VolumesAdminNegativeTest-1969758975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54a438b3-7ae4-4fe2-88fa-8c11f717c6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:49:33 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ba1cff0d-95bb-4e9a-bda4-1279bc5fff1d tempest-VolumesAdminNegativeTest-1969758975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54a438b3-7ae4-4fe2-88fa-8c11f717c6cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:49:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-851275145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ea42aa3-5232-4c83-98c3-8e1243bafb85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cdc2f3380be4125bec9c1781f7bb3e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:49:33Z,use_quota=True,user_id='bd66f9eb9cc44c7daff925e94b98dce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:49:33 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ba1cff0d-95bb-4e9a-bda4-1279bc5fff1d tempest-VolumesAdminNegativeTest-1969758975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d9551b4-15f6-4340-8498-654a88763d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:49:33 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ba1cff0d-95bb-4e9a-bda4-1279bc5fff1d tempest-VolumesAdminNegativeTest-1969758975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d9551b4-15f6-4340-8498-654a88763d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:49:33 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ba1cff0d-95bb-4e9a-bda4-1279bc5fff1d tempest-VolumesAdminNegativeTest-1969758975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (192fe563-0349-448e-b9f5-a78581b504ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:49:33 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ba1cff0d-95bb-4e9a-bda4-1279bc5fff1d tempest-VolumesAdminNegativeTest-1969758975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (192fe563-0349-448e-b9f5-a78581b504ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ea42aa3-5232-4c83-98c3-8e1243bafb85', 'volume_name': 'volume-5ea42aa3-5232-4c83-98c3-8e1243bafb85', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:49:33 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ba1cff0d-95bb-4e9a-bda4-1279bc5fff1d tempest-VolumesAdminNegativeTest-1969758975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eb1f449-8da8-49e4-b776-86f9bb30c298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:49:33 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ba1cff0d-95bb-4e9a-bda4-1279bc5fff1d tempest-VolumesAdminNegativeTest-1969758975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eb1f449-8da8-49e4-b776-86f9bb30c298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:49:33 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ba1cff0d-95bb-4e9a-bda4-1279bc5fff1d tempest-VolumesAdminNegativeTest-1969758975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2fd2ad7-1ca7-46ad-9ea4-4dde8712418f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:49:33 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-ba1cff0d-95bb-4e9a-bda4-1279bc5fff1d tempest-VolumesAdminNegativeTest-1969758975 None] Volume 5ea42aa3-5232-4c83-98c3-8e1243bafb85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ea42aa3-5232-4c83-98c3-8e1243bafb85', 'volume_size': 1} Jul 30 16:49:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ba1cff0d-95bb-4e9a-bda4-1279bc5fff1d tempest-VolumesAdminNegativeTest-1969758975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:49:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ba1cff0d-95bb-4e9a-bda4-1279bc5fff1d tempest-VolumesAdminNegativeTest-1969758975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:49:33 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ba1cff0d-95bb-4e9a-bda4-1279bc5fff1d tempest-VolumesAdminNegativeTest-1969758975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:49:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-851275145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ea42aa3-5232-4c83-98c3-8e1243bafb85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cdc2f3380be4125bec9c1781f7bb3e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:49:33Z,use_quota=True,user_id='bd66f9eb9cc44c7daff925e94b98dce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:49:33 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-ba1cff0d-95bb-4e9a-bda4-1279bc5fff1d tempest-VolumesAdminNegativeTest-1969758975 None] Creating volume 5ea42aa3-5232-4c83-98c3-8e1243bafb85 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:49:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ba1cff0d-95bb-4e9a-bda4-1279bc5fff1d tempest-VolumesAdminNegativeTest-1969758975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:49:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ba1cff0d-95bb-4e9a-bda4-1279bc5fff1d tempest-VolumesAdminNegativeTest-1969758975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:49:33 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ba1cff0d-95bb-4e9a-bda4-1279bc5fff1d tempest-VolumesAdminNegativeTest-1969758975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:49:33 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ba1cff0d-95bb-4e9a-bda4-1279bc5fff1d tempest-VolumesAdminNegativeTest-1969758975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:49:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ba1cff0d-95bb-4e9a-bda4-1279bc5fff1d tempest-VolumesAdminNegativeTest-1969758975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:49:33 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ba1cff0d-95bb-4e9a-bda4-1279bc5fff1d tempest-VolumesAdminNegativeTest-1969758975 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:49:33 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-ba1cff0d-95bb-4e9a-bda4-1279bc5fff1d tempest-VolumesAdminNegativeTest-1969758975 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:49:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ba1cff0d-95bb-4e9a-bda4-1279bc5fff1d tempest-VolumesAdminNegativeTest-1969758975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5ea42aa3-5232-4c83-98c3-8e1243bafb85 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:33 devstack sudo[90255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5ea42aa3-5232-4c83-98c3-8e1243bafb85 1073741824 Jul 30 16:49:33 devstack sudo[90255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:34 devstack cinder-volume[88591]: INFO cinder.volume.manager [req-5861a5d1-27d6-45c4-a964-57b759bdbc37 req-12a3fbd5-e125-4745-ad34-9074ef131030 tempest-DeleteServersTestJSON-294110885 None] Terminate volume connection completed successfully. Jul 30 16:49:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-5861a5d1-27d6-45c4-a964-57b759bdbc37 req-12a3fbd5-e125-4745-ad34-9074ef131030 tempest-DeleteServersTestJSON-294110885 None] Deleting attachment 86c87519-c189-4342-ad4b-cc1b6347a3ac. {{(pid=88591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:49:35 devstack sudo[90255]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ba1cff0d-95bb-4e9a-bda4-1279bc5fff1d tempest-VolumesAdminNegativeTest-1969758975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5ea42aa3-5232-4c83-98c3-8e1243bafb85 1073741824" returned: 0 in 1.412s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ba1cff0d-95bb-4e9a-bda4-1279bc5fff1d tempest-VolumesAdminNegativeTest-1969758975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5ea42aa3-5232-4c83-98c3-8e1243bafb85 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:35 devstack sudo[90296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5ea42aa3-5232-4c83-98c3-8e1243bafb85 Jul 30 16:49:35 devstack sudo[90296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:35 devstack sudo[90296]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ba1cff0d-95bb-4e9a-bda4-1279bc5fff1d tempest-VolumesAdminNegativeTest-1969758975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5ea42aa3-5232-4c83-98c3-8e1243bafb85" returned: 0 in 0.565s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:35 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ba1cff0d-95bb-4e9a-bda4-1279bc5fff1d tempest-VolumesAdminNegativeTest-1969758975 None] <== create_volume: return (2170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:49:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ba1cff0d-95bb-4e9a-bda4-1279bc5fff1d tempest-VolumesAdminNegativeTest-1969758975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.175s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:49:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ba1cff0d-95bb-4e9a-bda4-1279bc5fff1d tempest-VolumesAdminNegativeTest-1969758975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2fd2ad7-1ca7-46ad-9ea4-4dde8712418f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ea42aa3-5232-4c83-98c3-8e1243bafb85', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:49:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ba1cff0d-95bb-4e9a-bda4-1279bc5fff1d tempest-VolumesAdminNegativeTest-1969758975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89dad079-069c-43c0-9978-bd13798b2454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:49:35 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-ba1cff0d-95bb-4e9a-bda4-1279bc5fff1d tempest-VolumesAdminNegativeTest-1969758975 None] Volume volume-5ea42aa3-5232-4c83-98c3-8e1243bafb85 (5ea42aa3-5232-4c83-98c3-8e1243bafb85): created successfully Jul 30 16:49:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ba1cff0d-95bb-4e9a-bda4-1279bc5fff1d tempest-VolumesAdminNegativeTest-1969758975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89dad079-069c-43c0-9978-bd13798b2454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:49:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ba1cff0d-95bb-4e9a-bda4-1279bc5fff1d tempest-VolumesAdminNegativeTest-1969758975 None] Flow 'volume_create_manager' (fd52346f-99c1-4ce4-baf8-e8df448a69a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:49:35 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-ba1cff0d-95bb-4e9a-bda4-1279bc5fff1d tempest-VolumesAdminNegativeTest-1969758975 None] Created volume successfully. Jul 30 16:49:37 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-e76aec7d-1ee6-4070-9311-35f91bb2be3f tempest-DeleteServersTestJSON-294110885 None] Acquiring lock "cinder-5900c9cf-9b49-4694-86db-812f4e2e372b-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:49:37 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-e76aec7d-1ee6-4070-9311-35f91bb2be3f tempest-DeleteServersTestJSON-294110885 None] Lock "cinder-5900c9cf-9b49-4694-86db-812f4e2e372b-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:49:37 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-e76aec7d-1ee6-4070-9311-35f91bb2be3f tempest-DeleteServersTestJSON-294110885 None] Acquiring lock "cinder-quobyte-5900c9cf-9b49-4694-86db-812f4e2e372b" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:49:37 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-e76aec7d-1ee6-4070-9311-35f91bb2be3f tempest-DeleteServersTestJSON-294110885 None] Lock "cinder-quobyte-5900c9cf-9b49-4694-86db-812f4e2e372b" acquired by "delete_volume" :: waited 0.026s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:49:37 devstack cinder-volume[88591]: INFO oslo.privsep.daemon [None req-e76aec7d-1ee6-4070-9311-35f91bb2be3f tempest-DeleteServersTestJSON-294110885 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpr99c3i06/privsep.sock'] Jul 30 16:49:37 devstack sudo[90365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpr99c3i06/privsep.sock Jul 30 16:49:37 devstack sudo[90365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:38 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-dad8345b-39ce-4d3e-95ab-127b47911256 tempest-VolumesAdminNegativeTest-1969758975 None] Acquiring lock "cinder-5ea42aa3-5232-4c83-98c3-8e1243bafb85-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:49:38 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-dad8345b-39ce-4d3e-95ab-127b47911256 tempest-VolumesAdminNegativeTest-1969758975 None] Lock "cinder-5ea42aa3-5232-4c83-98c3-8e1243bafb85-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:49:38 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-dad8345b-39ce-4d3e-95ab-127b47911256 tempest-VolumesAdminNegativeTest-1969758975 None] Acquiring lock "cinder-quobyte-5ea42aa3-5232-4c83-98c3-8e1243bafb85" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:49:38 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-dad8345b-39ce-4d3e-95ab-127b47911256 tempest-VolumesAdminNegativeTest-1969758975 None] Lock "cinder-quobyte-5ea42aa3-5232-4c83-98c3-8e1243bafb85" acquired by "delete_volume" :: waited 0.025s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:49:39 devstack cinder-volume[88591]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Jul 30 16:49:39 devstack cinder-volume[88591]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 30 16:49:39 devstack cinder-volume[88591]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 30 16:49:39 devstack cinder-volume[88591]: WARNING oslo.privsep.daemon [-] privsep log: Jul 30 16:49:39 devstack cinder-volume[88591]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 30 16:49:39 devstack cinder-volume[88591]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 30 16:49:39 devstack cinder-volume[88591]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 30 16:49:39 devstack cinder-volume[88591]: WARNING oslo.privsep.daemon [-] privsep log: Jul 30 16:49:39 devstack cinder-volume[88591]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Jul 30 16:49:39 devstack sudo[90365]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:39 devstack cinder-volume[88591]: INFO oslo.privsep.daemon [None req-e76aec7d-1ee6-4070-9311-35f91bb2be3f tempest-DeleteServersTestJSON-294110885 None] Spawned new privsep daemon via rootwrap Jul 30 16:49:39 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [None req-e76aec7d-1ee6-4070-9311-35f91bb2be3f tempest-DeleteServersTestJSON-294110885 None] Accepted privsep connection to /tmp/tmpr99c3i06/privsep.sock {{(pid=88591) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 30 16:49:39 devstack cinder-volume[88591]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 30 16:49:39 devstack cinder-volume[88591]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 30 16:49:39 devstack cinder-volume[88591]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 30 16:49:39 devstack cinder-volume[88591]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 90400 Jul 30 16:49:39 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[384cf45d-6739-4da9-aaa9-66be46584ed9]: (2,) {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:49:39 devstack cinder-volume[88591]: WARNING oslo_privsep.priv_context [None req-dad8345b-39ce-4d3e-95ab-127b47911256 tempest-VolumesAdminNegativeTest-1969758975 None] privsep daemon already running Jul 30 16:49:39 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85cfabd-f1de-44b9-bb96-bd99630b268b]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:49:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e76aec7d-1ee6-4070-9311-35f91bb2be3f tempest-DeleteServersTestJSON-294110885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5900c9cf-9b49-4694-86db-812f4e2e372b {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:39 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[755f2afd-31e1-4a03-8900-71d7c03846e5]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:49:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dad8345b-39ce-4d3e-95ab-127b47911256 tempest-VolumesAdminNegativeTest-1969758975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5ea42aa3-5232-4c83-98c3-8e1243bafb85 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:39 devstack sudo[90404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5900c9cf-9b49-4694-86db-812f4e2e372b Jul 30 16:49:39 devstack sudo[90404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:39 devstack sudo[90405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5ea42aa3-5232-4c83-98c3-8e1243bafb85 Jul 30 16:49:39 devstack sudo[90405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:40 devstack sudo[90405]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dad8345b-39ce-4d3e-95ab-127b47911256 tempest-VolumesAdminNegativeTest-1969758975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5ea42aa3-5232-4c83-98c3-8e1243bafb85" returned: 0 in 0.809s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dad8345b-39ce-4d3e-95ab-127b47911256 tempest-VolumesAdminNegativeTest-1969758975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5ea42aa3-5232-4c83-98c3-8e1243bafb85 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:40 devstack sudo[90404]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e76aec7d-1ee6-4070-9311-35f91bb2be3f tempest-DeleteServersTestJSON-294110885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5900c9cf-9b49-4694-86db-812f4e2e372b" returned: 0 in 0.920s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e76aec7d-1ee6-4070-9311-35f91bb2be3f tempest-DeleteServersTestJSON-294110885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5900c9cf-9b49-4694-86db-812f4e2e372b {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:40 devstack sudo[90415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5ea42aa3-5232-4c83-98c3-8e1243bafb85 Jul 30 16:49:40 devstack sudo[90415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:40 devstack sudo[90416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5900c9cf-9b49-4694-86db-812f4e2e372b Jul 30 16:49:40 devstack sudo[90416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:40 devstack sudo[90415]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dad8345b-39ce-4d3e-95ab-127b47911256 tempest-VolumesAdminNegativeTest-1969758975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5ea42aa3-5232-4c83-98c3-8e1243bafb85" returned: 0 in 0.421s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:40 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-dad8345b-39ce-4d3e-95ab-127b47911256 tempest-VolumesAdminNegativeTest-1969758975 None] Lock "cinder-quobyte-5ea42aa3-5232-4c83-98c3-8e1243bafb85" released by "delete_volume" :: held 2.619s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:49:41 devstack sudo[90416]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e76aec7d-1ee6-4070-9311-35f91bb2be3f tempest-DeleteServersTestJSON-294110885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5900c9cf-9b49-4694-86db-812f4e2e372b" returned: 0 in 0.461s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:41 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-e76aec7d-1ee6-4070-9311-35f91bb2be3f tempest-DeleteServersTestJSON-294110885 None] Lock "cinder-quobyte-5900c9cf-9b49-4694-86db-812f4e2e372b" released by "delete_volume" :: held 3.321s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:49:41 devstack cinder-volume[88591]: WARNING cinder.quota [None req-dad8345b-39ce-4d3e-95ab-127b47911256 tempest-VolumesAdminNegativeTest-1969758975 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:49:41 devstack cinder-volume[88591]: WARNING cinder.quota [None req-dad8345b-39ce-4d3e-95ab-127b47911256 tempest-VolumesAdminNegativeTest-1969758975 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:49:41 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-dad8345b-39ce-4d3e-95ab-127b47911256 tempest-VolumesAdminNegativeTest-1969758975 None] Created reservations ['104a05f3-88e4-47bf-bde1-a158bd2e57d5', 'fab7c639-a5a9-4c85-88c1-6237e4b19b7c', '1eb74d9d-1b99-4732-9b7e-0c943d756e9d', '5f0bf950-16fa-4289-99b0-1b3029f1508d'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:49:41 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-e76aec7d-1ee6-4070-9311-35f91bb2be3f tempest-DeleteServersTestJSON-294110885 None] Created reservations ['80f4afbc-f276-412d-9305-0acf39851f41', '8b892796-c1a9-4e89-8397-67e0f3bccf30', '70cb2eeb-834a-46a6-b753-2c996fcef5ce', 'f90906e2-250f-490a-810a-2babdd983680'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:49:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-dad8345b-39ce-4d3e-95ab-127b47911256 tempest-VolumesAdminNegativeTest-1969758975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:49:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-dad8345b-39ce-4d3e-95ab-127b47911256 tempest-VolumesAdminNegativeTest-1969758975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:49:41 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-dad8345b-39ce-4d3e-95ab-127b47911256 tempest-VolumesAdminNegativeTest-1969758975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:49:41 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-dad8345b-39ce-4d3e-95ab-127b47911256 tempest-VolumesAdminNegativeTest-1969758975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:49:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-dad8345b-39ce-4d3e-95ab-127b47911256 tempest-VolumesAdminNegativeTest-1969758975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:49:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dad8345b-39ce-4d3e-95ab-127b47911256 tempest-VolumesAdminNegativeTest-1969758975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:41 devstack sudo[90423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:49:41 devstack sudo[90423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-e76aec7d-1ee6-4070-9311-35f91bb2be3f tempest-DeleteServersTestJSON-294110885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:49:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-e76aec7d-1ee6-4070-9311-35f91bb2be3f tempest-DeleteServersTestJSON-294110885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:49:41 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-e76aec7d-1ee6-4070-9311-35f91bb2be3f tempest-DeleteServersTestJSON-294110885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:49:41 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-e76aec7d-1ee6-4070-9311-35f91bb2be3f tempest-DeleteServersTestJSON-294110885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:49:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-e76aec7d-1ee6-4070-9311-35f91bb2be3f tempest-DeleteServersTestJSON-294110885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:49:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e76aec7d-1ee6-4070-9311-35f91bb2be3f tempest-DeleteServersTestJSON-294110885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:41 devstack sudo[90425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:49:41 devstack sudo[90425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:42 devstack sudo[90423]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dad8345b-39ce-4d3e-95ab-127b47911256 tempest-VolumesAdminNegativeTest-1969758975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.404s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:42 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-dad8345b-39ce-4d3e-95ab-127b47911256 tempest-VolumesAdminNegativeTest-1969758975 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:49:42 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-dad8345b-39ce-4d3e-95ab-127b47911256 tempest-VolumesAdminNegativeTest-1969758975 None] Deleted volume successfully. Jul 30 16:49:42 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-dad8345b-39ce-4d3e-95ab-127b47911256 tempest-VolumesAdminNegativeTest-1969758975 None] Lock "cinder-5ea42aa3-5232-4c83-98c3-8e1243bafb85-delete_volume" released by "delete_volume" :: held 3.834s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:49:42 devstack sudo[90425]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e76aec7d-1ee6-4070-9311-35f91bb2be3f tempest-DeleteServersTestJSON-294110885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.552s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:42 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-e76aec7d-1ee6-4070-9311-35f91bb2be3f tempest-DeleteServersTestJSON-294110885 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:49:42 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-e76aec7d-1ee6-4070-9311-35f91bb2be3f tempest-DeleteServersTestJSON-294110885 None] Deleted volume successfully. Jul 30 16:49:42 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-e76aec7d-1ee6-4070-9311-35f91bb2be3f tempest-DeleteServersTestJSON-294110885 None] Lock "cinder-5900c9cf-9b49-4694-86db-812f4e2e372b-delete_volume" released by "delete_volume" :: held 4.791s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:49:58 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:UPDATE=26,cinder:SELECT=23,cinder:INSERT=7,cinder:DELETE=2 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:49:58 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:SELECT=25,cinder:INSERT=4,cinder:UPDATE=28,cinder:DELETE=3 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:50:01 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-6557d7c1-52bd-4c77-ac27-cd5246cc0d35 tempest-ServerRescueNegativeTestJSON-1366830861 None] Acquiring lock "cinder-54e168ed-ce2e-412a-ab51-a18c714f4db1-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:50:01 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-6557d7c1-52bd-4c77-ac27-cd5246cc0d35 tempest-ServerRescueNegativeTestJSON-1366830861 None] Lock "cinder-54e168ed-ce2e-412a-ab51-a18c714f4db1-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:50:01 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-6557d7c1-52bd-4c77-ac27-cd5246cc0d35 tempest-ServerRescueNegativeTestJSON-1366830861 None] Acquiring lock "cinder-quobyte-54e168ed-ce2e-412a-ab51-a18c714f4db1" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:50:01 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-6557d7c1-52bd-4c77-ac27-cd5246cc0d35 tempest-ServerRescueNegativeTestJSON-1366830861 None] Lock "cinder-quobyte-54e168ed-ce2e-412a-ab51-a18c714f4db1" acquired by "delete_volume" :: waited 0.025s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:50:01 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[41cb98cc-ceb6-4296-89ff-d1d417ccd15b]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:50:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6557d7c1-52bd-4c77-ac27-cd5246cc0d35 tempest-ServerRescueNegativeTestJSON-1366830861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-54e168ed-ce2e-412a-ab51-a18c714f4db1 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:50:01 devstack sudo[90559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-54e168ed-ce2e-412a-ab51-a18c714f4db1 Jul 30 16:50:01 devstack sudo[90559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:50:01 devstack sudo[90559]: pam_unix(sudo:session): session closed for user root Jul 30 16:50:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6557d7c1-52bd-4c77-ac27-cd5246cc0d35 tempest-ServerRescueNegativeTestJSON-1366830861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-54e168ed-ce2e-412a-ab51-a18c714f4db1" returned: 0 in 0.503s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:50:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6557d7c1-52bd-4c77-ac27-cd5246cc0d35 tempest-ServerRescueNegativeTestJSON-1366830861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-54e168ed-ce2e-412a-ab51-a18c714f4db1 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:50:01 devstack sudo[90564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-54e168ed-ce2e-412a-ab51-a18c714f4db1 Jul 30 16:50:01 devstack sudo[90564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:50:02 devstack sudo[90564]: pam_unix(sudo:session): session closed for user root Jul 30 16:50:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6557d7c1-52bd-4c77-ac27-cd5246cc0d35 tempest-ServerRescueNegativeTestJSON-1366830861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-54e168ed-ce2e-412a-ab51-a18c714f4db1" returned: 0 in 0.305s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:50:02 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-6557d7c1-52bd-4c77-ac27-cd5246cc0d35 tempest-ServerRescueNegativeTestJSON-1366830861 None] Lock "cinder-quobyte-54e168ed-ce2e-412a-ab51-a18c714f4db1" released by "delete_volume" :: held 0.893s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:50:02 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-6557d7c1-52bd-4c77-ac27-cd5246cc0d35 tempest-ServerRescueNegativeTestJSON-1366830861 None] Created reservations ['7fcb86e3-8eb5-4e09-8271-1f726dbd432e', '3489e461-c30d-406a-8dc0-37d7f07102fd', '961aa485-03da-43cb-9159-21866694c373', '19fbc1a0-0720-4405-a391-32ca0450effd'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:50:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-6557d7c1-52bd-4c77-ac27-cd5246cc0d35 tempest-ServerRescueNegativeTestJSON-1366830861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:50:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-6557d7c1-52bd-4c77-ac27-cd5246cc0d35 tempest-ServerRescueNegativeTestJSON-1366830861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:50:02 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-6557d7c1-52bd-4c77-ac27-cd5246cc0d35 tempest-ServerRescueNegativeTestJSON-1366830861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:50:02 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-6557d7c1-52bd-4c77-ac27-cd5246cc0d35 tempest-ServerRescueNegativeTestJSON-1366830861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:50:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-6557d7c1-52bd-4c77-ac27-cd5246cc0d35 tempest-ServerRescueNegativeTestJSON-1366830861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:50:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6557d7c1-52bd-4c77-ac27-cd5246cc0d35 tempest-ServerRescueNegativeTestJSON-1366830861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:50:02 devstack sudo[90567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:50:02 devstack sudo[90567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:50:03 devstack sudo[90567]: pam_unix(sudo:session): session closed for user root Jul 30 16:50:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6557d7c1-52bd-4c77-ac27-cd5246cc0d35 tempest-ServerRescueNegativeTestJSON-1366830861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.617s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:50:03 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-6557d7c1-52bd-4c77-ac27-cd5246cc0d35 tempest-ServerRescueNegativeTestJSON-1366830861 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:50:03 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-6557d7c1-52bd-4c77-ac27-cd5246cc0d35 tempest-ServerRescueNegativeTestJSON-1366830861 None] Deleted volume successfully. Jul 30 16:50:03 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-6557d7c1-52bd-4c77-ac27-cd5246cc0d35 tempest-ServerRescueNegativeTestJSON-1366830861 None] Lock "cinder-54e168ed-ce2e-412a-ab51-a18c714f4db1-delete_volume" released by "delete_volume" :: held 1.855s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:50:12 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:SELECT=5,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:50:12 devstack cinder-volume[88591]: DEBUG oslo_service.periodic_task [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:50:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:50:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:50:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:50:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:50:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:50:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:50:12 devstack sudo[90611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:50:12 devstack sudo[90611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:50:12 devstack sudo[90611]: pam_unix(sudo:session): session closed for user root Jul 30 16:50:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.460s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:50:12 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:50:13 devstack cinder-volume[88591]: DEBUG oslo_service.periodic_task [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running periodic task VolumeManager._thread_info {{(pid=88591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:50:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] thread count: 8 {{(pid=88591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:50:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] thread info: [<_MainThread(MainThread, started 140677178003584)>, , , , , , , ] {{(pid=88591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:50:13 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:SELECT=5,cinder:INSERT=3,cinder:UPDATE=11,cinder:DELETE=1 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:50:17 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a7c1893-5f51-4627-a81a-2860b20524b1 tempest-TaggedAttachmentsTest-1743215712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:50:17 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0a7c1893-5f51-4627-a81a-2860b20524b1 tempest-TaggedAttachmentsTest-1743215712 None] Flow 'volume_create_manager' (643dbbc9-e0e4-42b5-9ae4-24d8fe12f4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:50:17 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0a7c1893-5f51-4627-a81a-2860b20524b1 tempest-TaggedAttachmentsTest-1743215712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2672d2a-7c96-48ed-be3f-825223a31dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:17 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0a7c1893-5f51-4627-a81a-2860b20524b1 tempest-TaggedAttachmentsTest-1743215712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2672d2a-7c96-48ed-be3f-825223a31dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-442803422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40a65094-4b4d-45ed-911c-fbac796076dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca6ad571c6dd4b17b8af427adaf17880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:50:17Z,use_quota=True,user_id='2cd6958018f741df888553679c0ac7b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:17 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0a7c1893-5f51-4627-a81a-2860b20524b1 tempest-TaggedAttachmentsTest-1743215712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d997c9a-0d0a-4403-9391-11d1a019a95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:17 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0a7c1893-5f51-4627-a81a-2860b20524b1 tempest-TaggedAttachmentsTest-1743215712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d997c9a-0d0a-4403-9391-11d1a019a95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:17 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0a7c1893-5f51-4627-a81a-2860b20524b1 tempest-TaggedAttachmentsTest-1743215712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23c0e2e2-885d-4a4f-8a03-936fb8551fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:17 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0a7c1893-5f51-4627-a81a-2860b20524b1 tempest-TaggedAttachmentsTest-1743215712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23c0e2e2-885d-4a4f-8a03-936fb8551fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40a65094-4b4d-45ed-911c-fbac796076dd', 'volume_name': 'volume-40a65094-4b4d-45ed-911c-fbac796076dd', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:17 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0a7c1893-5f51-4627-a81a-2860b20524b1 tempest-TaggedAttachmentsTest-1743215712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f3b9c5c-6164-416e-a427-c69bac00a66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:17 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0a7c1893-5f51-4627-a81a-2860b20524b1 tempest-TaggedAttachmentsTest-1743215712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f3b9c5c-6164-416e-a427-c69bac00a66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:17 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0a7c1893-5f51-4627-a81a-2860b20524b1 tempest-TaggedAttachmentsTest-1743215712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e640b476-abdd-4450-8787-d575c8d985a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:17 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-0a7c1893-5f51-4627-a81a-2860b20524b1 tempest-TaggedAttachmentsTest-1743215712 None] Volume 40a65094-4b4d-45ed-911c-fbac796076dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40a65094-4b4d-45ed-911c-fbac796076dd', 'volume_size': 1} Jul 30 16:50:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0a7c1893-5f51-4627-a81a-2860b20524b1 tempest-TaggedAttachmentsTest-1743215712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:50:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0a7c1893-5f51-4627-a81a-2860b20524b1 tempest-TaggedAttachmentsTest-1743215712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:50:17 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-0a7c1893-5f51-4627-a81a-2860b20524b1 tempest-TaggedAttachmentsTest-1743215712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-442803422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40a65094-4b4d-45ed-911c-fbac796076dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca6ad571c6dd4b17b8af427adaf17880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:50:17Z,use_quota=True,user_id='2cd6958018f741df888553679c0ac7b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:50:17 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-0a7c1893-5f51-4627-a81a-2860b20524b1 tempest-TaggedAttachmentsTest-1743215712 None] Creating volume 40a65094-4b4d-45ed-911c-fbac796076dd {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:50:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0a7c1893-5f51-4627-a81a-2860b20524b1 tempest-TaggedAttachmentsTest-1743215712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:50:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0a7c1893-5f51-4627-a81a-2860b20524b1 tempest-TaggedAttachmentsTest-1743215712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:50:17 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-0a7c1893-5f51-4627-a81a-2860b20524b1 tempest-TaggedAttachmentsTest-1743215712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:50:17 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-0a7c1893-5f51-4627-a81a-2860b20524b1 tempest-TaggedAttachmentsTest-1743215712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:50:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0a7c1893-5f51-4627-a81a-2860b20524b1 tempest-TaggedAttachmentsTest-1743215712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:50:17 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-0a7c1893-5f51-4627-a81a-2860b20524b1 tempest-TaggedAttachmentsTest-1743215712 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:50:17 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-0a7c1893-5f51-4627-a81a-2860b20524b1 tempest-TaggedAttachmentsTest-1743215712 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:50:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0a7c1893-5f51-4627-a81a-2860b20524b1 tempest-TaggedAttachmentsTest-1743215712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-40a65094-4b4d-45ed-911c-fbac796076dd 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:50:17 devstack sudo[90642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-40a65094-4b4d-45ed-911c-fbac796076dd 1073741824 Jul 30 16:50:17 devstack sudo[90642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:50:18 devstack sudo[90642]: pam_unix(sudo:session): session closed for user root Jul 30 16:50:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0a7c1893-5f51-4627-a81a-2860b20524b1 tempest-TaggedAttachmentsTest-1743215712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-40a65094-4b4d-45ed-911c-fbac796076dd 1073741824" returned: 0 in 0.650s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:50:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0a7c1893-5f51-4627-a81a-2860b20524b1 tempest-TaggedAttachmentsTest-1743215712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-40a65094-4b4d-45ed-911c-fbac796076dd {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:50:18 devstack sudo[90649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-40a65094-4b4d-45ed-911c-fbac796076dd Jul 30 16:50:18 devstack sudo[90649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:50:18 devstack sudo[90649]: pam_unix(sudo:session): session closed for user root Jul 30 16:50:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0a7c1893-5f51-4627-a81a-2860b20524b1 tempest-TaggedAttachmentsTest-1743215712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-40a65094-4b4d-45ed-911c-fbac796076dd" returned: 0 in 0.336s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:50:18 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-0a7c1893-5f51-4627-a81a-2860b20524b1 tempest-TaggedAttachmentsTest-1743215712 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:50:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0a7c1893-5f51-4627-a81a-2860b20524b1 tempest-TaggedAttachmentsTest-1743215712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:50:18 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0a7c1893-5f51-4627-a81a-2860b20524b1 tempest-TaggedAttachmentsTest-1743215712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e640b476-abdd-4450-8787-d575c8d985a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40a65094-4b4d-45ed-911c-fbac796076dd', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:18 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0a7c1893-5f51-4627-a81a-2860b20524b1 tempest-TaggedAttachmentsTest-1743215712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e87e5a79-1cf2-47c2-9beb-4de20bccdac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:18 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-0a7c1893-5f51-4627-a81a-2860b20524b1 tempest-TaggedAttachmentsTest-1743215712 None] Volume volume-40a65094-4b4d-45ed-911c-fbac796076dd (40a65094-4b4d-45ed-911c-fbac796076dd): created successfully Jul 30 16:50:18 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0a7c1893-5f51-4627-a81a-2860b20524b1 tempest-TaggedAttachmentsTest-1743215712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e87e5a79-1cf2-47c2-9beb-4de20bccdac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:18 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0a7c1893-5f51-4627-a81a-2860b20524b1 tempest-TaggedAttachmentsTest-1743215712 None] Flow 'volume_create_manager' (643dbbc9-e0e4-42b5-9ae4-24d8fe12f4c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:50:18 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-0a7c1893-5f51-4627-a81a-2860b20524b1 tempest-TaggedAttachmentsTest-1743215712 None] Created volume successfully. Jul 30 16:50:28 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:50:28 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:50:30 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-b70b6eaf-3dac-43fd-9e99-e286e3e9301f tempest-VolumesTestJSON-131648578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:50:30 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b70b6eaf-3dac-43fd-9e99-e286e3e9301f tempest-VolumesTestJSON-131648578 None] Flow 'volume_create_manager' (7db00611-7f37-4204-bfe5-0f1f78c56575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:50:30 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b70b6eaf-3dac-43fd-9e99-e286e3e9301f tempest-VolumesTestJSON-131648578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39240292-49c9-4248-af3c-c3b05681b285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:30 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b70b6eaf-3dac-43fd-9e99-e286e3e9301f tempest-VolumesTestJSON-131648578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39240292-49c9-4248-af3c-c3b05681b285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:50:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-139795487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac9a49e5-9690-4e8c-b205-85d7fca939e0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fae233c4529544e2ba81a5581afbd42a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:50:31Z,use_quota=True,user_id='1f3866aa3419407498000514cbcb65fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:30 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b70b6eaf-3dac-43fd-9e99-e286e3e9301f tempest-VolumesTestJSON-131648578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bccf6911-623b-45c9-a0e7-b9b588c21ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:30 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b70b6eaf-3dac-43fd-9e99-e286e3e9301f tempest-VolumesTestJSON-131648578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bccf6911-623b-45c9-a0e7-b9b588c21ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:30 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b70b6eaf-3dac-43fd-9e99-e286e3e9301f tempest-VolumesTestJSON-131648578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4012d5a8-7640-40b9-b818-f8239b65b532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:30 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b70b6eaf-3dac-43fd-9e99-e286e3e9301f tempest-VolumesTestJSON-131648578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4012d5a8-7640-40b9-b818-f8239b65b532) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac9a49e5-9690-4e8c-b205-85d7fca939e0', 'volume_name': 'volume-ac9a49e5-9690-4e8c-b205-85d7fca939e0', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:30 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b70b6eaf-3dac-43fd-9e99-e286e3e9301f tempest-VolumesTestJSON-131648578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4973ca74-c06c-4a72-bdae-18fbea7cb32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:30 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b70b6eaf-3dac-43fd-9e99-e286e3e9301f tempest-VolumesTestJSON-131648578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4973ca74-c06c-4a72-bdae-18fbea7cb32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:30 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b70b6eaf-3dac-43fd-9e99-e286e3e9301f tempest-VolumesTestJSON-131648578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee8c9c1f-944e-4599-9e7a-b65627dadc8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:30 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-b70b6eaf-3dac-43fd-9e99-e286e3e9301f tempest-VolumesTestJSON-131648578 None] Volume ac9a49e5-9690-4e8c-b205-85d7fca939e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac9a49e5-9690-4e8c-b205-85d7fca939e0', 'volume_size': 1} Jul 30 16:50:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b70b6eaf-3dac-43fd-9e99-e286e3e9301f tempest-VolumesTestJSON-131648578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:50:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b70b6eaf-3dac-43fd-9e99-e286e3e9301f tempest-VolumesTestJSON-131648578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:50:30 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b70b6eaf-3dac-43fd-9e99-e286e3e9301f tempest-VolumesTestJSON-131648578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:50:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-139795487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac9a49e5-9690-4e8c-b205-85d7fca939e0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fae233c4529544e2ba81a5581afbd42a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:50:31Z,use_quota=True,user_id='1f3866aa3419407498000514cbcb65fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:50:30 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-b70b6eaf-3dac-43fd-9e99-e286e3e9301f tempest-VolumesTestJSON-131648578 None] Creating volume ac9a49e5-9690-4e8c-b205-85d7fca939e0 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:50:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b70b6eaf-3dac-43fd-9e99-e286e3e9301f tempest-VolumesTestJSON-131648578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:50:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b70b6eaf-3dac-43fd-9e99-e286e3e9301f tempest-VolumesTestJSON-131648578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:50:30 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b70b6eaf-3dac-43fd-9e99-e286e3e9301f tempest-VolumesTestJSON-131648578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:50:30 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b70b6eaf-3dac-43fd-9e99-e286e3e9301f tempest-VolumesTestJSON-131648578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:50:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b70b6eaf-3dac-43fd-9e99-e286e3e9301f tempest-VolumesTestJSON-131648578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:50:30 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b70b6eaf-3dac-43fd-9e99-e286e3e9301f tempest-VolumesTestJSON-131648578 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:50:30 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-b70b6eaf-3dac-43fd-9e99-e286e3e9301f tempest-VolumesTestJSON-131648578 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:50:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b70b6eaf-3dac-43fd-9e99-e286e3e9301f tempest-VolumesTestJSON-131648578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac9a49e5-9690-4e8c-b205-85d7fca939e0 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:50:30 devstack sudo[90714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac9a49e5-9690-4e8c-b205-85d7fca939e0 1073741824 Jul 30 16:50:30 devstack sudo[90714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:50:31 devstack sudo[90714]: pam_unix(sudo:session): session closed for user root Jul 30 16:50:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b70b6eaf-3dac-43fd-9e99-e286e3e9301f tempest-VolumesTestJSON-131648578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac9a49e5-9690-4e8c-b205-85d7fca939e0 1073741824" returned: 0 in 0.591s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:50:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b70b6eaf-3dac-43fd-9e99-e286e3e9301f tempest-VolumesTestJSON-131648578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac9a49e5-9690-4e8c-b205-85d7fca939e0 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:50:31 devstack sudo[90721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac9a49e5-9690-4e8c-b205-85d7fca939e0 Jul 30 16:50:31 devstack sudo[90721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:50:32 devstack sudo[90721]: pam_unix(sudo:session): session closed for user root Jul 30 16:50:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b70b6eaf-3dac-43fd-9e99-e286e3e9301f tempest-VolumesTestJSON-131648578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac9a49e5-9690-4e8c-b205-85d7fca939e0" returned: 0 in 0.616s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:50:32 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b70b6eaf-3dac-43fd-9e99-e286e3e9301f tempest-VolumesTestJSON-131648578 None] <== create_volume: return (1275ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:50:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b70b6eaf-3dac-43fd-9e99-e286e3e9301f tempest-VolumesTestJSON-131648578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.281s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:50:32 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b70b6eaf-3dac-43fd-9e99-e286e3e9301f tempest-VolumesTestJSON-131648578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee8c9c1f-944e-4599-9e7a-b65627dadc8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac9a49e5-9690-4e8c-b205-85d7fca939e0', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:32 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b70b6eaf-3dac-43fd-9e99-e286e3e9301f tempest-VolumesTestJSON-131648578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76c4b8e2-a8e4-4f7b-b27d-a1156a636ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:32 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-b70b6eaf-3dac-43fd-9e99-e286e3e9301f tempest-VolumesTestJSON-131648578 None] Volume volume-ac9a49e5-9690-4e8c-b205-85d7fca939e0 (ac9a49e5-9690-4e8c-b205-85d7fca939e0): created successfully Jul 30 16:50:32 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b70b6eaf-3dac-43fd-9e99-e286e3e9301f tempest-VolumesTestJSON-131648578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76c4b8e2-a8e4-4f7b-b27d-a1156a636ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:32 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b70b6eaf-3dac-43fd-9e99-e286e3e9301f tempest-VolumesTestJSON-131648578 None] Flow 'volume_create_manager' (7db00611-7f37-4204-bfe5-0f1f78c56575) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:50:32 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-b70b6eaf-3dac-43fd-9e99-e286e3e9301f tempest-VolumesTestJSON-131648578 None] Created volume successfully. Jul 30 16:50:34 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0aac116-d000-4ede-8afb-2f4f9d80e330 tempest-VolumesTestJSON-131648578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:50:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a0aac116-d000-4ede-8afb-2f4f9d80e330 tempest-VolumesTestJSON-131648578 None] Flow 'volume_create_manager' (23e34387-e103-49e9-bd91-49e234c6a437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:50:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a0aac116-d000-4ede-8afb-2f4f9d80e330 tempest-VolumesTestJSON-131648578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d9b71c4-7220-46ae-afea-7de957bb512e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a0aac116-d000-4ede-8afb-2f4f9d80e330 tempest-VolumesTestJSON-131648578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d9b71c4-7220-46ae-afea-7de957bb512e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1255431874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d1d888c-b61d-4dcf-bbf5-d88e476d10ca,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fae233c4529544e2ba81a5581afbd42a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:50:34Z,use_quota=True,user_id='1f3866aa3419407498000514cbcb65fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a0aac116-d000-4ede-8afb-2f4f9d80e330 tempest-VolumesTestJSON-131648578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dc468b0-b110-4dea-9533-61300f0bb565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a0aac116-d000-4ede-8afb-2f4f9d80e330 tempest-VolumesTestJSON-131648578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dc468b0-b110-4dea-9533-61300f0bb565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a0aac116-d000-4ede-8afb-2f4f9d80e330 tempest-VolumesTestJSON-131648578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e42bfdd-52b5-46f8-8392-5fab4782f6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a0aac116-d000-4ede-8afb-2f4f9d80e330 tempest-VolumesTestJSON-131648578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e42bfdd-52b5-46f8-8392-5fab4782f6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d1d888c-b61d-4dcf-bbf5-d88e476d10ca', 'volume_name': 'volume-1d1d888c-b61d-4dcf-bbf5-d88e476d10ca', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a0aac116-d000-4ede-8afb-2f4f9d80e330 tempest-VolumesTestJSON-131648578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee51ce15-d289-4196-8bbc-b719c3b023b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a0aac116-d000-4ede-8afb-2f4f9d80e330 tempest-VolumesTestJSON-131648578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee51ce15-d289-4196-8bbc-b719c3b023b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a0aac116-d000-4ede-8afb-2f4f9d80e330 tempest-VolumesTestJSON-131648578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f8767b1-27e9-406e-be31-d7a11ba2adf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:34 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-a0aac116-d000-4ede-8afb-2f4f9d80e330 tempest-VolumesTestJSON-131648578 None] Volume 1d1d888c-b61d-4dcf-bbf5-d88e476d10ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d1d888c-b61d-4dcf-bbf5-d88e476d10ca', 'volume_size': 1} Jul 30 16:50:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a0aac116-d000-4ede-8afb-2f4f9d80e330 tempest-VolumesTestJSON-131648578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:50:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a0aac116-d000-4ede-8afb-2f4f9d80e330 tempest-VolumesTestJSON-131648578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:50:34 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a0aac116-d000-4ede-8afb-2f4f9d80e330 tempest-VolumesTestJSON-131648578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1255431874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d1d888c-b61d-4dcf-bbf5-d88e476d10ca,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fae233c4529544e2ba81a5581afbd42a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:50:34Z,use_quota=True,user_id='1f3866aa3419407498000514cbcb65fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:50:34 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-a0aac116-d000-4ede-8afb-2f4f9d80e330 tempest-VolumesTestJSON-131648578 None] Creating volume 1d1d888c-b61d-4dcf-bbf5-d88e476d10ca {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:50:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a0aac116-d000-4ede-8afb-2f4f9d80e330 tempest-VolumesTestJSON-131648578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:50:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a0aac116-d000-4ede-8afb-2f4f9d80e330 tempest-VolumesTestJSON-131648578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:50:34 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a0aac116-d000-4ede-8afb-2f4f9d80e330 tempest-VolumesTestJSON-131648578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:50:34 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a0aac116-d000-4ede-8afb-2f4f9d80e330 tempest-VolumesTestJSON-131648578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:50:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a0aac116-d000-4ede-8afb-2f4f9d80e330 tempest-VolumesTestJSON-131648578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:50:34 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a0aac116-d000-4ede-8afb-2f4f9d80e330 tempest-VolumesTestJSON-131648578 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:50:34 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-a0aac116-d000-4ede-8afb-2f4f9d80e330 tempest-VolumesTestJSON-131648578 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:50:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a0aac116-d000-4ede-8afb-2f4f9d80e330 tempest-VolumesTestJSON-131648578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1d1d888c-b61d-4dcf-bbf5-d88e476d10ca 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:50:34 devstack sudo[90844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1d1d888c-b61d-4dcf-bbf5-d88e476d10ca 1073741824 Jul 30 16:50:34 devstack sudo[90844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:50:35 devstack sudo[90844]: pam_unix(sudo:session): session closed for user root Jul 30 16:50:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a0aac116-d000-4ede-8afb-2f4f9d80e330 tempest-VolumesTestJSON-131648578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1d1d888c-b61d-4dcf-bbf5-d88e476d10ca 1073741824" returned: 0 in 0.882s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:50:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a0aac116-d000-4ede-8afb-2f4f9d80e330 tempest-VolumesTestJSON-131648578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1d1d888c-b61d-4dcf-bbf5-d88e476d10ca {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:50:35 devstack sudo[90855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1d1d888c-b61d-4dcf-bbf5-d88e476d10ca Jul 30 16:50:35 devstack sudo[90855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:50:36 devstack sudo[90855]: pam_unix(sudo:session): session closed for user root Jul 30 16:50:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a0aac116-d000-4ede-8afb-2f4f9d80e330 tempest-VolumesTestJSON-131648578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1d1d888c-b61d-4dcf-bbf5-d88e476d10ca" returned: 0 in 0.554s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:50:36 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a0aac116-d000-4ede-8afb-2f4f9d80e330 tempest-VolumesTestJSON-131648578 None] <== create_volume: return (1561ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:50:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a0aac116-d000-4ede-8afb-2f4f9d80e330 tempest-VolumesTestJSON-131648578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:50:36 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a0aac116-d000-4ede-8afb-2f4f9d80e330 tempest-VolumesTestJSON-131648578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f8767b1-27e9-406e-be31-d7a11ba2adf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d1d888c-b61d-4dcf-bbf5-d88e476d10ca', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:36 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a0aac116-d000-4ede-8afb-2f4f9d80e330 tempest-VolumesTestJSON-131648578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0f6a779-4462-4c7d-8400-0cf5fd965c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:36 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-a0aac116-d000-4ede-8afb-2f4f9d80e330 tempest-VolumesTestJSON-131648578 None] Volume volume-1d1d888c-b61d-4dcf-bbf5-d88e476d10ca (1d1d888c-b61d-4dcf-bbf5-d88e476d10ca): created successfully Jul 30 16:50:36 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a0aac116-d000-4ede-8afb-2f4f9d80e330 tempest-VolumesTestJSON-131648578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0f6a779-4462-4c7d-8400-0cf5fd965c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:36 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a0aac116-d000-4ede-8afb-2f4f9d80e330 tempest-VolumesTestJSON-131648578 None] Flow 'volume_create_manager' (23e34387-e103-49e9-bd91-49e234c6a437) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:50:36 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-a0aac116-d000-4ede-8afb-2f4f9d80e330 tempest-VolumesTestJSON-131648578 None] Created volume successfully. Jul 30 16:50:38 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fba3a8f-80bc-48be-9904-d78f4a4e5203 tempest-VolumesTestJSON-131648578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:50:38 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0fba3a8f-80bc-48be-9904-d78f4a4e5203 tempest-VolumesTestJSON-131648578 None] Flow 'volume_create_manager' (c3afd39a-3c7d-4eff-b814-1cf137a48a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:50:38 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0fba3a8f-80bc-48be-9904-d78f4a4e5203 tempest-VolumesTestJSON-131648578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8909886-5bc4-4515-8ee8-d1fa9825d023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:38 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0fba3a8f-80bc-48be-9904-d78f4a4e5203 tempest-VolumesTestJSON-131648578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8909886-5bc4-4515-8ee8-d1fa9825d023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1931955291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ebb9465-d7a6-4c31-ac99-c97a81d8ffa0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fae233c4529544e2ba81a5581afbd42a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:50:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:50:38Z,use_quota=True,user_id='1f3866aa3419407498000514cbcb65fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:38 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0fba3a8f-80bc-48be-9904-d78f4a4e5203 tempest-VolumesTestJSON-131648578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40697368-7cd1-4ca0-b50d-983e855719ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:38 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0fba3a8f-80bc-48be-9904-d78f4a4e5203 tempest-VolumesTestJSON-131648578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40697368-7cd1-4ca0-b50d-983e855719ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:38 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0fba3a8f-80bc-48be-9904-d78f4a4e5203 tempest-VolumesTestJSON-131648578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00f99570-604d-4a5d-be62-125aafebca77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:38 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0fba3a8f-80bc-48be-9904-d78f4a4e5203 tempest-VolumesTestJSON-131648578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00f99570-604d-4a5d-be62-125aafebca77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ebb9465-d7a6-4c31-ac99-c97a81d8ffa0', 'volume_name': 'volume-6ebb9465-d7a6-4c31-ac99-c97a81d8ffa0', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:38 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0fba3a8f-80bc-48be-9904-d78f4a4e5203 tempest-VolumesTestJSON-131648578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (590d5ee0-a4ad-49a8-8448-6bf83bdc4519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:38 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0fba3a8f-80bc-48be-9904-d78f4a4e5203 tempest-VolumesTestJSON-131648578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (590d5ee0-a4ad-49a8-8448-6bf83bdc4519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:38 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0fba3a8f-80bc-48be-9904-d78f4a4e5203 tempest-VolumesTestJSON-131648578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2a8ac6d-40b0-4dac-b860-9644be7cdbcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:38 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-0fba3a8f-80bc-48be-9904-d78f4a4e5203 tempest-VolumesTestJSON-131648578 None] Volume 6ebb9465-d7a6-4c31-ac99-c97a81d8ffa0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ebb9465-d7a6-4c31-ac99-c97a81d8ffa0', 'volume_size': 1} Jul 30 16:50:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0fba3a8f-80bc-48be-9904-d78f4a4e5203 tempest-VolumesTestJSON-131648578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:50:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0fba3a8f-80bc-48be-9904-d78f4a4e5203 tempest-VolumesTestJSON-131648578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:50:38 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-0fba3a8f-80bc-48be-9904-d78f4a4e5203 tempest-VolumesTestJSON-131648578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1931955291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ebb9465-d7a6-4c31-ac99-c97a81d8ffa0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fae233c4529544e2ba81a5581afbd42a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:50:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:50:38Z,use_quota=True,user_id='1f3866aa3419407498000514cbcb65fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:50:38 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-0fba3a8f-80bc-48be-9904-d78f4a4e5203 tempest-VolumesTestJSON-131648578 None] Creating volume 6ebb9465-d7a6-4c31-ac99-c97a81d8ffa0 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:50:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0fba3a8f-80bc-48be-9904-d78f4a4e5203 tempest-VolumesTestJSON-131648578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:50:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0fba3a8f-80bc-48be-9904-d78f4a4e5203 tempest-VolumesTestJSON-131648578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:50:38 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-0fba3a8f-80bc-48be-9904-d78f4a4e5203 tempest-VolumesTestJSON-131648578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:50:38 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-0fba3a8f-80bc-48be-9904-d78f4a4e5203 tempest-VolumesTestJSON-131648578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:50:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0fba3a8f-80bc-48be-9904-d78f4a4e5203 tempest-VolumesTestJSON-131648578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:50:38 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-0fba3a8f-80bc-48be-9904-d78f4a4e5203 tempest-VolumesTestJSON-131648578 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:50:38 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-0fba3a8f-80bc-48be-9904-d78f4a4e5203 tempest-VolumesTestJSON-131648578 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:50:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0fba3a8f-80bc-48be-9904-d78f4a4e5203 tempest-VolumesTestJSON-131648578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-6ebb9465-d7a6-4c31-ac99-c97a81d8ffa0 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:50:38 devstack sudo[90934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-6ebb9465-d7a6-4c31-ac99-c97a81d8ffa0 1073741824 Jul 30 16:50:38 devstack sudo[90934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:50:39 devstack sudo[90934]: pam_unix(sudo:session): session closed for user root Jul 30 16:50:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0fba3a8f-80bc-48be-9904-d78f4a4e5203 tempest-VolumesTestJSON-131648578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-6ebb9465-d7a6-4c31-ac99-c97a81d8ffa0 1073741824" returned: 0 in 0.849s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:50:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0fba3a8f-80bc-48be-9904-d78f4a4e5203 tempest-VolumesTestJSON-131648578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-6ebb9465-d7a6-4c31-ac99-c97a81d8ffa0 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:50:39 devstack sudo[90942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-6ebb9465-d7a6-4c31-ac99-c97a81d8ffa0 Jul 30 16:50:39 devstack sudo[90942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:50:39 devstack sudo[90942]: pam_unix(sudo:session): session closed for user root Jul 30 16:50:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0fba3a8f-80bc-48be-9904-d78f4a4e5203 tempest-VolumesTestJSON-131648578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-6ebb9465-d7a6-4c31-ac99-c97a81d8ffa0" returned: 0 in 0.477s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:50:39 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-0fba3a8f-80bc-48be-9904-d78f4a4e5203 tempest-VolumesTestJSON-131648578 None] <== create_volume: return (1491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:50:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0fba3a8f-80bc-48be-9904-d78f4a4e5203 tempest-VolumesTestJSON-131648578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.495s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:50:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0fba3a8f-80bc-48be-9904-d78f4a4e5203 tempest-VolumesTestJSON-131648578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2a8ac6d-40b0-4dac-b860-9644be7cdbcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ebb9465-d7a6-4c31-ac99-c97a81d8ffa0', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0fba3a8f-80bc-48be-9904-d78f4a4e5203 tempest-VolumesTestJSON-131648578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a733df1-084f-46c5-bfb0-ba26ec161a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:39 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-0fba3a8f-80bc-48be-9904-d78f4a4e5203 tempest-VolumesTestJSON-131648578 None] Volume volume-6ebb9465-d7a6-4c31-ac99-c97a81d8ffa0 (6ebb9465-d7a6-4c31-ac99-c97a81d8ffa0): created successfully Jul 30 16:50:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0fba3a8f-80bc-48be-9904-d78f4a4e5203 tempest-VolumesTestJSON-131648578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a733df1-084f-46c5-bfb0-ba26ec161a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0fba3a8f-80bc-48be-9904-d78f4a4e5203 tempest-VolumesTestJSON-131648578 None] Flow 'volume_create_manager' (c3afd39a-3c7d-4eff-b814-1cf137a48a49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:50:40 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-0fba3a8f-80bc-48be-9904-d78f4a4e5203 tempest-VolumesTestJSON-131648578 None] Created volume successfully. Jul 30 16:50:43 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-61a270f3-afb2-47d5-a6ed-44bdf04b0deb tempest-VolumesTestJSON-131648578 None] Acquiring lock "cinder-6ebb9465-d7a6-4c31-ac99-c97a81d8ffa0-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:50:43 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-61a270f3-afb2-47d5-a6ed-44bdf04b0deb tempest-VolumesTestJSON-131648578 None] Lock "cinder-6ebb9465-d7a6-4c31-ac99-c97a81d8ffa0-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:50:43 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-61a270f3-afb2-47d5-a6ed-44bdf04b0deb tempest-VolumesTestJSON-131648578 None] Acquiring lock "cinder-quobyte-6ebb9465-d7a6-4c31-ac99-c97a81d8ffa0" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:50:43 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-61a270f3-afb2-47d5-a6ed-44bdf04b0deb tempest-VolumesTestJSON-131648578 None] Lock "cinder-quobyte-6ebb9465-d7a6-4c31-ac99-c97a81d8ffa0" acquired by "delete_volume" :: waited 0.024s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:50:43 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8afd10b7-03f8-46a3-883b-af3ebd0bdf34]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:50:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-61a270f3-afb2-47d5-a6ed-44bdf04b0deb tempest-VolumesTestJSON-131648578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-6ebb9465-d7a6-4c31-ac99-c97a81d8ffa0 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:50:43 devstack sudo[90965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-6ebb9465-d7a6-4c31-ac99-c97a81d8ffa0 Jul 30 16:50:43 devstack sudo[90965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:50:44 devstack sudo[90965]: pam_unix(sudo:session): session closed for user root Jul 30 16:50:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-61a270f3-afb2-47d5-a6ed-44bdf04b0deb tempest-VolumesTestJSON-131648578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-6ebb9465-d7a6-4c31-ac99-c97a81d8ffa0" returned: 0 in 1.036s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:50:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-61a270f3-afb2-47d5-a6ed-44bdf04b0deb tempest-VolumesTestJSON-131648578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-6ebb9465-d7a6-4c31-ac99-c97a81d8ffa0 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:50:44 devstack sudo[90970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-6ebb9465-d7a6-4c31-ac99-c97a81d8ffa0 Jul 30 16:50:44 devstack sudo[90970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:50:45 devstack sudo[90970]: pam_unix(sudo:session): session closed for user root Jul 30 16:50:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-61a270f3-afb2-47d5-a6ed-44bdf04b0deb tempest-VolumesTestJSON-131648578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-6ebb9465-d7a6-4c31-ac99-c97a81d8ffa0" returned: 0 in 0.484s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:50:45 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-61a270f3-afb2-47d5-a6ed-44bdf04b0deb tempest-VolumesTestJSON-131648578 None] Lock "cinder-quobyte-6ebb9465-d7a6-4c31-ac99-c97a81d8ffa0" released by "delete_volume" :: held 1.624s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:50:45 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-61a270f3-afb2-47d5-a6ed-44bdf04b0deb tempest-VolumesTestJSON-131648578 None] Created reservations ['d217948a-c0f2-4047-8c57-86aa6ce4f7fb', '55c04a96-a7d0-474a-9206-cf7abc5296ae', '8f16f1c8-0c16-428f-96bb-64ef10b436c7', '4fa24bde-6e7b-4616-a99b-f2ee83dbfc3b'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:50:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-61a270f3-afb2-47d5-a6ed-44bdf04b0deb tempest-VolumesTestJSON-131648578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:50:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-61a270f3-afb2-47d5-a6ed-44bdf04b0deb tempest-VolumesTestJSON-131648578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:50:45 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-61a270f3-afb2-47d5-a6ed-44bdf04b0deb tempest-VolumesTestJSON-131648578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:50:45 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-61a270f3-afb2-47d5-a6ed-44bdf04b0deb tempest-VolumesTestJSON-131648578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:50:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-61a270f3-afb2-47d5-a6ed-44bdf04b0deb tempest-VolumesTestJSON-131648578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:50:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-61a270f3-afb2-47d5-a6ed-44bdf04b0deb tempest-VolumesTestJSON-131648578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:50:45 devstack sudo[90975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:50:45 devstack sudo[90975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:50:45 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b29a695a-dd37-498b-9f09-6e9f4b07cc62 tempest-VolumesTestJSON-131648578 None] Acquiring lock "cinder-1d1d888c-b61d-4dcf-bbf5-d88e476d10ca-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:50:45 devstack sudo[90975]: pam_unix(sudo:session): session closed for user root Jul 30 16:50:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-61a270f3-afb2-47d5-a6ed-44bdf04b0deb tempest-VolumesTestJSON-131648578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.491s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:50:45 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-61a270f3-afb2-47d5-a6ed-44bdf04b0deb tempest-VolumesTestJSON-131648578 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:50:45 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-61a270f3-afb2-47d5-a6ed-44bdf04b0deb tempest-VolumesTestJSON-131648578 None] Deleted volume successfully. Jul 30 16:50:46 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b29a695a-dd37-498b-9f09-6e9f4b07cc62 tempest-VolumesTestJSON-131648578 None] Lock "cinder-1d1d888c-b61d-4dcf-bbf5-d88e476d10ca-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:50:46 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-61a270f3-afb2-47d5-a6ed-44bdf04b0deb tempest-VolumesTestJSON-131648578 None] Lock "cinder-6ebb9465-d7a6-4c31-ac99-c97a81d8ffa0-delete_volume" released by "delete_volume" :: held 2.649s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:50:46 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b29a695a-dd37-498b-9f09-6e9f4b07cc62 tempest-VolumesTestJSON-131648578 None] Acquiring lock "cinder-quobyte-1d1d888c-b61d-4dcf-bbf5-d88e476d10ca" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:50:46 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b29a695a-dd37-498b-9f09-6e9f4b07cc62 tempest-VolumesTestJSON-131648578 None] Lock "cinder-quobyte-1d1d888c-b61d-4dcf-bbf5-d88e476d10ca" acquired by "delete_volume" :: waited 0.036s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:50:46 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c9f60f-fd7e-4c40-b5bb-9df4dc662af4]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:50:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b29a695a-dd37-498b-9f09-6e9f4b07cc62 tempest-VolumesTestJSON-131648578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1d1d888c-b61d-4dcf-bbf5-d88e476d10ca {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:50:46 devstack sudo[90978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1d1d888c-b61d-4dcf-bbf5-d88e476d10ca Jul 30 16:50:46 devstack sudo[90978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:50:46 devstack sudo[90978]: pam_unix(sudo:session): session closed for user root Jul 30 16:50:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b29a695a-dd37-498b-9f09-6e9f4b07cc62 tempest-VolumesTestJSON-131648578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1d1d888c-b61d-4dcf-bbf5-d88e476d10ca" returned: 0 in 0.737s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:50:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b29a695a-dd37-498b-9f09-6e9f4b07cc62 tempest-VolumesTestJSON-131648578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1d1d888c-b61d-4dcf-bbf5-d88e476d10ca {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:50:46 devstack sudo[90983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1d1d888c-b61d-4dcf-bbf5-d88e476d10ca Jul 30 16:50:46 devstack sudo[90983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:50:47 devstack sudo[90983]: pam_unix(sudo:session): session closed for user root Jul 30 16:50:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b29a695a-dd37-498b-9f09-6e9f4b07cc62 tempest-VolumesTestJSON-131648578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1d1d888c-b61d-4dcf-bbf5-d88e476d10ca" returned: 0 in 0.517s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:50:47 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b29a695a-dd37-498b-9f09-6e9f4b07cc62 tempest-VolumesTestJSON-131648578 None] Lock "cinder-quobyte-1d1d888c-b61d-4dcf-bbf5-d88e476d10ca" released by "delete_volume" :: held 1.344s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:50:47 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-b29a695a-dd37-498b-9f09-6e9f4b07cc62 tempest-VolumesTestJSON-131648578 None] Created reservations ['92adc02a-c060-450b-a196-d36f721a93fa', '3132edd9-3de2-44e9-b20b-7e0a2cba4201', '27d009d7-584c-44b3-9c69-64ce713e5cd4', '07ae56af-bedd-4789-85de-e8878956e530'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:50:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b29a695a-dd37-498b-9f09-6e9f4b07cc62 tempest-VolumesTestJSON-131648578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:50:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b29a695a-dd37-498b-9f09-6e9f4b07cc62 tempest-VolumesTestJSON-131648578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:50:47 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b29a695a-dd37-498b-9f09-6e9f4b07cc62 tempest-VolumesTestJSON-131648578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:50:47 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b29a695a-dd37-498b-9f09-6e9f4b07cc62 tempest-VolumesTestJSON-131648578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:50:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b29a695a-dd37-498b-9f09-6e9f4b07cc62 tempest-VolumesTestJSON-131648578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:50:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b29a695a-dd37-498b-9f09-6e9f4b07cc62 tempest-VolumesTestJSON-131648578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:50:47 devstack sudo[90986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:50:47 devstack sudo[90986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:50:48 devstack sudo[90986]: pam_unix(sudo:session): session closed for user root Jul 30 16:50:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b29a695a-dd37-498b-9f09-6e9f4b07cc62 tempest-VolumesTestJSON-131648578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.554s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:50:48 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-b29a695a-dd37-498b-9f09-6e9f4b07cc62 tempest-VolumesTestJSON-131648578 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:50:48 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-b29a695a-dd37-498b-9f09-6e9f4b07cc62 tempest-VolumesTestJSON-131648578 None] Deleted volume successfully. Jul 30 16:50:48 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b29a695a-dd37-498b-9f09-6e9f4b07cc62 tempest-VolumesTestJSON-131648578 None] Lock "cinder-1d1d888c-b61d-4dcf-bbf5-d88e476d10ca-delete_volume" released by "delete_volume" :: held 2.513s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:50:48 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-8d5eb7ca-f1d9-4694-8cec-f83eb98503ad tempest-VolumesTestJSON-131648578 None] Acquiring lock "cinder-ac9a49e5-9690-4e8c-b205-85d7fca939e0-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:50:48 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-8d5eb7ca-f1d9-4694-8cec-f83eb98503ad tempest-VolumesTestJSON-131648578 None] Lock "cinder-ac9a49e5-9690-4e8c-b205-85d7fca939e0-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:50:48 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-8d5eb7ca-f1d9-4694-8cec-f83eb98503ad tempest-VolumesTestJSON-131648578 None] Acquiring lock "cinder-quobyte-ac9a49e5-9690-4e8c-b205-85d7fca939e0" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:50:48 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-8d5eb7ca-f1d9-4694-8cec-f83eb98503ad tempest-VolumesTestJSON-131648578 None] Lock "cinder-quobyte-ac9a49e5-9690-4e8c-b205-85d7fca939e0" acquired by "delete_volume" :: waited 0.035s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:50:48 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f964d863-2a71-4851-802c-73b68b5099f2]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:50:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8d5eb7ca-f1d9-4694-8cec-f83eb98503ad tempest-VolumesTestJSON-131648578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac9a49e5-9690-4e8c-b205-85d7fca939e0 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:50:49 devstack sudo[90994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac9a49e5-9690-4e8c-b205-85d7fca939e0 Jul 30 16:50:49 devstack sudo[90994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:50:49 devstack sudo[90994]: pam_unix(sudo:session): session closed for user root Jul 30 16:50:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8d5eb7ca-f1d9-4694-8cec-f83eb98503ad tempest-VolumesTestJSON-131648578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac9a49e5-9690-4e8c-b205-85d7fca939e0" returned: 0 in 0.601s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:50:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8d5eb7ca-f1d9-4694-8cec-f83eb98503ad tempest-VolumesTestJSON-131648578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac9a49e5-9690-4e8c-b205-85d7fca939e0 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:50:49 devstack sudo[91023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac9a49e5-9690-4e8c-b205-85d7fca939e0 Jul 30 16:50:49 devstack sudo[91023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:50:49 devstack sudo[91023]: pam_unix(sudo:session): session closed for user root Jul 30 16:50:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8d5eb7ca-f1d9-4694-8cec-f83eb98503ad tempest-VolumesTestJSON-131648578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac9a49e5-9690-4e8c-b205-85d7fca939e0" returned: 0 in 0.502s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:50:50 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-8d5eb7ca-f1d9-4694-8cec-f83eb98503ad tempest-VolumesTestJSON-131648578 None] Lock "cinder-quobyte-ac9a49e5-9690-4e8c-b205-85d7fca939e0" released by "delete_volume" :: held 1.168s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:50:50 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-8d5eb7ca-f1d9-4694-8cec-f83eb98503ad tempest-VolumesTestJSON-131648578 None] Created reservations ['585e902c-7ef5-4b75-8b32-bc133ee77284', 'bb1d0ba4-cd81-4480-a74e-18b7f54e30e0', '2797bf04-696c-4a7f-a8ef-6bf4ebf9c588', 'ab4c0241-da43-4562-8462-d8a5094bb0da'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:50:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8d5eb7ca-f1d9-4694-8cec-f83eb98503ad tempest-VolumesTestJSON-131648578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:50:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8d5eb7ca-f1d9-4694-8cec-f83eb98503ad tempest-VolumesTestJSON-131648578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:50:50 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-8d5eb7ca-f1d9-4694-8cec-f83eb98503ad tempest-VolumesTestJSON-131648578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:50:50 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-8d5eb7ca-f1d9-4694-8cec-f83eb98503ad tempest-VolumesTestJSON-131648578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:50:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8d5eb7ca-f1d9-4694-8cec-f83eb98503ad tempest-VolumesTestJSON-131648578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:50:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8d5eb7ca-f1d9-4694-8cec-f83eb98503ad tempest-VolumesTestJSON-131648578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:50:50 devstack sudo[91026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:50:50 devstack sudo[91026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:50:50 devstack sudo[91026]: pam_unix(sudo:session): session closed for user root Jul 30 16:50:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8d5eb7ca-f1d9-4694-8cec-f83eb98503ad tempest-VolumesTestJSON-131648578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.478s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:50:50 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-8d5eb7ca-f1d9-4694-8cec-f83eb98503ad tempest-VolumesTestJSON-131648578 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:50:50 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-8d5eb7ca-f1d9-4694-8cec-f83eb98503ad tempest-VolumesTestJSON-131648578 None] Deleted volume successfully. Jul 30 16:50:50 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-8d5eb7ca-f1d9-4694-8cec-f83eb98503ad tempest-VolumesTestJSON-131648578 None] Lock "cinder-ac9a49e5-9690-4e8c-b205-85d7fca939e0-delete_volume" released by "delete_volume" :: held 2.070s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:51:00 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:SELECT=24,cinder:UPDATE=37,cinder:DELETE=1,cinder:INSERT=4 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:51:00 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:UPDATE=29,cinder:SELECT=18,cinder:INSERT=11,cinder:DELETE=5 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:51:01 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-b994a0fa-20f7-477b-a41a-db128b44588c tempest-AttachVolumeNegativeTest-1135644984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:51:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b994a0fa-20f7-477b-a41a-db128b44588c tempest-AttachVolumeNegativeTest-1135644984 None] Flow 'volume_create_manager' (40f45fb3-f4d2-4438-8064-3aead36cc696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:51:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b994a0fa-20f7-477b-a41a-db128b44588c tempest-AttachVolumeNegativeTest-1135644984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d04efe06-0bed-4383-865f-bdbe2e4ec072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:51:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b994a0fa-20f7-477b-a41a-db128b44588c tempest-AttachVolumeNegativeTest-1135644984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d04efe06-0bed-4383-865f-bdbe2e4ec072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:51:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-919780612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28b193d5-cea8-4ef5-8f95-6e1658bfba68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='731ad24ec4834b3aafb0fd86002127f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:51:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:51:01Z,use_quota=True,user_id='dc12f9071eda4283b96f21bc61636311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:51:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b994a0fa-20f7-477b-a41a-db128b44588c tempest-AttachVolumeNegativeTest-1135644984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b474e63e-ba8f-4c23-b389-5599f3ebf7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:51:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b994a0fa-20f7-477b-a41a-db128b44588c tempest-AttachVolumeNegativeTest-1135644984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b474e63e-ba8f-4c23-b389-5599f3ebf7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:51:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b994a0fa-20f7-477b-a41a-db128b44588c tempest-AttachVolumeNegativeTest-1135644984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (721b3994-0eab-492b-9d9b-fe71e9634b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:51:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b994a0fa-20f7-477b-a41a-db128b44588c tempest-AttachVolumeNegativeTest-1135644984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (721b3994-0eab-492b-9d9b-fe71e9634b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28b193d5-cea8-4ef5-8f95-6e1658bfba68', 'volume_name': 'volume-28b193d5-cea8-4ef5-8f95-6e1658bfba68', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:51:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b994a0fa-20f7-477b-a41a-db128b44588c tempest-AttachVolumeNegativeTest-1135644984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3f31dd3-b73d-4e6f-92de-0f900d8a60b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:51:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b994a0fa-20f7-477b-a41a-db128b44588c tempest-AttachVolumeNegativeTest-1135644984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3f31dd3-b73d-4e6f-92de-0f900d8a60b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:51:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b994a0fa-20f7-477b-a41a-db128b44588c tempest-AttachVolumeNegativeTest-1135644984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1247a436-1c31-4354-9544-743c3c367c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:51:01 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-b994a0fa-20f7-477b-a41a-db128b44588c tempest-AttachVolumeNegativeTest-1135644984 None] Volume 28b193d5-cea8-4ef5-8f95-6e1658bfba68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28b193d5-cea8-4ef5-8f95-6e1658bfba68', 'volume_size': 1} Jul 30 16:51:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b994a0fa-20f7-477b-a41a-db128b44588c tempest-AttachVolumeNegativeTest-1135644984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:51:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b994a0fa-20f7-477b-a41a-db128b44588c tempest-AttachVolumeNegativeTest-1135644984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:51:01 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b994a0fa-20f7-477b-a41a-db128b44588c tempest-AttachVolumeNegativeTest-1135644984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:51:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-919780612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28b193d5-cea8-4ef5-8f95-6e1658bfba68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='731ad24ec4834b3aafb0fd86002127f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:51:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:51:01Z,use_quota=True,user_id='dc12f9071eda4283b96f21bc61636311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:51:01 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-b994a0fa-20f7-477b-a41a-db128b44588c tempest-AttachVolumeNegativeTest-1135644984 None] Creating volume 28b193d5-cea8-4ef5-8f95-6e1658bfba68 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:51:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b994a0fa-20f7-477b-a41a-db128b44588c tempest-AttachVolumeNegativeTest-1135644984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:51:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b994a0fa-20f7-477b-a41a-db128b44588c tempest-AttachVolumeNegativeTest-1135644984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:51:01 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b994a0fa-20f7-477b-a41a-db128b44588c tempest-AttachVolumeNegativeTest-1135644984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:51:01 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b994a0fa-20f7-477b-a41a-db128b44588c tempest-AttachVolumeNegativeTest-1135644984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:51:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b994a0fa-20f7-477b-a41a-db128b44588c tempest-AttachVolumeNegativeTest-1135644984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:51:01 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b994a0fa-20f7-477b-a41a-db128b44588c tempest-AttachVolumeNegativeTest-1135644984 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:51:01 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-b994a0fa-20f7-477b-a41a-db128b44588c tempest-AttachVolumeNegativeTest-1135644984 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:51:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b994a0fa-20f7-477b-a41a-db128b44588c tempest-AttachVolumeNegativeTest-1135644984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-28b193d5-cea8-4ef5-8f95-6e1658bfba68 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:51:01 devstack sudo[91160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-28b193d5-cea8-4ef5-8f95-6e1658bfba68 1073741824 Jul 30 16:51:01 devstack sudo[91160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:51:02 devstack sudo[91160]: pam_unix(sudo:session): session closed for user root Jul 30 16:51:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b994a0fa-20f7-477b-a41a-db128b44588c tempest-AttachVolumeNegativeTest-1135644984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-28b193d5-cea8-4ef5-8f95-6e1658bfba68 1073741824" returned: 0 in 0.597s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:51:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b994a0fa-20f7-477b-a41a-db128b44588c tempest-AttachVolumeNegativeTest-1135644984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-28b193d5-cea8-4ef5-8f95-6e1658bfba68 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:51:02 devstack sudo[91166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-28b193d5-cea8-4ef5-8f95-6e1658bfba68 Jul 30 16:51:02 devstack sudo[91166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:51:02 devstack sudo[91166]: pam_unix(sudo:session): session closed for user root Jul 30 16:51:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b994a0fa-20f7-477b-a41a-db128b44588c tempest-AttachVolumeNegativeTest-1135644984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-28b193d5-cea8-4ef5-8f95-6e1658bfba68" returned: 0 in 0.364s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:51:02 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b994a0fa-20f7-477b-a41a-db128b44588c tempest-AttachVolumeNegativeTest-1135644984 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:51:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b994a0fa-20f7-477b-a41a-db128b44588c tempest-AttachVolumeNegativeTest-1135644984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:51:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b994a0fa-20f7-477b-a41a-db128b44588c tempest-AttachVolumeNegativeTest-1135644984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1247a436-1c31-4354-9544-743c3c367c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28b193d5-cea8-4ef5-8f95-6e1658bfba68', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:51:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b994a0fa-20f7-477b-a41a-db128b44588c tempest-AttachVolumeNegativeTest-1135644984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa66ed32-332c-4683-8cd4-404fdb2b851c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:51:02 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-b994a0fa-20f7-477b-a41a-db128b44588c tempest-AttachVolumeNegativeTest-1135644984 None] Volume volume-28b193d5-cea8-4ef5-8f95-6e1658bfba68 (28b193d5-cea8-4ef5-8f95-6e1658bfba68): created successfully Jul 30 16:51:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b994a0fa-20f7-477b-a41a-db128b44588c tempest-AttachVolumeNegativeTest-1135644984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa66ed32-332c-4683-8cd4-404fdb2b851c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:51:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b994a0fa-20f7-477b-a41a-db128b44588c tempest-AttachVolumeNegativeTest-1135644984 None] Flow 'volume_create_manager' (40f45fb3-f4d2-4438-8064-3aead36cc696) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:51:02 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-b994a0fa-20f7-477b-a41a-db128b44588c tempest-AttachVolumeNegativeTest-1135644984 None] Created volume successfully. Jul 30 16:51:03 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-655859d4-aeeb-46bf-af09-db49ac03a497 tempest-GroupsV320Test-1377316048 None] Group tempest-GroupsV320Test-Group-1158335042: creating Jul 30 16:51:03 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-655859d4-aeeb-46bf-af09-db49ac03a497 tempest-GroupsV320Test-1377316048 None] Group tempest-GroupsV320Test-Group-1158335042: created successfully Jul 30 16:51:03 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-655859d4-aeeb-46bf-af09-db49ac03a497 tempest-GroupsV320Test-1377316048 None] Create group completed successfully. Jul 30 16:51:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-a5b647a5-5ae1-45eb-8e60-bc0303212fed req-3ff64cc6-e3a8-496e-bbe4-3463e964df71 tempest-AttachVolumeNegativeTest-1135644984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:51:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-a5b647a5-5ae1-45eb-8e60-bc0303212fed req-3ff64cc6-e3a8-496e-bbe4-3463e964df71 tempest-AttachVolumeNegativeTest-1135644984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:51:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-a5b647a5-5ae1-45eb-8e60-bc0303212fed req-3ff64cc6-e3a8-496e-bbe4-3463e964df71 tempest-AttachVolumeNegativeTest-1135644984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:51:04 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-a5b647a5-5ae1-45eb-8e60-bc0303212fed req-3ff64cc6-e3a8-496e-bbe4-3463e964df71 tempest-AttachVolumeNegativeTest-1135644984 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202', 'name': 'volume-28b193d5-cea8-4ef5-8f95-6e1658bfba68', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '889901a7-c9e9-4467-a8aa-1f41de2f3c96', 'enforce_multipath': True} {{(pid=88591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:51:04 devstack cinder-volume[88591]: INFO cinder.volume.manager [req-a5b647a5-5ae1-45eb-8e60-bc0303212fed req-3ff64cc6-e3a8-496e-bbe4-3463e964df71 tempest-AttachVolumeNegativeTest-1135644984 None] attachment_update completed successfully. Jul 30 16:51:06 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-695834b9-2db6-492c-a3e1-77b6f7d2f74e tempest-GroupsV320Test-1377316048 None] Created reservations ['b6352f11-b7dd-4b16-a15a-497e12483e8c'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:51:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-695834b9-2db6-492c-a3e1-77b6f7d2f74e tempest-GroupsV320Test-1377316048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:51:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-695834b9-2db6-492c-a3e1-77b6f7d2f74e tempest-GroupsV320Test-1377316048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:51:06 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-695834b9-2db6-492c-a3e1-77b6f7d2f74e tempest-GroupsV320Test-1377316048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:51:06 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-695834b9-2db6-492c-a3e1-77b6f7d2f74e tempest-GroupsV320Test-1377316048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:51:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-695834b9-2db6-492c-a3e1-77b6f7d2f74e tempest-GroupsV320Test-1377316048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:51:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-695834b9-2db6-492c-a3e1-77b6f7d2f74e tempest-GroupsV320Test-1377316048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:51:06 devstack sudo[91582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:51:06 devstack sudo[91582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:51:06 devstack sudo[91582]: pam_unix(sudo:session): session closed for user root Jul 30 16:51:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-695834b9-2db6-492c-a3e1-77b6f7d2f74e tempest-GroupsV320Test-1377316048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.415s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:51:06 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-695834b9-2db6-492c-a3e1-77b6f7d2f74e tempest-GroupsV320Test-1377316048 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:51:06 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-695834b9-2db6-492c-a3e1-77b6f7d2f74e tempest-GroupsV320Test-1377316048 None] Delete group completed successfully. Jul 30 16:51:12 devstack cinder-volume[88591]: DEBUG oslo_service.periodic_task [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:51:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:51:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:51:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:51:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:51:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:51:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:51:12 devstack sudo[91619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:51:12 devstack sudo[91619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:51:13 devstack sudo[91619]: pam_unix(sudo:session): session closed for user root Jul 30 16:51:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.569s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:51:13 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:51:13 devstack cinder-volume[88591]: DEBUG oslo_service.periodic_task [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running periodic task VolumeManager._thread_info {{(pid=88591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:51:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] thread count: 8 {{(pid=88591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:51:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] thread info: [<_MainThread(MainThread, started 140677178003584)>, , , , , , , ] {{(pid=88591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:51:16 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:UPDATE=7,cinder:SELECT=16 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:51:16 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:SELECT=14,cinder:UPDATE=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:51:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-9a936645-a834-40a5-a4d6-55eaf7a54e87 req-86b957aa-ff95-4311-bfc1-1cf39c3c397a tempest-TaggedAttachmentsTest-1743215712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:51:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-9a936645-a834-40a5-a4d6-55eaf7a54e87 req-86b957aa-ff95-4311-bfc1-1cf39c3c397a tempest-TaggedAttachmentsTest-1743215712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:51:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-9a936645-a834-40a5-a4d6-55eaf7a54e87 req-86b957aa-ff95-4311-bfc1-1cf39c3c397a tempest-TaggedAttachmentsTest-1743215712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:51:19 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-9a936645-a834-40a5-a4d6-55eaf7a54e87 req-86b957aa-ff95-4311-bfc1-1cf39c3c397a tempest-TaggedAttachmentsTest-1743215712 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202', 'name': 'volume-40a65094-4b4d-45ed-911c-fbac796076dd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5a3c97e0-6934-4b67-aa71-df278bb13fe3', 'enforce_multipath': True} {{(pid=88591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:51:19 devstack cinder-volume[88591]: INFO cinder.volume.manager [req-9a936645-a834-40a5-a4d6-55eaf7a54e87 req-86b957aa-ff95-4311-bfc1-1cf39c3c397a tempest-TaggedAttachmentsTest-1743215712 None] attachment_update completed successfully. Jul 30 16:51:24 devstack cinder-volume[88591]: INFO cinder.volume.manager [req-4fa41150-ab64-4f4b-88df-dd921b6f39f1 req-10da303f-056a-4a82-b41e-492aa45e9f4d tempest-TaggedAttachmentsTest-1743215712 None] Terminate volume connection completed successfully. Jul 30 16:51:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-4fa41150-ab64-4f4b-88df-dd921b6f39f1 req-10da303f-056a-4a82-b41e-492aa45e9f4d tempest-TaggedAttachmentsTest-1743215712 None] Deleting attachment 5a3c97e0-6934-4b67-aa71-df278bb13fe3. {{(pid=88591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:51:25 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b15bbf1-0068-401f-b377-4bce75311edb tempest-ServersNegativeTestJSON-1887235908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:51:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3b15bbf1-0068-401f-b377-4bce75311edb tempest-ServersNegativeTestJSON-1887235908 None] Flow 'volume_create_manager' (d6c1ca8e-d39f-44f2-8460-7aefbcc5d7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:51:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3b15bbf1-0068-401f-b377-4bce75311edb tempest-ServersNegativeTestJSON-1887235908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e752cef-f6f7-4be9-9d1c-3f2291f47cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:51:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3b15bbf1-0068-401f-b377-4bce75311edb tempest-ServersNegativeTestJSON-1887235908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e752cef-f6f7-4be9-9d1c-3f2291f47cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:51:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1684871137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42106a23-b2d3-4f33-a703-27d3e431e3c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e1b59ba00594a8194db29b1447b6cea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:51:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:51:25Z,use_quota=True,user_id='e83f7d5c1fee4303bbd07ada3625cdbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:51:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3b15bbf1-0068-401f-b377-4bce75311edb tempest-ServersNegativeTestJSON-1887235908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77838b90-7733-4407-8a38-804bd0573055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:51:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3b15bbf1-0068-401f-b377-4bce75311edb tempest-ServersNegativeTestJSON-1887235908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77838b90-7733-4407-8a38-804bd0573055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:51:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3b15bbf1-0068-401f-b377-4bce75311edb tempest-ServersNegativeTestJSON-1887235908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c6d579a-6c2b-4fe9-86ba-7e311b13a8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:51:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3b15bbf1-0068-401f-b377-4bce75311edb tempest-ServersNegativeTestJSON-1887235908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c6d579a-6c2b-4fe9-86ba-7e311b13a8d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42106a23-b2d3-4f33-a703-27d3e431e3c0', 'volume_name': 'volume-42106a23-b2d3-4f33-a703-27d3e431e3c0', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:51:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3b15bbf1-0068-401f-b377-4bce75311edb tempest-ServersNegativeTestJSON-1887235908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (407d8491-5c0f-45b4-9f1e-80ee526c1c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:51:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3b15bbf1-0068-401f-b377-4bce75311edb tempest-ServersNegativeTestJSON-1887235908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (407d8491-5c0f-45b4-9f1e-80ee526c1c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:51:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3b15bbf1-0068-401f-b377-4bce75311edb tempest-ServersNegativeTestJSON-1887235908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c465d3a-5423-4fd1-9cc1-548ee0068e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:51:25 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-3b15bbf1-0068-401f-b377-4bce75311edb tempest-ServersNegativeTestJSON-1887235908 None] Volume 42106a23-b2d3-4f33-a703-27d3e431e3c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42106a23-b2d3-4f33-a703-27d3e431e3c0', 'volume_size': 1} Jul 30 16:51:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3b15bbf1-0068-401f-b377-4bce75311edb tempest-ServersNegativeTestJSON-1887235908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:51:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3b15bbf1-0068-401f-b377-4bce75311edb tempest-ServersNegativeTestJSON-1887235908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:51:25 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-3b15bbf1-0068-401f-b377-4bce75311edb tempest-ServersNegativeTestJSON-1887235908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:51:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1684871137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42106a23-b2d3-4f33-a703-27d3e431e3c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e1b59ba00594a8194db29b1447b6cea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:51:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:51:25Z,use_quota=True,user_id='e83f7d5c1fee4303bbd07ada3625cdbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:51:25 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-3b15bbf1-0068-401f-b377-4bce75311edb tempest-ServersNegativeTestJSON-1887235908 None] Creating volume 42106a23-b2d3-4f33-a703-27d3e431e3c0 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:51:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3b15bbf1-0068-401f-b377-4bce75311edb tempest-ServersNegativeTestJSON-1887235908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:51:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3b15bbf1-0068-401f-b377-4bce75311edb tempest-ServersNegativeTestJSON-1887235908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:51:25 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-3b15bbf1-0068-401f-b377-4bce75311edb tempest-ServersNegativeTestJSON-1887235908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:51:25 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-3b15bbf1-0068-401f-b377-4bce75311edb tempest-ServersNegativeTestJSON-1887235908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:51:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3b15bbf1-0068-401f-b377-4bce75311edb tempest-ServersNegativeTestJSON-1887235908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:51:25 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-3b15bbf1-0068-401f-b377-4bce75311edb tempest-ServersNegativeTestJSON-1887235908 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:51:25 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-3b15bbf1-0068-401f-b377-4bce75311edb tempest-ServersNegativeTestJSON-1887235908 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:51:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3b15bbf1-0068-401f-b377-4bce75311edb tempest-ServersNegativeTestJSON-1887235908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-42106a23-b2d3-4f33-a703-27d3e431e3c0 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:51:25 devstack sudo[91936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-42106a23-b2d3-4f33-a703-27d3e431e3c0 1073741824 Jul 30 16:51:25 devstack sudo[91936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:51:26 devstack sudo[91936]: pam_unix(sudo:session): session closed for user root Jul 30 16:51:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3b15bbf1-0068-401f-b377-4bce75311edb tempest-ServersNegativeTestJSON-1887235908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-42106a23-b2d3-4f33-a703-27d3e431e3c0 1073741824" returned: 0 in 0.796s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:51:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3b15bbf1-0068-401f-b377-4bce75311edb tempest-ServersNegativeTestJSON-1887235908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-42106a23-b2d3-4f33-a703-27d3e431e3c0 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:51:26 devstack sudo[91952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-42106a23-b2d3-4f33-a703-27d3e431e3c0 Jul 30 16:51:26 devstack sudo[91952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:51:26 devstack sudo[91952]: pam_unix(sudo:session): session closed for user root Jul 30 16:51:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3b15bbf1-0068-401f-b377-4bce75311edb tempest-ServersNegativeTestJSON-1887235908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-42106a23-b2d3-4f33-a703-27d3e431e3c0" returned: 0 in 0.508s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:51:26 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-3b15bbf1-0068-401f-b377-4bce75311edb tempest-ServersNegativeTestJSON-1887235908 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:51:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3b15bbf1-0068-401f-b377-4bce75311edb tempest-ServersNegativeTestJSON-1887235908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:51:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3b15bbf1-0068-401f-b377-4bce75311edb tempest-ServersNegativeTestJSON-1887235908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c465d3a-5423-4fd1-9cc1-548ee0068e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42106a23-b2d3-4f33-a703-27d3e431e3c0', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:51:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3b15bbf1-0068-401f-b377-4bce75311edb tempest-ServersNegativeTestJSON-1887235908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f279847c-d802-4eca-ad24-4faf0f476503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:51:26 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-3b15bbf1-0068-401f-b377-4bce75311edb tempest-ServersNegativeTestJSON-1887235908 None] Volume volume-42106a23-b2d3-4f33-a703-27d3e431e3c0 (42106a23-b2d3-4f33-a703-27d3e431e3c0): created successfully Jul 30 16:51:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3b15bbf1-0068-401f-b377-4bce75311edb tempest-ServersNegativeTestJSON-1887235908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f279847c-d802-4eca-ad24-4faf0f476503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:51:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3b15bbf1-0068-401f-b377-4bce75311edb tempest-ServersNegativeTestJSON-1887235908 None] Flow 'volume_create_manager' (d6c1ca8e-d39f-44f2-8460-7aefbcc5d7a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:51:26 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-3b15bbf1-0068-401f-b377-4bce75311edb tempest-ServersNegativeTestJSON-1887235908 None] Created volume successfully. Jul 30 16:51:30 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-df4b4b98-1a8c-48d7-b535-02dbb1475cde tempest-ServersNegativeTestJSON-1887235908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:51:30 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-df4b4b98-1a8c-48d7-b535-02dbb1475cde tempest-ServersNegativeTestJSON-1887235908 None] Flow 'volume_create_manager' (9fbc794d-e450-4410-bc2a-0f93d8b40b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:51:30 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-df4b4b98-1a8c-48d7-b535-02dbb1475cde tempest-ServersNegativeTestJSON-1887235908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b76ac48e-b58b-4721-8bb3-c13192243e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:51:30 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-df4b4b98-1a8c-48d7-b535-02dbb1475cde tempest-ServersNegativeTestJSON-1887235908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b76ac48e-b58b-4721-8bb3-c13192243e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1961653904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40448fd1-6fb4-4b74-980d-791e1bb542eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e1b59ba00594a8194db29b1447b6cea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:51:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:51:30Z,use_quota=True,user_id='e83f7d5c1fee4303bbd07ada3625cdbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:51:30 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-df4b4b98-1a8c-48d7-b535-02dbb1475cde tempest-ServersNegativeTestJSON-1887235908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fd95977-b748-45c6-b16e-f28c68b6848e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:51:30 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-df4b4b98-1a8c-48d7-b535-02dbb1475cde tempest-ServersNegativeTestJSON-1887235908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fd95977-b748-45c6-b16e-f28c68b6848e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:51:30 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-df4b4b98-1a8c-48d7-b535-02dbb1475cde tempest-ServersNegativeTestJSON-1887235908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6405341-2c09-4e54-a0b7-c543e2434c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:51:30 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-df4b4b98-1a8c-48d7-b535-02dbb1475cde tempest-ServersNegativeTestJSON-1887235908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6405341-2c09-4e54-a0b7-c543e2434c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40448fd1-6fb4-4b74-980d-791e1bb542eb', 'volume_name': 'volume-40448fd1-6fb4-4b74-980d-791e1bb542eb', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:51:30 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-df4b4b98-1a8c-48d7-b535-02dbb1475cde tempest-ServersNegativeTestJSON-1887235908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd35d21a-dca7-422c-a404-3611f70edd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:51:30 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-df4b4b98-1a8c-48d7-b535-02dbb1475cde tempest-ServersNegativeTestJSON-1887235908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd35d21a-dca7-422c-a404-3611f70edd03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:51:30 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-df4b4b98-1a8c-48d7-b535-02dbb1475cde tempest-ServersNegativeTestJSON-1887235908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65c9c899-ec7d-4025-a751-7d4d2d3e9d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:51:30 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-df4b4b98-1a8c-48d7-b535-02dbb1475cde tempest-ServersNegativeTestJSON-1887235908 None] Volume 40448fd1-6fb4-4b74-980d-791e1bb542eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40448fd1-6fb4-4b74-980d-791e1bb542eb', 'volume_size': 1} Jul 30 16:51:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-df4b4b98-1a8c-48d7-b535-02dbb1475cde tempest-ServersNegativeTestJSON-1887235908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:51:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-df4b4b98-1a8c-48d7-b535-02dbb1475cde tempest-ServersNegativeTestJSON-1887235908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:51:30 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-df4b4b98-1a8c-48d7-b535-02dbb1475cde tempest-ServersNegativeTestJSON-1887235908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1961653904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40448fd1-6fb4-4b74-980d-791e1bb542eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e1b59ba00594a8194db29b1447b6cea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:51:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:51:30Z,use_quota=True,user_id='e83f7d5c1fee4303bbd07ada3625cdbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:51:30 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-df4b4b98-1a8c-48d7-b535-02dbb1475cde tempest-ServersNegativeTestJSON-1887235908 None] Creating volume 40448fd1-6fb4-4b74-980d-791e1bb542eb {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:51:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-df4b4b98-1a8c-48d7-b535-02dbb1475cde tempest-ServersNegativeTestJSON-1887235908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:51:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-df4b4b98-1a8c-48d7-b535-02dbb1475cde tempest-ServersNegativeTestJSON-1887235908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:51:30 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-df4b4b98-1a8c-48d7-b535-02dbb1475cde tempest-ServersNegativeTestJSON-1887235908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:51:30 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-df4b4b98-1a8c-48d7-b535-02dbb1475cde tempest-ServersNegativeTestJSON-1887235908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:51:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-df4b4b98-1a8c-48d7-b535-02dbb1475cde tempest-ServersNegativeTestJSON-1887235908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:51:30 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-df4b4b98-1a8c-48d7-b535-02dbb1475cde tempest-ServersNegativeTestJSON-1887235908 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:51:30 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-df4b4b98-1a8c-48d7-b535-02dbb1475cde tempest-ServersNegativeTestJSON-1887235908 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:51:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-df4b4b98-1a8c-48d7-b535-02dbb1475cde tempest-ServersNegativeTestJSON-1887235908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-40448fd1-6fb4-4b74-980d-791e1bb542eb 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:51:30 devstack sudo[91970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-40448fd1-6fb4-4b74-980d-791e1bb542eb 1073741824 Jul 30 16:51:30 devstack sudo[91970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:51:30 devstack sudo[91970]: pam_unix(sudo:session): session closed for user root Jul 30 16:51:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-df4b4b98-1a8c-48d7-b535-02dbb1475cde tempest-ServersNegativeTestJSON-1887235908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-40448fd1-6fb4-4b74-980d-791e1bb542eb 1073741824" returned: 0 in 0.728s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:51:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-df4b4b98-1a8c-48d7-b535-02dbb1475cde tempest-ServersNegativeTestJSON-1887235908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-40448fd1-6fb4-4b74-980d-791e1bb542eb {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:51:31 devstack sudo[91978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-40448fd1-6fb4-4b74-980d-791e1bb542eb Jul 30 16:51:31 devstack sudo[91978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:51:31 devstack sudo[91978]: pam_unix(sudo:session): session closed for user root Jul 30 16:51:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-df4b4b98-1a8c-48d7-b535-02dbb1475cde tempest-ServersNegativeTestJSON-1887235908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-40448fd1-6fb4-4b74-980d-791e1bb542eb" returned: 0 in 0.454s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:51:31 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-df4b4b98-1a8c-48d7-b535-02dbb1475cde tempest-ServersNegativeTestJSON-1887235908 None] <== create_volume: return (1295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:51:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-df4b4b98-1a8c-48d7-b535-02dbb1475cde tempest-ServersNegativeTestJSON-1887235908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.298s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:51:31 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-df4b4b98-1a8c-48d7-b535-02dbb1475cde tempest-ServersNegativeTestJSON-1887235908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65c9c899-ec7d-4025-a751-7d4d2d3e9d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40448fd1-6fb4-4b74-980d-791e1bb542eb', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:51:31 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-df4b4b98-1a8c-48d7-b535-02dbb1475cde tempest-ServersNegativeTestJSON-1887235908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b28291e2-647a-40a0-ae72-43c46b8e5e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:51:31 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-df4b4b98-1a8c-48d7-b535-02dbb1475cde tempest-ServersNegativeTestJSON-1887235908 None] Volume volume-40448fd1-6fb4-4b74-980d-791e1bb542eb (40448fd1-6fb4-4b74-980d-791e1bb542eb): created successfully Jul 30 16:51:31 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-df4b4b98-1a8c-48d7-b535-02dbb1475cde tempest-ServersNegativeTestJSON-1887235908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b28291e2-647a-40a0-ae72-43c46b8e5e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:51:31 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-df4b4b98-1a8c-48d7-b535-02dbb1475cde tempest-ServersNegativeTestJSON-1887235908 None] Flow 'volume_create_manager' (9fbc794d-e450-4410-bc2a-0f93d8b40b3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:51:31 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-df4b4b98-1a8c-48d7-b535-02dbb1475cde tempest-ServersNegativeTestJSON-1887235908 None] Created volume successfully. Jul 30 16:51:34 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c7e2f665-f4a4-47d1-87b7-53b1a4a16ccd tempest-ServersNegativeTestJSON-1887235908 None] Acquiring lock "cinder-40448fd1-6fb4-4b74-980d-791e1bb542eb-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:51:34 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c7e2f665-f4a4-47d1-87b7-53b1a4a16ccd tempest-ServersNegativeTestJSON-1887235908 None] Lock "cinder-40448fd1-6fb4-4b74-980d-791e1bb542eb-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:51:34 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c7e2f665-f4a4-47d1-87b7-53b1a4a16ccd tempest-ServersNegativeTestJSON-1887235908 None] Acquiring lock "cinder-quobyte-40448fd1-6fb4-4b74-980d-791e1bb542eb" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:51:34 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c7e2f665-f4a4-47d1-87b7-53b1a4a16ccd tempest-ServersNegativeTestJSON-1887235908 None] Lock "cinder-quobyte-40448fd1-6fb4-4b74-980d-791e1bb542eb" acquired by "delete_volume" :: waited 0.026s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:51:34 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[729839ea-764d-4401-8612-9ba74089b93f]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:51:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c7e2f665-f4a4-47d1-87b7-53b1a4a16ccd tempest-ServersNegativeTestJSON-1887235908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-40448fd1-6fb4-4b74-980d-791e1bb542eb {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:51:34 devstack sudo[92013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-40448fd1-6fb4-4b74-980d-791e1bb542eb Jul 30 16:51:34 devstack sudo[92013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:51:35 devstack sudo[92013]: pam_unix(sudo:session): session closed for user root Jul 30 16:51:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c7e2f665-f4a4-47d1-87b7-53b1a4a16ccd tempest-ServersNegativeTestJSON-1887235908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-40448fd1-6fb4-4b74-980d-791e1bb542eb" returned: 0 in 0.549s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:51:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c7e2f665-f4a4-47d1-87b7-53b1a4a16ccd tempest-ServersNegativeTestJSON-1887235908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-40448fd1-6fb4-4b74-980d-791e1bb542eb {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:51:35 devstack sudo[92019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-40448fd1-6fb4-4b74-980d-791e1bb542eb Jul 30 16:51:35 devstack sudo[92019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:51:35 devstack sudo[92019]: pam_unix(sudo:session): session closed for user root Jul 30 16:51:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c7e2f665-f4a4-47d1-87b7-53b1a4a16ccd tempest-ServersNegativeTestJSON-1887235908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-40448fd1-6fb4-4b74-980d-791e1bb542eb" returned: 0 in 0.628s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:51:35 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c7e2f665-f4a4-47d1-87b7-53b1a4a16ccd tempest-ServersNegativeTestJSON-1887235908 None] Lock "cinder-quobyte-40448fd1-6fb4-4b74-980d-791e1bb542eb" released by "delete_volume" :: held 1.245s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:51:35 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-c7e2f665-f4a4-47d1-87b7-53b1a4a16ccd tempest-ServersNegativeTestJSON-1887235908 None] Created reservations ['4f3d49ba-ceda-4274-a44e-d6d322f8fdf2', 'a874e4cd-4497-4e90-a450-1ea5d51edcf5', '089be856-25b9-4bb2-afd1-fce55691826d', '8df59c95-c35c-449b-9062-69c3c3b7c371'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:51:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c7e2f665-f4a4-47d1-87b7-53b1a4a16ccd tempest-ServersNegativeTestJSON-1887235908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:51:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c7e2f665-f4a4-47d1-87b7-53b1a4a16ccd tempest-ServersNegativeTestJSON-1887235908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:51:35 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-c7e2f665-f4a4-47d1-87b7-53b1a4a16ccd tempest-ServersNegativeTestJSON-1887235908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:51:35 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-c7e2f665-f4a4-47d1-87b7-53b1a4a16ccd tempest-ServersNegativeTestJSON-1887235908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:51:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c7e2f665-f4a4-47d1-87b7-53b1a4a16ccd tempest-ServersNegativeTestJSON-1887235908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:51:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c7e2f665-f4a4-47d1-87b7-53b1a4a16ccd tempest-ServersNegativeTestJSON-1887235908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:51:35 devstack sudo[92022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:51:35 devstack sudo[92022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:51:36 devstack sudo[92022]: pam_unix(sudo:session): session closed for user root Jul 30 16:51:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c7e2f665-f4a4-47d1-87b7-53b1a4a16ccd tempest-ServersNegativeTestJSON-1887235908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.309s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:51:36 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-c7e2f665-f4a4-47d1-87b7-53b1a4a16ccd tempest-ServersNegativeTestJSON-1887235908 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:51:36 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-c7e2f665-f4a4-47d1-87b7-53b1a4a16ccd tempest-ServersNegativeTestJSON-1887235908 None] Deleted volume successfully. Jul 30 16:51:36 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c7e2f665-f4a4-47d1-87b7-53b1a4a16ccd tempest-ServersNegativeTestJSON-1887235908 None] Lock "cinder-40448fd1-6fb4-4b74-980d-791e1bb542eb-delete_volume" released by "delete_volume" :: held 1.905s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:51:36 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-3bf834ed-3759-4526-8d9f-6a0cfce8492c tempest-ServersNegativeTestJSON-1887235908 None] Acquiring lock "cinder-42106a23-b2d3-4f33-a703-27d3e431e3c0-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:51:36 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-3bf834ed-3759-4526-8d9f-6a0cfce8492c tempest-ServersNegativeTestJSON-1887235908 None] Lock "cinder-42106a23-b2d3-4f33-a703-27d3e431e3c0-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:51:36 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-3bf834ed-3759-4526-8d9f-6a0cfce8492c tempest-ServersNegativeTestJSON-1887235908 None] Acquiring lock "cinder-quobyte-42106a23-b2d3-4f33-a703-27d3e431e3c0" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:51:36 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-3bf834ed-3759-4526-8d9f-6a0cfce8492c tempest-ServersNegativeTestJSON-1887235908 None] Lock "cinder-quobyte-42106a23-b2d3-4f33-a703-27d3e431e3c0" acquired by "delete_volume" :: waited 0.024s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:51:36 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd27b91-eecb-4beb-8b5d-b3e5bdf9056b]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:51:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3bf834ed-3759-4526-8d9f-6a0cfce8492c tempest-ServersNegativeTestJSON-1887235908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-42106a23-b2d3-4f33-a703-27d3e431e3c0 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:51:36 devstack sudo[92025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-42106a23-b2d3-4f33-a703-27d3e431e3c0 Jul 30 16:51:36 devstack sudo[92025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:51:37 devstack sudo[92025]: pam_unix(sudo:session): session closed for user root Jul 30 16:51:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3bf834ed-3759-4526-8d9f-6a0cfce8492c tempest-ServersNegativeTestJSON-1887235908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-42106a23-b2d3-4f33-a703-27d3e431e3c0" returned: 0 in 0.447s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:51:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3bf834ed-3759-4526-8d9f-6a0cfce8492c tempest-ServersNegativeTestJSON-1887235908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-42106a23-b2d3-4f33-a703-27d3e431e3c0 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:51:37 devstack sudo[92031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-42106a23-b2d3-4f33-a703-27d3e431e3c0 Jul 30 16:51:37 devstack sudo[92031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:51:37 devstack sudo[92031]: pam_unix(sudo:session): session closed for user root Jul 30 16:51:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3bf834ed-3759-4526-8d9f-6a0cfce8492c tempest-ServersNegativeTestJSON-1887235908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-42106a23-b2d3-4f33-a703-27d3e431e3c0" returned: 0 in 0.457s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:51:37 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-3bf834ed-3759-4526-8d9f-6a0cfce8492c tempest-ServersNegativeTestJSON-1887235908 None] Lock "cinder-quobyte-42106a23-b2d3-4f33-a703-27d3e431e3c0" released by "delete_volume" :: held 0.992s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:51:37 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-3bf834ed-3759-4526-8d9f-6a0cfce8492c tempest-ServersNegativeTestJSON-1887235908 None] Created reservations ['191436c3-c1d3-403b-9554-e68beaa450ca', 'e8986976-3a0b-4e0d-bac4-3944b6a92118', 'cb3551fa-5db6-4b37-930e-3c36a5230adc', 'c12a7318-6a2e-4ae7-bd61-7df1bbed928f'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:51:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3bf834ed-3759-4526-8d9f-6a0cfce8492c tempest-ServersNegativeTestJSON-1887235908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:51:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3bf834ed-3759-4526-8d9f-6a0cfce8492c tempest-ServersNegativeTestJSON-1887235908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:51:38 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-3bf834ed-3759-4526-8d9f-6a0cfce8492c tempest-ServersNegativeTestJSON-1887235908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:51:38 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-3bf834ed-3759-4526-8d9f-6a0cfce8492c tempest-ServersNegativeTestJSON-1887235908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:51:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3bf834ed-3759-4526-8d9f-6a0cfce8492c tempest-ServersNegativeTestJSON-1887235908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:51:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3bf834ed-3759-4526-8d9f-6a0cfce8492c tempest-ServersNegativeTestJSON-1887235908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:51:38 devstack sudo[92069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:51:38 devstack sudo[92069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:51:38 devstack sudo[92069]: pam_unix(sudo:session): session closed for user root Jul 30 16:51:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3bf834ed-3759-4526-8d9f-6a0cfce8492c tempest-ServersNegativeTestJSON-1887235908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.352s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:51:38 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-3bf834ed-3759-4526-8d9f-6a0cfce8492c tempest-ServersNegativeTestJSON-1887235908 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:51:38 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-3bf834ed-3759-4526-8d9f-6a0cfce8492c tempest-ServersNegativeTestJSON-1887235908 None] Deleted volume successfully. Jul 30 16:51:38 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-34c81976-c242-460f-aca4-aef0bf849627 tempest-TaggedAttachmentsTest-1743215712 None] Acquiring lock "cinder-40a65094-4b4d-45ed-911c-fbac796076dd-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:51:38 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-3bf834ed-3759-4526-8d9f-6a0cfce8492c tempest-ServersNegativeTestJSON-1887235908 None] Lock "cinder-42106a23-b2d3-4f33-a703-27d3e431e3c0-delete_volume" released by "delete_volume" :: held 1.841s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:51:38 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-34c81976-c242-460f-aca4-aef0bf849627 tempest-TaggedAttachmentsTest-1743215712 None] Lock "cinder-40a65094-4b4d-45ed-911c-fbac796076dd-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:51:38 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-34c81976-c242-460f-aca4-aef0bf849627 tempest-TaggedAttachmentsTest-1743215712 None] Acquiring lock "cinder-quobyte-40a65094-4b4d-45ed-911c-fbac796076dd" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:51:38 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-34c81976-c242-460f-aca4-aef0bf849627 tempest-TaggedAttachmentsTest-1743215712 None] Lock "cinder-quobyte-40a65094-4b4d-45ed-911c-fbac796076dd" acquired by "delete_volume" :: waited 0.021s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:51:38 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c96be2-ccb4-40aa-b3b1-42d86bb119a7]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:51:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34c81976-c242-460f-aca4-aef0bf849627 tempest-TaggedAttachmentsTest-1743215712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-40a65094-4b4d-45ed-911c-fbac796076dd {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:51:38 devstack sudo[92074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-40a65094-4b4d-45ed-911c-fbac796076dd Jul 30 16:51:38 devstack sudo[92074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:51:39 devstack sudo[92074]: pam_unix(sudo:session): session closed for user root Jul 30 16:51:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34c81976-c242-460f-aca4-aef0bf849627 tempest-TaggedAttachmentsTest-1743215712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-40a65094-4b4d-45ed-911c-fbac796076dd" returned: 0 in 0.526s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:51:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34c81976-c242-460f-aca4-aef0bf849627 tempest-TaggedAttachmentsTest-1743215712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-40a65094-4b4d-45ed-911c-fbac796076dd {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:51:39 devstack sudo[92079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-40a65094-4b4d-45ed-911c-fbac796076dd Jul 30 16:51:39 devstack sudo[92079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:51:39 devstack sudo[92079]: pam_unix(sudo:session): session closed for user root Jul 30 16:51:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34c81976-c242-460f-aca4-aef0bf849627 tempest-TaggedAttachmentsTest-1743215712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-40a65094-4b4d-45ed-911c-fbac796076dd" returned: 0 in 0.472s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:51:39 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-34c81976-c242-460f-aca4-aef0bf849627 tempest-TaggedAttachmentsTest-1743215712 None] Lock "cinder-quobyte-40a65094-4b4d-45ed-911c-fbac796076dd" released by "delete_volume" :: held 1.075s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:51:39 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-34c81976-c242-460f-aca4-aef0bf849627 tempest-TaggedAttachmentsTest-1743215712 None] Created reservations ['5933c7c7-9ab4-41be-834f-3b2b8f122b17', '085308ea-98c2-4e66-872e-4e7cdf022c08', '4d74e524-61c8-42b0-92e3-937c2bce6c76', '66b86b69-14d0-4b7d-b383-340dd8aa8a5f'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:51:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34c81976-c242-460f-aca4-aef0bf849627 tempest-TaggedAttachmentsTest-1743215712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:51:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34c81976-c242-460f-aca4-aef0bf849627 tempest-TaggedAttachmentsTest-1743215712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:51:40 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-34c81976-c242-460f-aca4-aef0bf849627 tempest-TaggedAttachmentsTest-1743215712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:51:40 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-34c81976-c242-460f-aca4-aef0bf849627 tempest-TaggedAttachmentsTest-1743215712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:51:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34c81976-c242-460f-aca4-aef0bf849627 tempest-TaggedAttachmentsTest-1743215712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.060s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:51:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34c81976-c242-460f-aca4-aef0bf849627 tempest-TaggedAttachmentsTest-1743215712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:51:40 devstack sudo[92122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:51:40 devstack sudo[92122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:51:40 devstack sudo[92122]: pam_unix(sudo:session): session closed for user root Jul 30 16:51:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34c81976-c242-460f-aca4-aef0bf849627 tempest-TaggedAttachmentsTest-1743215712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.458s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:51:40 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-34c81976-c242-460f-aca4-aef0bf849627 tempest-TaggedAttachmentsTest-1743215712 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:51:40 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-34c81976-c242-460f-aca4-aef0bf849627 tempest-TaggedAttachmentsTest-1743215712 None] Deleted volume successfully. Jul 30 16:51:40 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-34c81976-c242-460f-aca4-aef0bf849627 tempest-TaggedAttachmentsTest-1743215712 None] Lock "cinder-40a65094-4b4d-45ed-911c-fbac796076dd-delete_volume" released by "delete_volume" :: held 2.015s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:51:45 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcfda196-0bc7-4b62-bc64-ba4e4875d1aa tempest-VolumeTypesAccessTest-202838261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:51:45 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-dcfda196-0bc7-4b62-bc64-ba4e4875d1aa tempest-VolumeTypesAccessTest-202838261 None] Flow 'volume_create_manager' (0fac6f76-a553-4846-82ee-585381350041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:51:45 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-dcfda196-0bc7-4b62-bc64-ba4e4875d1aa tempest-VolumeTypesAccessTest-202838261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8330e1a-212d-4c17-befb-3d6b3071d0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:51:45 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-dcfda196-0bc7-4b62-bc64-ba4e4875d1aa tempest-VolumeTypesAccessTest-202838261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8330e1a-212d-4c17-befb-3d6b3071d0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:51:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-198342922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36b7341b-2f75-40dc-9843-274910981e50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30bce102c09442bb9d6f53f832d70dc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:51:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:51:45Z,use_quota=True,user_id='15d1d5f8d89240c7a3f90629cb8a485f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5171fab3-f9fe-4bd2-ade5-b8de291e18a8),volume_type_id=5171fab3-f9fe-4bd2-ade5-b8de291e18a8)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:51:45 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-dcfda196-0bc7-4b62-bc64-ba4e4875d1aa tempest-VolumeTypesAccessTest-202838261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (975f2600-4596-4414-9b95-df49112fe03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:51:45 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-dcfda196-0bc7-4b62-bc64-ba4e4875d1aa tempest-VolumeTypesAccessTest-202838261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (975f2600-4596-4414-9b95-df49112fe03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:51:45 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-dcfda196-0bc7-4b62-bc64-ba4e4875d1aa tempest-VolumeTypesAccessTest-202838261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68bad23f-b999-480a-bce4-225a03386183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:51:45 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-dcfda196-0bc7-4b62-bc64-ba4e4875d1aa tempest-VolumeTypesAccessTest-202838261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68bad23f-b999-480a-bce4-225a03386183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36b7341b-2f75-40dc-9843-274910981e50', 'volume_name': 'volume-36b7341b-2f75-40dc-9843-274910981e50', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:51:45 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-dcfda196-0bc7-4b62-bc64-ba4e4875d1aa tempest-VolumeTypesAccessTest-202838261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f2b4999-e385-46dd-88f3-0972cbe0297b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:51:45 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-dcfda196-0bc7-4b62-bc64-ba4e4875d1aa tempest-VolumeTypesAccessTest-202838261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f2b4999-e385-46dd-88f3-0972cbe0297b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:51:45 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-dcfda196-0bc7-4b62-bc64-ba4e4875d1aa tempest-VolumeTypesAccessTest-202838261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffa678f0-2adb-4bb0-82e8-54c836537850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:51:45 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-dcfda196-0bc7-4b62-bc64-ba4e4875d1aa tempest-VolumeTypesAccessTest-202838261 None] Volume 36b7341b-2f75-40dc-9843-274910981e50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36b7341b-2f75-40dc-9843-274910981e50', 'volume_size': 1} Jul 30 16:51:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-dcfda196-0bc7-4b62-bc64-ba4e4875d1aa tempest-VolumeTypesAccessTest-202838261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:51:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-dcfda196-0bc7-4b62-bc64-ba4e4875d1aa tempest-VolumeTypesAccessTest-202838261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:51:45 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-dcfda196-0bc7-4b62-bc64-ba4e4875d1aa tempest-VolumeTypesAccessTest-202838261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:51:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-198342922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36b7341b-2f75-40dc-9843-274910981e50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30bce102c09442bb9d6f53f832d70dc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:51:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:51:45Z,use_quota=True,user_id='15d1d5f8d89240c7a3f90629cb8a485f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5171fab3-f9fe-4bd2-ade5-b8de291e18a8),volume_type_id=5171fab3-f9fe-4bd2-ade5-b8de291e18a8)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:51:45 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-dcfda196-0bc7-4b62-bc64-ba4e4875d1aa tempest-VolumeTypesAccessTest-202838261 None] Creating volume 36b7341b-2f75-40dc-9843-274910981e50 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:51:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-dcfda196-0bc7-4b62-bc64-ba4e4875d1aa tempest-VolumeTypesAccessTest-202838261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:51:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-dcfda196-0bc7-4b62-bc64-ba4e4875d1aa tempest-VolumeTypesAccessTest-202838261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:51:45 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-dcfda196-0bc7-4b62-bc64-ba4e4875d1aa tempest-VolumeTypesAccessTest-202838261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:51:45 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-dcfda196-0bc7-4b62-bc64-ba4e4875d1aa tempest-VolumeTypesAccessTest-202838261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:51:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-dcfda196-0bc7-4b62-bc64-ba4e4875d1aa tempest-VolumeTypesAccessTest-202838261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:51:45 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-dcfda196-0bc7-4b62-bc64-ba4e4875d1aa tempest-VolumeTypesAccessTest-202838261 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:51:45 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-dcfda196-0bc7-4b62-bc64-ba4e4875d1aa tempest-VolumeTypesAccessTest-202838261 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:51:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dcfda196-0bc7-4b62-bc64-ba4e4875d1aa tempest-VolumeTypesAccessTest-202838261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-36b7341b-2f75-40dc-9843-274910981e50 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:51:45 devstack sudo[92161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-36b7341b-2f75-40dc-9843-274910981e50 1073741824 Jul 30 16:51:45 devstack sudo[92161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:51:46 devstack sudo[92161]: pam_unix(sudo:session): session closed for user root Jul 30 16:51:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dcfda196-0bc7-4b62-bc64-ba4e4875d1aa tempest-VolumeTypesAccessTest-202838261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-36b7341b-2f75-40dc-9843-274910981e50 1073741824" returned: 0 in 0.576s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:51:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dcfda196-0bc7-4b62-bc64-ba4e4875d1aa tempest-VolumeTypesAccessTest-202838261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-36b7341b-2f75-40dc-9843-274910981e50 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:51:46 devstack sudo[92167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-36b7341b-2f75-40dc-9843-274910981e50 Jul 30 16:51:46 devstack sudo[92167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:51:46 devstack sudo[92167]: pam_unix(sudo:session): session closed for user root Jul 30 16:51:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dcfda196-0bc7-4b62-bc64-ba4e4875d1aa tempest-VolumeTypesAccessTest-202838261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-36b7341b-2f75-40dc-9843-274910981e50" returned: 0 in 0.344s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:51:46 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-dcfda196-0bc7-4b62-bc64-ba4e4875d1aa tempest-VolumeTypesAccessTest-202838261 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:51:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-dcfda196-0bc7-4b62-bc64-ba4e4875d1aa tempest-VolumeTypesAccessTest-202838261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:51:46 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-dcfda196-0bc7-4b62-bc64-ba4e4875d1aa tempest-VolumeTypesAccessTest-202838261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffa678f0-2adb-4bb0-82e8-54c836537850) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36b7341b-2f75-40dc-9843-274910981e50', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:51:46 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-dcfda196-0bc7-4b62-bc64-ba4e4875d1aa tempest-VolumeTypesAccessTest-202838261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4995d3d8-03c2-42b9-a007-34243a785bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:51:46 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-dcfda196-0bc7-4b62-bc64-ba4e4875d1aa tempest-VolumeTypesAccessTest-202838261 None] Volume volume-36b7341b-2f75-40dc-9843-274910981e50 (36b7341b-2f75-40dc-9843-274910981e50): created successfully Jul 30 16:51:46 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-dcfda196-0bc7-4b62-bc64-ba4e4875d1aa tempest-VolumeTypesAccessTest-202838261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4995d3d8-03c2-42b9-a007-34243a785bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:51:46 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-dcfda196-0bc7-4b62-bc64-ba4e4875d1aa tempest-VolumeTypesAccessTest-202838261 None] Flow 'volume_create_manager' (0fac6f76-a553-4846-82ee-585381350041) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:51:46 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-dcfda196-0bc7-4b62-bc64-ba4e4875d1aa tempest-VolumeTypesAccessTest-202838261 None] Created volume successfully. Jul 30 16:51:47 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c68e1476-59ee-4f52-9bac-179e28ea4b33 tempest-VolumeTypesAccessTest-202838261 None] Acquiring lock "cinder-36b7341b-2f75-40dc-9843-274910981e50-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:51:47 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c68e1476-59ee-4f52-9bac-179e28ea4b33 tempest-VolumeTypesAccessTest-202838261 None] Lock "cinder-36b7341b-2f75-40dc-9843-274910981e50-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:51:47 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c68e1476-59ee-4f52-9bac-179e28ea4b33 tempest-VolumeTypesAccessTest-202838261 None] Acquiring lock "cinder-quobyte-36b7341b-2f75-40dc-9843-274910981e50" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:51:47 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c68e1476-59ee-4f52-9bac-179e28ea4b33 tempest-VolumeTypesAccessTest-202838261 None] Lock "cinder-quobyte-36b7341b-2f75-40dc-9843-274910981e50" acquired by "delete_volume" :: waited 0.025s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:51:47 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[404d7f96-21f3-4056-9c52-3af0460d1b53]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:51:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c68e1476-59ee-4f52-9bac-179e28ea4b33 tempest-VolumeTypesAccessTest-202838261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-36b7341b-2f75-40dc-9843-274910981e50 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:51:47 devstack sudo[92172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-36b7341b-2f75-40dc-9843-274910981e50 Jul 30 16:51:47 devstack sudo[92172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:51:48 devstack sudo[92172]: pam_unix(sudo:session): session closed for user root Jul 30 16:51:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c68e1476-59ee-4f52-9bac-179e28ea4b33 tempest-VolumeTypesAccessTest-202838261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-36b7341b-2f75-40dc-9843-274910981e50" returned: 0 in 0.414s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:51:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c68e1476-59ee-4f52-9bac-179e28ea4b33 tempest-VolumeTypesAccessTest-202838261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-36b7341b-2f75-40dc-9843-274910981e50 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:51:48 devstack sudo[92178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-36b7341b-2f75-40dc-9843-274910981e50 Jul 30 16:51:48 devstack sudo[92178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:51:48 devstack sudo[92178]: pam_unix(sudo:session): session closed for user root Jul 30 16:51:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c68e1476-59ee-4f52-9bac-179e28ea4b33 tempest-VolumeTypesAccessTest-202838261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-36b7341b-2f75-40dc-9843-274910981e50" returned: 0 in 0.390s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:51:48 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c68e1476-59ee-4f52-9bac-179e28ea4b33 tempest-VolumeTypesAccessTest-202838261 None] Lock "cinder-quobyte-36b7341b-2f75-40dc-9843-274910981e50" released by "delete_volume" :: held 0.859s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:51:48 devstack cinder-volume[88591]: WARNING cinder.quota [None req-c68e1476-59ee-4f52-9bac-179e28ea4b33 tempest-VolumeTypesAccessTest-202838261 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-430420943 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-430420943, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:51:48 devstack cinder-volume[88591]: WARNING cinder.quota [None req-c68e1476-59ee-4f52-9bac-179e28ea4b33 tempest-VolumeTypesAccessTest-202838261 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-430420943 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-430420943, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:51:48 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-c68e1476-59ee-4f52-9bac-179e28ea4b33 tempest-VolumeTypesAccessTest-202838261 None] Created reservations ['fd8b5292-31de-44db-ab50-b5b7c496b8f5', 'c579cd71-ee25-4cc7-980d-680f98127be6', 'a7abad96-f1fa-43e8-9ee3-f492857d6409', 'f4fa9a48-2496-40dc-9468-f83dcc6eec59'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:51:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c68e1476-59ee-4f52-9bac-179e28ea4b33 tempest-VolumeTypesAccessTest-202838261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:51:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c68e1476-59ee-4f52-9bac-179e28ea4b33 tempest-VolumeTypesAccessTest-202838261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:51:48 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-c68e1476-59ee-4f52-9bac-179e28ea4b33 tempest-VolumeTypesAccessTest-202838261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:51:48 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-c68e1476-59ee-4f52-9bac-179e28ea4b33 tempest-VolumeTypesAccessTest-202838261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:51:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c68e1476-59ee-4f52-9bac-179e28ea4b33 tempest-VolumeTypesAccessTest-202838261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:51:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c68e1476-59ee-4f52-9bac-179e28ea4b33 tempest-VolumeTypesAccessTest-202838261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:51:48 devstack sudo[92181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:51:48 devstack sudo[92181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:51:49 devstack sudo[92181]: pam_unix(sudo:session): session closed for user root Jul 30 16:51:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c68e1476-59ee-4f52-9bac-179e28ea4b33 tempest-VolumeTypesAccessTest-202838261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.483s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:51:49 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-c68e1476-59ee-4f52-9bac-179e28ea4b33 tempest-VolumeTypesAccessTest-202838261 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:51:49 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-c68e1476-59ee-4f52-9bac-179e28ea4b33 tempest-VolumeTypesAccessTest-202838261 None] Deleted volume successfully. Jul 30 16:51:49 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c68e1476-59ee-4f52-9bac-179e28ea4b33 tempest-VolumeTypesAccessTest-202838261 None] Lock "cinder-36b7341b-2f75-40dc-9843-274910981e50-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:51:58 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:SELECT=34,cinder:UPDATE=38,cinder:DELETE=4,cinder:INSERT=9 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:51:59 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:SELECT=34,cinder:UPDATE=48,cinder:INSERT=10,cinder:DELETE=3 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:52:04 devstack cinder-volume[88591]: INFO cinder.volume.manager [req-d527c375-bb37-4f3e-8e57-602d013d8623 req-19918cfe-93b2-43be-a907-f3b98643d2c3 tempest-AttachVolumeNegativeTest-1135644984 None] Terminate volume connection completed successfully. Jul 30 16:52:04 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-d527c375-bb37-4f3e-8e57-602d013d8623 req-19918cfe-93b2-43be-a907-f3b98643d2c3 tempest-AttachVolumeNegativeTest-1135644984 None] Deleting attachment 889901a7-c9e9-4467-a8aa-1f41de2f3c96. {{(pid=88591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:52:12 devstack cinder-volume[88591]: DEBUG oslo_service.periodic_task [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:52:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:52:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:52:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:52:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:52:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:52:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:52:12 devstack sudo[92291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:52:12 devstack sudo[92291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:52:12 devstack sudo[92291]: pam_unix(sudo:session): session closed for user root Jul 30 16:52:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.430s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:52:12 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:52:14 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:SELECT=1 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:52:14 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:SELECT=1 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:52:47 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-5db7f52e-f559-48ed-a12b-0c9a8e8714b4 tempest-AttachVolumeShelveTestJSON-1173435809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:52:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5db7f52e-f559-48ed-a12b-0c9a8e8714b4 tempest-AttachVolumeShelveTestJSON-1173435809 None] Flow 'volume_create_manager' (a9ddb8ba-bf50-46e7-97af-ebf246cbc146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:52:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5db7f52e-f559-48ed-a12b-0c9a8e8714b4 tempest-AttachVolumeShelveTestJSON-1173435809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c4e3d49-a9be-4fbc-8b71-2dca7137f72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:52:48 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5db7f52e-f559-48ed-a12b-0c9a8e8714b4 tempest-AttachVolumeShelveTestJSON-1173435809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c4e3d49-a9be-4fbc-8b71-2dca7137f72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:52:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1298346106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8156db28-831f-40e3-bafb-805f0ee591ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8088ccd3ff7486288b3d3099a427c61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:52:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:52:48Z,use_quota=True,user_id='58a1866c62c34c88bca893436bde2796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:52:48 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5db7f52e-f559-48ed-a12b-0c9a8e8714b4 tempest-AttachVolumeShelveTestJSON-1173435809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15741f39-79c5-4dc5-bed5-46800d1ccd35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:52:48 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5db7f52e-f559-48ed-a12b-0c9a8e8714b4 tempest-AttachVolumeShelveTestJSON-1173435809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15741f39-79c5-4dc5-bed5-46800d1ccd35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:52:48 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5db7f52e-f559-48ed-a12b-0c9a8e8714b4 tempest-AttachVolumeShelveTestJSON-1173435809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b5c4bca-0411-44f1-b893-949252627ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:52:48 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5db7f52e-f559-48ed-a12b-0c9a8e8714b4 tempest-AttachVolumeShelveTestJSON-1173435809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b5c4bca-0411-44f1-b893-949252627ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8156db28-831f-40e3-bafb-805f0ee591ea', 'volume_name': 'volume-8156db28-831f-40e3-bafb-805f0ee591ea', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:52:48 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5db7f52e-f559-48ed-a12b-0c9a8e8714b4 tempest-AttachVolumeShelveTestJSON-1173435809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42387c27-bb98-4a40-af6a-59f70cf7afb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:52:48 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5db7f52e-f559-48ed-a12b-0c9a8e8714b4 tempest-AttachVolumeShelveTestJSON-1173435809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42387c27-bb98-4a40-af6a-59f70cf7afb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:52:48 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5db7f52e-f559-48ed-a12b-0c9a8e8714b4 tempest-AttachVolumeShelveTestJSON-1173435809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4acc9161-ce98-4f8e-b56e-f8a2f450dbf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:52:48 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-5db7f52e-f559-48ed-a12b-0c9a8e8714b4 tempest-AttachVolumeShelveTestJSON-1173435809 None] Volume 8156db28-831f-40e3-bafb-805f0ee591ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8156db28-831f-40e3-bafb-805f0ee591ea', 'volume_size': 1} Jul 30 16:52:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5db7f52e-f559-48ed-a12b-0c9a8e8714b4 tempest-AttachVolumeShelveTestJSON-1173435809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:52:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5db7f52e-f559-48ed-a12b-0c9a8e8714b4 tempest-AttachVolumeShelveTestJSON-1173435809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:52:48 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-5db7f52e-f559-48ed-a12b-0c9a8e8714b4 tempest-AttachVolumeShelveTestJSON-1173435809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:52:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1298346106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8156db28-831f-40e3-bafb-805f0ee591ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8088ccd3ff7486288b3d3099a427c61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:52:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:52:48Z,use_quota=True,user_id='58a1866c62c34c88bca893436bde2796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:52:48 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-5db7f52e-f559-48ed-a12b-0c9a8e8714b4 tempest-AttachVolumeShelveTestJSON-1173435809 None] Creating volume 8156db28-831f-40e3-bafb-805f0ee591ea {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:52:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5db7f52e-f559-48ed-a12b-0c9a8e8714b4 tempest-AttachVolumeShelveTestJSON-1173435809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:52:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5db7f52e-f559-48ed-a12b-0c9a8e8714b4 tempest-AttachVolumeShelveTestJSON-1173435809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:52:48 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-5db7f52e-f559-48ed-a12b-0c9a8e8714b4 tempest-AttachVolumeShelveTestJSON-1173435809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:52:48 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-5db7f52e-f559-48ed-a12b-0c9a8e8714b4 tempest-AttachVolumeShelveTestJSON-1173435809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:52:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5db7f52e-f559-48ed-a12b-0c9a8e8714b4 tempest-AttachVolumeShelveTestJSON-1173435809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:52:48 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-5db7f52e-f559-48ed-a12b-0c9a8e8714b4 tempest-AttachVolumeShelveTestJSON-1173435809 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:52:48 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-5db7f52e-f559-48ed-a12b-0c9a8e8714b4 tempest-AttachVolumeShelveTestJSON-1173435809 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:52:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5db7f52e-f559-48ed-a12b-0c9a8e8714b4 tempest-AttachVolumeShelveTestJSON-1173435809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8156db28-831f-40e3-bafb-805f0ee591ea 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:52:48 devstack sudo[92763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8156db28-831f-40e3-bafb-805f0ee591ea 1073741824 Jul 30 16:52:48 devstack sudo[92763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:52:48 devstack sudo[92763]: pam_unix(sudo:session): session closed for user root Jul 30 16:52:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5db7f52e-f559-48ed-a12b-0c9a8e8714b4 tempest-AttachVolumeShelveTestJSON-1173435809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8156db28-831f-40e3-bafb-805f0ee591ea 1073741824" returned: 0 in 0.548s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:52:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5db7f52e-f559-48ed-a12b-0c9a8e8714b4 tempest-AttachVolumeShelveTestJSON-1173435809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8156db28-831f-40e3-bafb-805f0ee591ea {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:52:48 devstack sudo[92770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8156db28-831f-40e3-bafb-805f0ee591ea Jul 30 16:52:48 devstack sudo[92770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:52:48 devstack sudo[92770]: pam_unix(sudo:session): session closed for user root Jul 30 16:52:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5db7f52e-f559-48ed-a12b-0c9a8e8714b4 tempest-AttachVolumeShelveTestJSON-1173435809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8156db28-831f-40e3-bafb-805f0ee591ea" returned: 0 in 0.299s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:52:48 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-5db7f52e-f559-48ed-a12b-0c9a8e8714b4 tempest-AttachVolumeShelveTestJSON-1173435809 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:52:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5db7f52e-f559-48ed-a12b-0c9a8e8714b4 tempest-AttachVolumeShelveTestJSON-1173435809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:52:48 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5db7f52e-f559-48ed-a12b-0c9a8e8714b4 tempest-AttachVolumeShelveTestJSON-1173435809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4acc9161-ce98-4f8e-b56e-f8a2f450dbf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8156db28-831f-40e3-bafb-805f0ee591ea', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:52:48 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5db7f52e-f559-48ed-a12b-0c9a8e8714b4 tempest-AttachVolumeShelveTestJSON-1173435809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d661ab4-45b9-45a4-ad51-ce28abe1e0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:52:48 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-5db7f52e-f559-48ed-a12b-0c9a8e8714b4 tempest-AttachVolumeShelveTestJSON-1173435809 None] Volume volume-8156db28-831f-40e3-bafb-805f0ee591ea (8156db28-831f-40e3-bafb-805f0ee591ea): created successfully Jul 30 16:52:48 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5db7f52e-f559-48ed-a12b-0c9a8e8714b4 tempest-AttachVolumeShelveTestJSON-1173435809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d661ab4-45b9-45a4-ad51-ce28abe1e0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:52:48 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5db7f52e-f559-48ed-a12b-0c9a8e8714b4 tempest-AttachVolumeShelveTestJSON-1173435809 None] Flow 'volume_create_manager' (a9ddb8ba-bf50-46e7-97af-ebf246cbc146) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:52:49 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-5db7f52e-f559-48ed-a12b-0c9a8e8714b4 tempest-AttachVolumeShelveTestJSON-1173435809 None] Created volume successfully. Jul 30 16:52:58 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e7ddfaf-01c4-4e2a-8611-e784df25fb32 tempest-AttachVolumeNegativeTest-1135644984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:52:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6e7ddfaf-01c4-4e2a-8611-e784df25fb32 tempest-AttachVolumeNegativeTest-1135644984 None] Flow 'volume_create_manager' (1b8c948c-ef9f-4563-9436-f7d1cf3763e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:52:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6e7ddfaf-01c4-4e2a-8611-e784df25fb32 tempest-AttachVolumeNegativeTest-1135644984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb63feef-3916-4f54-95d9-d3665dd8c5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:52:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6e7ddfaf-01c4-4e2a-8611-e784df25fb32 tempest-AttachVolumeNegativeTest-1135644984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb63feef-3916-4f54-95d9-d3665dd8c5d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-78227982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcdc52ab-53d8-43c7-ab24-1735aca4d12c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='731ad24ec4834b3aafb0fd86002127f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:52:58Z,use_quota=True,user_id='dc12f9071eda4283b96f21bc61636311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:52:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6e7ddfaf-01c4-4e2a-8611-e784df25fb32 tempest-AttachVolumeNegativeTest-1135644984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47315fb1-e0f7-436d-a39f-590b4c75b07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:52:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6e7ddfaf-01c4-4e2a-8611-e784df25fb32 tempest-AttachVolumeNegativeTest-1135644984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47315fb1-e0f7-436d-a39f-590b4c75b07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:52:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6e7ddfaf-01c4-4e2a-8611-e784df25fb32 tempest-AttachVolumeNegativeTest-1135644984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2a89149-ceb5-4e87-8987-06023e8d4f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:52:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6e7ddfaf-01c4-4e2a-8611-e784df25fb32 tempest-AttachVolumeNegativeTest-1135644984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2a89149-ceb5-4e87-8987-06023e8d4f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcdc52ab-53d8-43c7-ab24-1735aca4d12c', 'volume_name': 'volume-bcdc52ab-53d8-43c7-ab24-1735aca4d12c', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:52:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6e7ddfaf-01c4-4e2a-8611-e784df25fb32 tempest-AttachVolumeNegativeTest-1135644984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2bacf2b-4a4e-41a9-967c-47859f113f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:52:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6e7ddfaf-01c4-4e2a-8611-e784df25fb32 tempest-AttachVolumeNegativeTest-1135644984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2bacf2b-4a4e-41a9-967c-47859f113f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:52:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6e7ddfaf-01c4-4e2a-8611-e784df25fb32 tempest-AttachVolumeNegativeTest-1135644984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5966f792-56b9-4a40-a6e4-c907e80c645d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:52:58 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-6e7ddfaf-01c4-4e2a-8611-e784df25fb32 tempest-AttachVolumeNegativeTest-1135644984 None] Volume bcdc52ab-53d8-43c7-ab24-1735aca4d12c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcdc52ab-53d8-43c7-ab24-1735aca4d12c', 'volume_size': 1} Jul 30 16:52:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-6e7ddfaf-01c4-4e2a-8611-e784df25fb32 tempest-AttachVolumeNegativeTest-1135644984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:52:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-6e7ddfaf-01c4-4e2a-8611-e784df25fb32 tempest-AttachVolumeNegativeTest-1135644984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:52:58 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-6e7ddfaf-01c4-4e2a-8611-e784df25fb32 tempest-AttachVolumeNegativeTest-1135644984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-78227982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcdc52ab-53d8-43c7-ab24-1735aca4d12c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='731ad24ec4834b3aafb0fd86002127f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:52:58Z,use_quota=True,user_id='dc12f9071eda4283b96f21bc61636311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:52:58 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-6e7ddfaf-01c4-4e2a-8611-e784df25fb32 tempest-AttachVolumeNegativeTest-1135644984 None] Creating volume bcdc52ab-53d8-43c7-ab24-1735aca4d12c {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:52:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-6e7ddfaf-01c4-4e2a-8611-e784df25fb32 tempest-AttachVolumeNegativeTest-1135644984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:52:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-6e7ddfaf-01c4-4e2a-8611-e784df25fb32 tempest-AttachVolumeNegativeTest-1135644984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:52:58 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-6e7ddfaf-01c4-4e2a-8611-e784df25fb32 tempest-AttachVolumeNegativeTest-1135644984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:52:58 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-6e7ddfaf-01c4-4e2a-8611-e784df25fb32 tempest-AttachVolumeNegativeTest-1135644984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:52:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-6e7ddfaf-01c4-4e2a-8611-e784df25fb32 tempest-AttachVolumeNegativeTest-1135644984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:52:58 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-6e7ddfaf-01c4-4e2a-8611-e784df25fb32 tempest-AttachVolumeNegativeTest-1135644984 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:52:58 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-6e7ddfaf-01c4-4e2a-8611-e784df25fb32 tempest-AttachVolumeNegativeTest-1135644984 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:52:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6e7ddfaf-01c4-4e2a-8611-e784df25fb32 tempest-AttachVolumeNegativeTest-1135644984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bcdc52ab-53d8-43c7-ab24-1735aca4d12c 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:52:58 devstack sudo[92805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bcdc52ab-53d8-43c7-ab24-1735aca4d12c 1073741824 Jul 30 16:52:58 devstack sudo[92805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:52:59 devstack sudo[92805]: pam_unix(sudo:session): session closed for user root Jul 30 16:52:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6e7ddfaf-01c4-4e2a-8611-e784df25fb32 tempest-AttachVolumeNegativeTest-1135644984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bcdc52ab-53d8-43c7-ab24-1735aca4d12c 1073741824" returned: 0 in 0.631s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:52:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6e7ddfaf-01c4-4e2a-8611-e784df25fb32 tempest-AttachVolumeNegativeTest-1135644984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bcdc52ab-53d8-43c7-ab24-1735aca4d12c {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:52:59 devstack sudo[92816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bcdc52ab-53d8-43c7-ab24-1735aca4d12c Jul 30 16:52:59 devstack sudo[92816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:52:59 devstack sudo[92816]: pam_unix(sudo:session): session closed for user root Jul 30 16:52:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6e7ddfaf-01c4-4e2a-8611-e784df25fb32 tempest-AttachVolumeNegativeTest-1135644984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bcdc52ab-53d8-43c7-ab24-1735aca4d12c" returned: 0 in 0.406s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:52:59 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-6e7ddfaf-01c4-4e2a-8611-e784df25fb32 tempest-AttachVolumeNegativeTest-1135644984 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:52:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-6e7ddfaf-01c4-4e2a-8611-e784df25fb32 tempest-AttachVolumeNegativeTest-1135644984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:52:59 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6e7ddfaf-01c4-4e2a-8611-e784df25fb32 tempest-AttachVolumeNegativeTest-1135644984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5966f792-56b9-4a40-a6e4-c907e80c645d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcdc52ab-53d8-43c7-ab24-1735aca4d12c', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:52:59 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6e7ddfaf-01c4-4e2a-8611-e784df25fb32 tempest-AttachVolumeNegativeTest-1135644984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c8d43b8-560c-40d1-8fd0-7713b657b5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:52:59 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-6e7ddfaf-01c4-4e2a-8611-e784df25fb32 tempest-AttachVolumeNegativeTest-1135644984 None] Volume volume-bcdc52ab-53d8-43c7-ab24-1735aca4d12c (bcdc52ab-53d8-43c7-ab24-1735aca4d12c): created successfully Jul 30 16:52:59 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6e7ddfaf-01c4-4e2a-8611-e784df25fb32 tempest-AttachVolumeNegativeTest-1135644984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c8d43b8-560c-40d1-8fd0-7713b657b5e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:52:59 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6e7ddfaf-01c4-4e2a-8611-e784df25fb32 tempest-AttachVolumeNegativeTest-1135644984 None] Flow 'volume_create_manager' (1b8c948c-ef9f-4563-9436-f7d1cf3763e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:52:59 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-6e7ddfaf-01c4-4e2a-8611-e784df25fb32 tempest-AttachVolumeNegativeTest-1135644984 None] Created volume successfully. Jul 30 16:53:00 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-a69505e2-5d04-44c9-b834-b27ceec98b15 tempest-ServerActionsTestOtherA-277957863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:53:00 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a69505e2-5d04-44c9-b834-b27ceec98b15 tempest-ServerActionsTestOtherA-277957863 None] Flow 'volume_create_manager' (5c8751de-24cf-4dd9-9139-a994ea1eb231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:00 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a69505e2-5d04-44c9-b834-b27ceec98b15 tempest-ServerActionsTestOtherA-277957863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5024107-9538-4599-8b61-8a02ff5d442a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:00 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a69505e2-5d04-44c9-b834-b27ceec98b15 tempest-ServerActionsTestOtherA-277957863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5024107-9538-4599-8b61-8a02ff5d442a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-25930313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9f8f412-523d-4ad2-9041-c2a96f63ce4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc5bdd3cc1ad4a4d9c5a8c0ff87c5071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:01Z,use_quota=True,user_id='4750e3e11cb84d64bca07a9b665c260a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:00 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a69505e2-5d04-44c9-b834-b27ceec98b15 tempest-ServerActionsTestOtherA-277957863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (924e5e55-cf31-4824-9ce1-3da88471a858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a69505e2-5d04-44c9-b834-b27ceec98b15 tempest-ServerActionsTestOtherA-277957863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (924e5e55-cf31-4824-9ce1-3da88471a858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a69505e2-5d04-44c9-b834-b27ceec98b15 tempest-ServerActionsTestOtherA-277957863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaf494b5-4b66-462c-87d3-a683bf770cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a69505e2-5d04-44c9-b834-b27ceec98b15 tempest-ServerActionsTestOtherA-277957863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaf494b5-4b66-462c-87d3-a683bf770cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9f8f412-523d-4ad2-9041-c2a96f63ce4f', 'volume_name': 'volume-a9f8f412-523d-4ad2-9041-c2a96f63ce4f', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a69505e2-5d04-44c9-b834-b27ceec98b15 tempest-ServerActionsTestOtherA-277957863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9046b593-5de6-4c42-acb8-e8b94585bbb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a69505e2-5d04-44c9-b834-b27ceec98b15 tempest-ServerActionsTestOtherA-277957863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9046b593-5de6-4c42-acb8-e8b94585bbb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a69505e2-5d04-44c9-b834-b27ceec98b15 tempest-ServerActionsTestOtherA-277957863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3698e0c0-ef4a-447a-b926-15464a092be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:01 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-a69505e2-5d04-44c9-b834-b27ceec98b15 tempest-ServerActionsTestOtherA-277957863 None] Volume a9f8f412-523d-4ad2-9041-c2a96f63ce4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9f8f412-523d-4ad2-9041-c2a96f63ce4f', 'volume_size': 1} Jul 30 16:53:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a69505e2-5d04-44c9-b834-b27ceec98b15 tempest-ServerActionsTestOtherA-277957863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a69505e2-5d04-44c9-b834-b27ceec98b15 tempest-ServerActionsTestOtherA-277957863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:01 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a69505e2-5d04-44c9-b834-b27ceec98b15 tempest-ServerActionsTestOtherA-277957863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-25930313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9f8f412-523d-4ad2-9041-c2a96f63ce4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc5bdd3cc1ad4a4d9c5a8c0ff87c5071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:01Z,use_quota=True,user_id='4750e3e11cb84d64bca07a9b665c260a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:53:01 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-a69505e2-5d04-44c9-b834-b27ceec98b15 tempest-ServerActionsTestOtherA-277957863 None] Creating volume a9f8f412-523d-4ad2-9041-c2a96f63ce4f {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:53:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a69505e2-5d04-44c9-b834-b27ceec98b15 tempest-ServerActionsTestOtherA-277957863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a69505e2-5d04-44c9-b834-b27ceec98b15 tempest-ServerActionsTestOtherA-277957863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:01 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a69505e2-5d04-44c9-b834-b27ceec98b15 tempest-ServerActionsTestOtherA-277957863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:53:01 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a69505e2-5d04-44c9-b834-b27ceec98b15 tempest-ServerActionsTestOtherA-277957863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:53:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a69505e2-5d04-44c9-b834-b27ceec98b15 tempest-ServerActionsTestOtherA-277957863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:01 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a69505e2-5d04-44c9-b834-b27ceec98b15 tempest-ServerActionsTestOtherA-277957863 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:53:01 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-a69505e2-5d04-44c9-b834-b27ceec98b15 tempest-ServerActionsTestOtherA-277957863 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:53:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a69505e2-5d04-44c9-b834-b27ceec98b15 tempest-ServerActionsTestOtherA-277957863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f8f412-523d-4ad2-9041-c2a96f63ce4f 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:01 devstack sudo[92841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f8f412-523d-4ad2-9041-c2a96f63ce4f 1073741824 Jul 30 16:53:01 devstack sudo[92841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:01 devstack sudo[92841]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a69505e2-5d04-44c9-b834-b27ceec98b15 tempest-ServerActionsTestOtherA-277957863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f8f412-523d-4ad2-9041-c2a96f63ce4f 1073741824" returned: 0 in 0.607s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a69505e2-5d04-44c9-b834-b27ceec98b15 tempest-ServerActionsTestOtherA-277957863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f8f412-523d-4ad2-9041-c2a96f63ce4f {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:01 devstack sudo[92853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f8f412-523d-4ad2-9041-c2a96f63ce4f Jul 30 16:53:01 devstack sudo[92853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:02 devstack sudo[92853]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a69505e2-5d04-44c9-b834-b27ceec98b15 tempest-ServerActionsTestOtherA-277957863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f8f412-523d-4ad2-9041-c2a96f63ce4f" returned: 0 in 0.350s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:02 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a69505e2-5d04-44c9-b834-b27ceec98b15 tempest-ServerActionsTestOtherA-277957863 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:53:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a69505e2-5d04-44c9-b834-b27ceec98b15 tempest-ServerActionsTestOtherA-277957863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a69505e2-5d04-44c9-b834-b27ceec98b15 tempest-ServerActionsTestOtherA-277957863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3698e0c0-ef4a-447a-b926-15464a092be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9f8f412-523d-4ad2-9041-c2a96f63ce4f', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a69505e2-5d04-44c9-b834-b27ceec98b15 tempest-ServerActionsTestOtherA-277957863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6745eeb3-3b97-4df3-af07-54e6a1e3f571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-af3de572-f7fb-464e-8fe9-a0c827a25ade req-a1bf8ac2-8dfd-4043-8189-155b19398958 tempest-AttachVolumeNegativeTest-1135644984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-af3de572-f7fb-464e-8fe9-a0c827a25ade req-a1bf8ac2-8dfd-4043-8189-155b19398958 tempest-AttachVolumeNegativeTest-1135644984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:02 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-a69505e2-5d04-44c9-b834-b27ceec98b15 tempest-ServerActionsTestOtherA-277957863 None] Volume volume-a9f8f412-523d-4ad2-9041-c2a96f63ce4f (a9f8f412-523d-4ad2-9041-c2a96f63ce4f): created successfully Jul 30 16:53:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a69505e2-5d04-44c9-b834-b27ceec98b15 tempest-ServerActionsTestOtherA-277957863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6745eeb3-3b97-4df3-af07-54e6a1e3f571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a69505e2-5d04-44c9-b834-b27ceec98b15 tempest-ServerActionsTestOtherA-277957863 None] Flow 'volume_create_manager' (5c8751de-24cf-4dd9-9139-a994ea1eb231) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-af3de572-f7fb-464e-8fe9-a0c827a25ade req-a1bf8ac2-8dfd-4043-8189-155b19398958 tempest-AttachVolumeNegativeTest-1135644984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:02 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-a69505e2-5d04-44c9-b834-b27ceec98b15 tempest-ServerActionsTestOtherA-277957863 None] Created volume successfully. Jul 30 16:53:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-af3de572-f7fb-464e-8fe9-a0c827a25ade req-a1bf8ac2-8dfd-4043-8189-155b19398958 tempest-AttachVolumeNegativeTest-1135644984 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202', 'name': 'volume-bcdc52ab-53d8-43c7-ab24-1735aca4d12c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b551d628-8d48-475d-b2de-d0940662c9b8', 'enforce_multipath': True} {{(pid=88591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:53:02 devstack cinder-volume[88591]: INFO cinder.volume.manager [req-af3de572-f7fb-464e-8fe9-a0c827a25ade req-a1bf8ac2-8dfd-4043-8189-155b19398958 tempest-AttachVolumeNegativeTest-1135644984 None] attachment_update completed successfully. Jul 30 16:53:03 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-66ea2560-e9d6-4477-ae4b-36298fd61c0c req-9d957b70-bf53-4684-b6b4-853bafe2cc50 tempest-AttachVolumeShelveTestJSON-1173435809 None] No connector for attachment bfb7c4b8-c008-4ad2-ba39-0a3e18981313; skipping storage backend terminate_connection call. {{(pid=88591) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 30 16:53:03 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-66ea2560-e9d6-4477-ae4b-36298fd61c0c req-9d957b70-bf53-4684-b6b4-853bafe2cc50 tempest-AttachVolumeShelveTestJSON-1173435809 None] Deleting attachment bfb7c4b8-c008-4ad2-ba39-0a3e18981313. {{(pid=88591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:53:05 devstack cinder-volume[88591]: INFO cinder.volume.manager [req-7f7e85f2-a153-4423-9523-2df92d095240 req-eadf615d-0f07-4574-b304-539bd51a8b03 tempest-AttachVolumeNegativeTest-1135644984 None] Terminate volume connection completed successfully. Jul 30 16:53:05 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-7f7e85f2-a153-4423-9523-2df92d095240 req-eadf615d-0f07-4574-b304-539bd51a8b03 tempest-AttachVolumeNegativeTest-1135644984 None] Deleting attachment b551d628-8d48-475d-b2de-d0940662c9b8. {{(pid=88591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:53:12 devstack cinder-volume[88591]: DEBUG oslo_service.periodic_task [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:53:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:53:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:53:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:12 devstack sudo[93434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:53:12 devstack sudo[93434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:12 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-92865cd6-0807-4896-b873-d7d8fa52fa6d tempest-VolumesActionsTest-1018607988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:53:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-92865cd6-0807-4896-b873-d7d8fa52fa6d tempest-VolumesActionsTest-1018607988 None] Flow 'volume_create_manager' (ec6f6838-ba48-417e-905e-9b6bd95fae9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-92865cd6-0807-4896-b873-d7d8fa52fa6d tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (547fb866-3832-4a4b-a012-cc893aad4c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-92865cd6-0807-4896-b873-d7d8fa52fa6d tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (547fb866-3832-4a4b-a012-cc893aad4c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1574003739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ae71ae9-13f2-4adf-8131-ba633ea74f01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a7b0cb1f35f46b8937ad101219debac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:13Z,use_quota=True,user_id='0fefb055b10240b488b138ebb5f3dfd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-92865cd6-0807-4896-b873-d7d8fa52fa6d tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a333ed2f-3fb8-40b2-b1e1-e9037385704d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-92865cd6-0807-4896-b873-d7d8fa52fa6d tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a333ed2f-3fb8-40b2-b1e1-e9037385704d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-92865cd6-0807-4896-b873-d7d8fa52fa6d tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc9bdc88-5375-4e22-8875-9ffa2a697c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-92865cd6-0807-4896-b873-d7d8fa52fa6d tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc9bdc88-5375-4e22-8875-9ffa2a697c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ae71ae9-13f2-4adf-8131-ba633ea74f01', 'volume_name': 'volume-9ae71ae9-13f2-4adf-8131-ba633ea74f01', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-92865cd6-0807-4896-b873-d7d8fa52fa6d tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6422f49d-2ddb-449d-a593-b16191f28424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-92865cd6-0807-4896-b873-d7d8fa52fa6d tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6422f49d-2ddb-449d-a593-b16191f28424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-92865cd6-0807-4896-b873-d7d8fa52fa6d tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecb42610-d9cb-4cdd-a96d-e33616d8a27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:13 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-92865cd6-0807-4896-b873-d7d8fa52fa6d tempest-VolumesActionsTest-1018607988 None] Volume 9ae71ae9-13f2-4adf-8131-ba633ea74f01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ae71ae9-13f2-4adf-8131-ba633ea74f01', 'volume_size': 1} Jul 30 16:53:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-92865cd6-0807-4896-b873-d7d8fa52fa6d tempest-VolumesActionsTest-1018607988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-92865cd6-0807-4896-b873-d7d8fa52fa6d tempest-VolumesActionsTest-1018607988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:13 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-92865cd6-0807-4896-b873-d7d8fa52fa6d tempest-VolumesActionsTest-1018607988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1574003739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ae71ae9-13f2-4adf-8131-ba633ea74f01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a7b0cb1f35f46b8937ad101219debac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:13Z,use_quota=True,user_id='0fefb055b10240b488b138ebb5f3dfd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:53:13 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-92865cd6-0807-4896-b873-d7d8fa52fa6d tempest-VolumesActionsTest-1018607988 None] Creating volume 9ae71ae9-13f2-4adf-8131-ba633ea74f01 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:53:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-92865cd6-0807-4896-b873-d7d8fa52fa6d tempest-VolumesActionsTest-1018607988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-92865cd6-0807-4896-b873-d7d8fa52fa6d tempest-VolumesActionsTest-1018607988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:13 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-92865cd6-0807-4896-b873-d7d8fa52fa6d tempest-VolumesActionsTest-1018607988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:53:13 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-92865cd6-0807-4896-b873-d7d8fa52fa6d tempest-VolumesActionsTest-1018607988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:53:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-92865cd6-0807-4896-b873-d7d8fa52fa6d tempest-VolumesActionsTest-1018607988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:13 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-92865cd6-0807-4896-b873-d7d8fa52fa6d tempest-VolumesActionsTest-1018607988 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:53:13 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-92865cd6-0807-4896-b873-d7d8fa52fa6d tempest-VolumesActionsTest-1018607988 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:53:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-92865cd6-0807-4896-b873-d7d8fa52fa6d tempest-VolumesActionsTest-1018607988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9ae71ae9-13f2-4adf-8131-ba633ea74f01 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:13 devstack sudo[93436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9ae71ae9-13f2-4adf-8131-ba633ea74f01 1073741824 Jul 30 16:53:13 devstack sudo[93436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:13 devstack sudo[93434]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.768s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:13 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:53:13 devstack cinder-volume[88591]: DEBUG oslo_service.periodic_task [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running periodic task VolumeManager._thread_info {{(pid=88591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:53:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] thread count: 8 {{(pid=88591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:53:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] thread info: [<_MainThread(MainThread, started 140677178003584)>, , , , , , , ] {{(pid=88591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:53:13 devstack sudo[93436]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-92865cd6-0807-4896-b873-d7d8fa52fa6d tempest-VolumesActionsTest-1018607988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9ae71ae9-13f2-4adf-8131-ba633ea74f01 1073741824" returned: 0 in 0.847s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-92865cd6-0807-4896-b873-d7d8fa52fa6d tempest-VolumesActionsTest-1018607988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9ae71ae9-13f2-4adf-8131-ba633ea74f01 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:14 devstack sudo[93443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9ae71ae9-13f2-4adf-8131-ba633ea74f01 Jul 30 16:53:14 devstack sudo[93443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:14 devstack sudo[93443]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-92865cd6-0807-4896-b873-d7d8fa52fa6d tempest-VolumesActionsTest-1018607988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9ae71ae9-13f2-4adf-8131-ba633ea74f01" returned: 0 in 0.622s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:14 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-92865cd6-0807-4896-b873-d7d8fa52fa6d tempest-VolumesActionsTest-1018607988 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:53:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-92865cd6-0807-4896-b873-d7d8fa52fa6d tempest-VolumesActionsTest-1018607988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:14 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-92865cd6-0807-4896-b873-d7d8fa52fa6d tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecb42610-d9cb-4cdd-a96d-e33616d8a27a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ae71ae9-13f2-4adf-8131-ba633ea74f01', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:14 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-92865cd6-0807-4896-b873-d7d8fa52fa6d tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa86a067-7261-4843-afbe-918ac13267c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:14 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-92865cd6-0807-4896-b873-d7d8fa52fa6d tempest-VolumesActionsTest-1018607988 None] Volume volume-9ae71ae9-13f2-4adf-8131-ba633ea74f01 (9ae71ae9-13f2-4adf-8131-ba633ea74f01): created successfully Jul 30 16:53:14 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-92865cd6-0807-4896-b873-d7d8fa52fa6d tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa86a067-7261-4843-afbe-918ac13267c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:14 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-92865cd6-0807-4896-b873-d7d8fa52fa6d tempest-VolumesActionsTest-1018607988 None] Flow 'volume_create_manager' (ec6f6838-ba48-417e-905e-9b6bd95fae9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:14 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-92865cd6-0807-4896-b873-d7d8fa52fa6d tempest-VolumesActionsTest-1018607988 None] Created volume successfully. Jul 30 16:53:15 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-e0c28bd1-de04-47ef-9be9-9046d2089c05 tempest-VolumesActionsTest-1018607988 None] Acquiring lock "cinder-9ae71ae9-13f2-4adf-8131-ba633ea74f01" by "attach_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:53:15 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-e0c28bd1-de04-47ef-9be9-9046d2089c05 tempest-VolumesActionsTest-1018607988 None] Lock "cinder-9ae71ae9-13f2-4adf-8131-ba633ea74f01" acquired by "attach_volume" :: waited 0.050s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:53:16 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-e0c28bd1-de04-47ef-9be9-9046d2089c05 tempest-VolumesActionsTest-1018607988 None] Attaching volume 9ae71ae9-13f2-4adf-8131-ba633ea74f01 to instance 9446b52c-9c36-4277-932e-b3d06caaf291 at mountpoint /dev/vdb on host None. Jul 30 16:53:16 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-e0c28bd1-de04-47ef-9be9-9046d2089c05 tempest-VolumesActionsTest-1018607988 None] Attach volume completed successfully. Jul 30 16:53:16 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-e0c28bd1-de04-47ef-9be9-9046d2089c05 tempest-VolumesActionsTest-1018607988 None] Lock "cinder-9ae71ae9-13f2-4adf-8131-ba633ea74f01" released by "attach_volume" :: held 0.235s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:53:17 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-dc768178-345b-4fc7-9ae1-f2a43a023cc8 tempest-VolumesActionsTest-46902407 None] Terminate volume connection completed successfully. Jul 30 16:53:17 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-dc768178-345b-4fc7-9ae1-f2a43a023cc8 tempest-VolumesActionsTest-46902407 None] Acquiring lock "cinder-9ae71ae9-13f2-4adf-8131-ba633ea74f01-detach_volume" by "detach_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:53:17 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-dc768178-345b-4fc7-9ae1-f2a43a023cc8 tempest-VolumesActionsTest-46902407 None] Lock "cinder-9ae71ae9-13f2-4adf-8131-ba633ea74f01-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:53:17 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-dc768178-345b-4fc7-9ae1-f2a43a023cc8 tempest-VolumesActionsTest-46902407 None] Detaching volume 9ae71ae9-13f2-4adf-8131-ba633ea74f01 from instance 9446b52c-9c36-4277-932e-b3d06caaf291. Jul 30 16:53:17 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-dc768178-345b-4fc7-9ae1-f2a43a023cc8 tempest-VolumesActionsTest-46902407 None] Detach volume completed successfully. Jul 30 16:53:17 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-dc768178-345b-4fc7-9ae1-f2a43a023cc8 tempest-VolumesActionsTest-46902407 None] Lock "cinder-9ae71ae9-13f2-4adf-8131-ba633ea74f01-detach_volume" released by "detach_volume" :: held 0.365s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:53:18 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-6e47a351-97c8-454a-9bcb-2457df19b0ed tempest-VolumesActionsTest-1018607988 None] Acquiring lock "cinder-9ae71ae9-13f2-4adf-8131-ba633ea74f01-detach_volume" by "detach_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:53:18 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-6e47a351-97c8-454a-9bcb-2457df19b0ed tempest-VolumesActionsTest-1018607988 None] Lock "cinder-9ae71ae9-13f2-4adf-8131-ba633ea74f01-detach_volume" acquired by "detach_volume" :: waited 0.051s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:53:18 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-6e47a351-97c8-454a-9bcb-2457df19b0ed tempest-VolumesActionsTest-1018607988 None] Volume detach called, but volume not attached. Jul 30 16:53:18 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-6e47a351-97c8-454a-9bcb-2457df19b0ed tempest-VolumesActionsTest-1018607988 None] Lock "cinder-9ae71ae9-13f2-4adf-8131-ba633ea74f01-detach_volume" released by "detach_volume" :: held 0.064s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:53:19 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-399659a3-7ed1-416a-899e-25615e635617 tempest-VolumesActionsTest-1018607988 None] Acquiring lock "cinder-9ae71ae9-13f2-4adf-8131-ba633ea74f01-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:53:19 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-399659a3-7ed1-416a-899e-25615e635617 tempest-VolumesActionsTest-1018607988 None] Lock "cinder-9ae71ae9-13f2-4adf-8131-ba633ea74f01-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:53:19 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-399659a3-7ed1-416a-899e-25615e635617 tempest-VolumesActionsTest-1018607988 None] Acquiring lock "cinder-quobyte-9ae71ae9-13f2-4adf-8131-ba633ea74f01" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:53:19 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-399659a3-7ed1-416a-899e-25615e635617 tempest-VolumesActionsTest-1018607988 None] Lock "cinder-quobyte-9ae71ae9-13f2-4adf-8131-ba633ea74f01" acquired by "delete_volume" :: waited 0.045s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:53:19 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14a5725-f7db-4d65-b6e9-c0dd8318cda3]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:53:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-399659a3-7ed1-416a-899e-25615e635617 tempest-VolumesActionsTest-1018607988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9ae71ae9-13f2-4adf-8131-ba633ea74f01 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:19 devstack sudo[93522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9ae71ae9-13f2-4adf-8131-ba633ea74f01 Jul 30 16:53:19 devstack sudo[93522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:20 devstack sudo[93522]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-399659a3-7ed1-416a-899e-25615e635617 tempest-VolumesActionsTest-1018607988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9ae71ae9-13f2-4adf-8131-ba633ea74f01" returned: 0 in 0.848s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-399659a3-7ed1-416a-899e-25615e635617 tempest-VolumesActionsTest-1018607988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9ae71ae9-13f2-4adf-8131-ba633ea74f01 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:20 devstack sudo[93544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9ae71ae9-13f2-4adf-8131-ba633ea74f01 Jul 30 16:53:20 devstack sudo[93544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:21 devstack sudo[93544]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-399659a3-7ed1-416a-899e-25615e635617 tempest-VolumesActionsTest-1018607988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9ae71ae9-13f2-4adf-8131-ba633ea74f01" returned: 0 in 0.578s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:21 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-399659a3-7ed1-416a-899e-25615e635617 tempest-VolumesActionsTest-1018607988 None] Lock "cinder-quobyte-9ae71ae9-13f2-4adf-8131-ba633ea74f01" released by "delete_volume" :: held 1.611s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:53:21 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-399659a3-7ed1-416a-899e-25615e635617 tempest-VolumesActionsTest-1018607988 None] Created reservations ['a0957936-ccc5-4995-baaa-a99823f4c5f7', '2892d108-7c61-4b62-90a2-1f1fe07b66a9', 'e8dee8c5-6764-4621-91ad-1524c9fbf53e', '25c6c637-60c4-480d-8930-afad2aaa6e8f'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:53:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-399659a3-7ed1-416a-899e-25615e635617 tempest-VolumesActionsTest-1018607988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-399659a3-7ed1-416a-899e-25615e635617 tempest-VolumesActionsTest-1018607988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:21 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-399659a3-7ed1-416a-899e-25615e635617 tempest-VolumesActionsTest-1018607988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:53:21 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-399659a3-7ed1-416a-899e-25615e635617 tempest-VolumesActionsTest-1018607988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:53:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-399659a3-7ed1-416a-899e-25615e635617 tempest-VolumesActionsTest-1018607988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-399659a3-7ed1-416a-899e-25615e635617 tempest-VolumesActionsTest-1018607988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:21 devstack sudo[93547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:53:21 devstack sudo[93547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:22 devstack sudo[93547]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-399659a3-7ed1-416a-899e-25615e635617 tempest-VolumesActionsTest-1018607988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.826s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:22 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-399659a3-7ed1-416a-899e-25615e635617 tempest-VolumesActionsTest-1018607988 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:53:22 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-399659a3-7ed1-416a-899e-25615e635617 tempest-VolumesActionsTest-1018607988 None] Deleted volume successfully. Jul 30 16:53:22 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-399659a3-7ed1-416a-899e-25615e635617 tempest-VolumesActionsTest-1018607988 None] Lock "cinder-9ae71ae9-13f2-4adf-8131-ba633ea74f01-delete_volume" released by "delete_volume" :: held 3.114s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:53:30 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-172a3ead-1ab9-43d0-bcab-a94e148cdbcb tempest-VolumesActionsTest-1018607988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:53:30 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-172a3ead-1ab9-43d0-bcab-a94e148cdbcb tempest-VolumesActionsTest-1018607988 None] Flow 'volume_create_manager' (c9452acf-0816-45da-a45c-83151e10e720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:30 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-172a3ead-1ab9-43d0-bcab-a94e148cdbcb tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be084b2a-6055-4786-9e29-44971b7ed71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:30 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-172a3ead-1ab9-43d0-bcab-a94e148cdbcb tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be084b2a-6055-4786-9e29-44971b7ed71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-318698068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80e5486b-a7ae-4022-9a3f-9eb065803692,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a7b0cb1f35f46b8937ad101219debac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:31Z,use_quota=True,user_id='0fefb055b10240b488b138ebb5f3dfd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:30 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-172a3ead-1ab9-43d0-bcab-a94e148cdbcb tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (637693bc-2301-454e-896f-89c3be754459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:31 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-172a3ead-1ab9-43d0-bcab-a94e148cdbcb tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (637693bc-2301-454e-896f-89c3be754459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:31 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-172a3ead-1ab9-43d0-bcab-a94e148cdbcb tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ff0b7f7-a3bb-4bf6-9623-2947bc0482b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:31 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-172a3ead-1ab9-43d0-bcab-a94e148cdbcb tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ff0b7f7-a3bb-4bf6-9623-2947bc0482b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80e5486b-a7ae-4022-9a3f-9eb065803692', 'volume_name': 'volume-80e5486b-a7ae-4022-9a3f-9eb065803692', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:31 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-172a3ead-1ab9-43d0-bcab-a94e148cdbcb tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76e9f6f8-7298-49a6-b871-449ffb52f117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:31 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-172a3ead-1ab9-43d0-bcab-a94e148cdbcb tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76e9f6f8-7298-49a6-b871-449ffb52f117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:31 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-172a3ead-1ab9-43d0-bcab-a94e148cdbcb tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (751af281-1e67-42ce-9ab5-3976e61e6ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:31 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-172a3ead-1ab9-43d0-bcab-a94e148cdbcb tempest-VolumesActionsTest-1018607988 None] Volume 80e5486b-a7ae-4022-9a3f-9eb065803692: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80e5486b-a7ae-4022-9a3f-9eb065803692', 'volume_size': 1} Jul 30 16:53:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-172a3ead-1ab9-43d0-bcab-a94e148cdbcb tempest-VolumesActionsTest-1018607988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-172a3ead-1ab9-43d0-bcab-a94e148cdbcb tempest-VolumesActionsTest-1018607988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:31 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-172a3ead-1ab9-43d0-bcab-a94e148cdbcb tempest-VolumesActionsTest-1018607988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-318698068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80e5486b-a7ae-4022-9a3f-9eb065803692,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a7b0cb1f35f46b8937ad101219debac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:31Z,use_quota=True,user_id='0fefb055b10240b488b138ebb5f3dfd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:53:31 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-172a3ead-1ab9-43d0-bcab-a94e148cdbcb tempest-VolumesActionsTest-1018607988 None] Creating volume 80e5486b-a7ae-4022-9a3f-9eb065803692 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:53:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-172a3ead-1ab9-43d0-bcab-a94e148cdbcb tempest-VolumesActionsTest-1018607988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-172a3ead-1ab9-43d0-bcab-a94e148cdbcb tempest-VolumesActionsTest-1018607988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:31 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-172a3ead-1ab9-43d0-bcab-a94e148cdbcb tempest-VolumesActionsTest-1018607988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:53:31 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-172a3ead-1ab9-43d0-bcab-a94e148cdbcb tempest-VolumesActionsTest-1018607988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:53:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-172a3ead-1ab9-43d0-bcab-a94e148cdbcb tempest-VolumesActionsTest-1018607988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:31 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-172a3ead-1ab9-43d0-bcab-a94e148cdbcb tempest-VolumesActionsTest-1018607988 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:53:31 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-172a3ead-1ab9-43d0-bcab-a94e148cdbcb tempest-VolumesActionsTest-1018607988 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:53:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-172a3ead-1ab9-43d0-bcab-a94e148cdbcb tempest-VolumesActionsTest-1018607988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-80e5486b-a7ae-4022-9a3f-9eb065803692 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:31 devstack sudo[93705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-80e5486b-a7ae-4022-9a3f-9eb065803692 1073741824 Jul 30 16:53:31 devstack sudo[93705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:31 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:UPDATE=28,cinder:SELECT=27,cinder:INSERT=4,cinder:DELETE=1 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:53:31 devstack sudo[93705]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-172a3ead-1ab9-43d0-bcab-a94e148cdbcb tempest-VolumesActionsTest-1018607988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-80e5486b-a7ae-4022-9a3f-9eb065803692 1073741824" returned: 0 in 0.704s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-172a3ead-1ab9-43d0-bcab-a94e148cdbcb tempest-VolumesActionsTest-1018607988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-80e5486b-a7ae-4022-9a3f-9eb065803692 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:31 devstack sudo[93713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-80e5486b-a7ae-4022-9a3f-9eb065803692 Jul 30 16:53:31 devstack sudo[93713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:32 devstack sudo[93713]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-172a3ead-1ab9-43d0-bcab-a94e148cdbcb tempest-VolumesActionsTest-1018607988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-80e5486b-a7ae-4022-9a3f-9eb065803692" returned: 0 in 0.670s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:32 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-172a3ead-1ab9-43d0-bcab-a94e148cdbcb tempest-VolumesActionsTest-1018607988 None] <== create_volume: return (1491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:53:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-172a3ead-1ab9-43d0-bcab-a94e148cdbcb tempest-VolumesActionsTest-1018607988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:32 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-172a3ead-1ab9-43d0-bcab-a94e148cdbcb tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (751af281-1e67-42ce-9ab5-3976e61e6ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80e5486b-a7ae-4022-9a3f-9eb065803692', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:32 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-172a3ead-1ab9-43d0-bcab-a94e148cdbcb tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13623b58-615e-48e0-a887-218f5bb7c00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:32 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-172a3ead-1ab9-43d0-bcab-a94e148cdbcb tempest-VolumesActionsTest-1018607988 None] Volume volume-80e5486b-a7ae-4022-9a3f-9eb065803692 (80e5486b-a7ae-4022-9a3f-9eb065803692): created successfully Jul 30 16:53:32 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-172a3ead-1ab9-43d0-bcab-a94e148cdbcb tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13623b58-615e-48e0-a887-218f5bb7c00b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:32 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-172a3ead-1ab9-43d0-bcab-a94e148cdbcb tempest-VolumesActionsTest-1018607988 None] Flow 'volume_create_manager' (c9452acf-0816-45da-a45c-83151e10e720) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:32 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-172a3ead-1ab9-43d0-bcab-a94e148cdbcb tempest-VolumesActionsTest-1018607988 None] Created volume successfully. Jul 30 16:53:34 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d97b4828-f0c3-4c9e-9d55-b02dfc9957f4 tempest-VolumesActionsTest-46902407 None] Acquiring lock "cinder-80e5486b-a7ae-4022-9a3f-9eb065803692-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:53:34 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d97b4828-f0c3-4c9e-9d55-b02dfc9957f4 tempest-VolumesActionsTest-46902407 None] Lock "cinder-80e5486b-a7ae-4022-9a3f-9eb065803692-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:53:34 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d97b4828-f0c3-4c9e-9d55-b02dfc9957f4 tempest-VolumesActionsTest-46902407 None] Acquiring lock "cinder-quobyte-80e5486b-a7ae-4022-9a3f-9eb065803692" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:53:34 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d97b4828-f0c3-4c9e-9d55-b02dfc9957f4 tempest-VolumesActionsTest-46902407 None] Lock "cinder-quobyte-80e5486b-a7ae-4022-9a3f-9eb065803692" acquired by "delete_volume" :: waited 0.031s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:53:34 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[32fbb6a0-a8ab-44fe-ae9a-fc6a74639f93]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:53:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d97b4828-f0c3-4c9e-9d55-b02dfc9957f4 tempest-VolumesActionsTest-46902407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-80e5486b-a7ae-4022-9a3f-9eb065803692 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:34 devstack sudo[93773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-80e5486b-a7ae-4022-9a3f-9eb065803692 Jul 30 16:53:34 devstack sudo[93773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:34 devstack sudo[93773]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d97b4828-f0c3-4c9e-9d55-b02dfc9957f4 tempest-VolumesActionsTest-46902407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-80e5486b-a7ae-4022-9a3f-9eb065803692" returned: 0 in 0.556s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d97b4828-f0c3-4c9e-9d55-b02dfc9957f4 tempest-VolumesActionsTest-46902407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-80e5486b-a7ae-4022-9a3f-9eb065803692 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:34 devstack sudo[93803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-80e5486b-a7ae-4022-9a3f-9eb065803692 Jul 30 16:53:34 devstack sudo[93803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:35 devstack sudo[93803]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d97b4828-f0c3-4c9e-9d55-b02dfc9957f4 tempest-VolumesActionsTest-46902407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-80e5486b-a7ae-4022-9a3f-9eb065803692" returned: 0 in 0.370s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:35 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d97b4828-f0c3-4c9e-9d55-b02dfc9957f4 tempest-VolumesActionsTest-46902407 None] Lock "cinder-quobyte-80e5486b-a7ae-4022-9a3f-9eb065803692" released by "delete_volume" :: held 0.990s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:53:35 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-d97b4828-f0c3-4c9e-9d55-b02dfc9957f4 tempest-VolumesActionsTest-46902407 None] Created reservations ['f628fbf1-f399-45f6-a48a-f0d2588bfc98', '21efd228-32d0-4127-b80a-97defe214201', '3ed792d8-62c1-4dd8-b490-a5fd194be940', '7922885e-e39f-445a-8f10-d9a62059f83b'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:53:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d97b4828-f0c3-4c9e-9d55-b02dfc9957f4 tempest-VolumesActionsTest-46902407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d97b4828-f0c3-4c9e-9d55-b02dfc9957f4 tempest-VolumesActionsTest-46902407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:35 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d97b4828-f0c3-4c9e-9d55-b02dfc9957f4 tempest-VolumesActionsTest-46902407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:53:35 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d97b4828-f0c3-4c9e-9d55-b02dfc9957f4 tempest-VolumesActionsTest-46902407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:53:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d97b4828-f0c3-4c9e-9d55-b02dfc9957f4 tempest-VolumesActionsTest-46902407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d97b4828-f0c3-4c9e-9d55-b02dfc9957f4 tempest-VolumesActionsTest-46902407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:35 devstack sudo[93807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:53:35 devstack sudo[93807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:35 devstack sudo[93807]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d97b4828-f0c3-4c9e-9d55-b02dfc9957f4 tempest-VolumesActionsTest-46902407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.266s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:35 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-d97b4828-f0c3-4c9e-9d55-b02dfc9957f4 tempest-VolumesActionsTest-46902407 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:53:35 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-d97b4828-f0c3-4c9e-9d55-b02dfc9957f4 tempest-VolumesActionsTest-46902407 None] Deleted volume successfully. Jul 30 16:53:35 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d97b4828-f0c3-4c9e-9d55-b02dfc9957f4 tempest-VolumesActionsTest-46902407 None] Lock "cinder-80e5486b-a7ae-4022-9a3f-9eb065803692-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:53:37 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-47a417c3-2b8b-4bb7-a8a4-8d500f382ba5 tempest-VolumesActionsTest-1018607988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:53:37 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-47a417c3-2b8b-4bb7-a8a4-8d500f382ba5 tempest-VolumesActionsTest-1018607988 None] Flow 'volume_create_manager' (9d1989e7-08d1-4d86-bf2e-c0ad845913ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:37 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-47a417c3-2b8b-4bb7-a8a4-8d500f382ba5 tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ef612e2-e5e9-42c9-8d0d-b82fc1be9e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:37 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-47a417c3-2b8b-4bb7-a8a4-8d500f382ba5 tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ef612e2-e5e9-42c9-8d0d-b82fc1be9e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-219317991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37b264dc-0256-4b2e-969d-872847384998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a7b0cb1f35f46b8937ad101219debac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:37Z,use_quota=True,user_id='0fefb055b10240b488b138ebb5f3dfd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:37 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-47a417c3-2b8b-4bb7-a8a4-8d500f382ba5 tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69a72577-e0de-46c6-8041-0fabf5454236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:37 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-47a417c3-2b8b-4bb7-a8a4-8d500f382ba5 tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69a72577-e0de-46c6-8041-0fabf5454236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:37 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-47a417c3-2b8b-4bb7-a8a4-8d500f382ba5 tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11298abb-4f87-41b9-ab73-ae1d60db1a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:37 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-47a417c3-2b8b-4bb7-a8a4-8d500f382ba5 tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11298abb-4f87-41b9-ab73-ae1d60db1a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37b264dc-0256-4b2e-969d-872847384998', 'volume_name': 'volume-37b264dc-0256-4b2e-969d-872847384998', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:37 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-47a417c3-2b8b-4bb7-a8a4-8d500f382ba5 tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ac0b5f5-f0b6-4f02-9463-4e15382aaa99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:37 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-47a417c3-2b8b-4bb7-a8a4-8d500f382ba5 tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ac0b5f5-f0b6-4f02-9463-4e15382aaa99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:37 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-47a417c3-2b8b-4bb7-a8a4-8d500f382ba5 tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b86f3a2d-d65b-4fde-8750-60e740faba00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:37 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-47a417c3-2b8b-4bb7-a8a4-8d500f382ba5 tempest-VolumesActionsTest-1018607988 None] Volume 37b264dc-0256-4b2e-969d-872847384998: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37b264dc-0256-4b2e-969d-872847384998', 'volume_size': 1} Jul 30 16:53:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-47a417c3-2b8b-4bb7-a8a4-8d500f382ba5 tempest-VolumesActionsTest-1018607988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-47a417c3-2b8b-4bb7-a8a4-8d500f382ba5 tempest-VolumesActionsTest-1018607988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:37 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-47a417c3-2b8b-4bb7-a8a4-8d500f382ba5 tempest-VolumesActionsTest-1018607988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-219317991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37b264dc-0256-4b2e-969d-872847384998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a7b0cb1f35f46b8937ad101219debac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:37Z,use_quota=True,user_id='0fefb055b10240b488b138ebb5f3dfd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:53:37 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-47a417c3-2b8b-4bb7-a8a4-8d500f382ba5 tempest-VolumesActionsTest-1018607988 None] Creating volume 37b264dc-0256-4b2e-969d-872847384998 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:53:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-47a417c3-2b8b-4bb7-a8a4-8d500f382ba5 tempest-VolumesActionsTest-1018607988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-47a417c3-2b8b-4bb7-a8a4-8d500f382ba5 tempest-VolumesActionsTest-1018607988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:37 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-47a417c3-2b8b-4bb7-a8a4-8d500f382ba5 tempest-VolumesActionsTest-1018607988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:53:37 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-47a417c3-2b8b-4bb7-a8a4-8d500f382ba5 tempest-VolumesActionsTest-1018607988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:53:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-47a417c3-2b8b-4bb7-a8a4-8d500f382ba5 tempest-VolumesActionsTest-1018607988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:37 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-47a417c3-2b8b-4bb7-a8a4-8d500f382ba5 tempest-VolumesActionsTest-1018607988 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:53:37 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-47a417c3-2b8b-4bb7-a8a4-8d500f382ba5 tempest-VolumesActionsTest-1018607988 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:53:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-47a417c3-2b8b-4bb7-a8a4-8d500f382ba5 tempest-VolumesActionsTest-1018607988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-37b264dc-0256-4b2e-969d-872847384998 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:37 devstack sudo[93831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-37b264dc-0256-4b2e-969d-872847384998 1073741824 Jul 30 16:53:37 devstack sudo[93831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:37 devstack sudo[93831]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-47a417c3-2b8b-4bb7-a8a4-8d500f382ba5 tempest-VolumesActionsTest-1018607988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-37b264dc-0256-4b2e-969d-872847384998 1073741824" returned: 0 in 0.566s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-47a417c3-2b8b-4bb7-a8a4-8d500f382ba5 tempest-VolumesActionsTest-1018607988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-37b264dc-0256-4b2e-969d-872847384998 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:37 devstack sudo[93837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-37b264dc-0256-4b2e-969d-872847384998 Jul 30 16:53:37 devstack sudo[93837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:38 devstack sudo[93837]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-47a417c3-2b8b-4bb7-a8a4-8d500f382ba5 tempest-VolumesActionsTest-1018607988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-37b264dc-0256-4b2e-969d-872847384998" returned: 0 in 0.321s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:38 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-47a417c3-2b8b-4bb7-a8a4-8d500f382ba5 tempest-VolumesActionsTest-1018607988 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:53:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-47a417c3-2b8b-4bb7-a8a4-8d500f382ba5 tempest-VolumesActionsTest-1018607988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:38 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-47a417c3-2b8b-4bb7-a8a4-8d500f382ba5 tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b86f3a2d-d65b-4fde-8750-60e740faba00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37b264dc-0256-4b2e-969d-872847384998', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:38 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-47a417c3-2b8b-4bb7-a8a4-8d500f382ba5 tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4389484a-176a-4c14-8952-1ff9579936d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:38 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-47a417c3-2b8b-4bb7-a8a4-8d500f382ba5 tempest-VolumesActionsTest-1018607988 None] Volume volume-37b264dc-0256-4b2e-969d-872847384998 (37b264dc-0256-4b2e-969d-872847384998): created successfully Jul 30 16:53:38 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-47a417c3-2b8b-4bb7-a8a4-8d500f382ba5 tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4389484a-176a-4c14-8952-1ff9579936d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:38 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-47a417c3-2b8b-4bb7-a8a4-8d500f382ba5 tempest-VolumesActionsTest-1018607988 None] Flow 'volume_create_manager' (9d1989e7-08d1-4d86-bf2e-c0ad845913ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:38 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-47a417c3-2b8b-4bb7-a8a4-8d500f382ba5 tempest-VolumesActionsTest-1018607988 None] Created volume successfully. Jul 30 16:53:39 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f133a09a-1b79-4d4e-9c29-0c08b3c351ab tempest-VolumesActionsTest-46902407 None] Acquiring lock "cinder-37b264dc-0256-4b2e-969d-872847384998-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:53:39 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f133a09a-1b79-4d4e-9c29-0c08b3c351ab tempest-VolumesActionsTest-46902407 None] Lock "cinder-37b264dc-0256-4b2e-969d-872847384998-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:53:39 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f133a09a-1b79-4d4e-9c29-0c08b3c351ab tempest-VolumesActionsTest-46902407 None] Acquiring lock "cinder-quobyte-37b264dc-0256-4b2e-969d-872847384998" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:53:39 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f133a09a-1b79-4d4e-9c29-0c08b3c351ab tempest-VolumesActionsTest-46902407 None] Lock "cinder-quobyte-37b264dc-0256-4b2e-969d-872847384998" acquired by "delete_volume" :: waited 0.025s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:53:39 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[516033ea-3378-41b2-9ed6-73b2e385f8c3]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:53:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f133a09a-1b79-4d4e-9c29-0c08b3c351ab tempest-VolumesActionsTest-46902407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-37b264dc-0256-4b2e-969d-872847384998 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:39 devstack sudo[93842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-37b264dc-0256-4b2e-969d-872847384998 Jul 30 16:53:39 devstack sudo[93842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:40 devstack sudo[93842]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f133a09a-1b79-4d4e-9c29-0c08b3c351ab tempest-VolumesActionsTest-46902407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-37b264dc-0256-4b2e-969d-872847384998" returned: 0 in 0.543s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f133a09a-1b79-4d4e-9c29-0c08b3c351ab tempest-VolumesActionsTest-46902407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-37b264dc-0256-4b2e-969d-872847384998 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:40 devstack sudo[93881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-37b264dc-0256-4b2e-969d-872847384998 Jul 30 16:53:40 devstack sudo[93881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:40 devstack sudo[93881]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f133a09a-1b79-4d4e-9c29-0c08b3c351ab tempest-VolumesActionsTest-46902407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-37b264dc-0256-4b2e-969d-872847384998" returned: 0 in 0.290s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:40 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f133a09a-1b79-4d4e-9c29-0c08b3c351ab tempest-VolumesActionsTest-46902407 None] Lock "cinder-quobyte-37b264dc-0256-4b2e-969d-872847384998" released by "delete_volume" :: held 0.898s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:53:40 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-f133a09a-1b79-4d4e-9c29-0c08b3c351ab tempest-VolumesActionsTest-46902407 None] Created reservations ['57ead74b-cf68-4e09-96fb-b0ef5edcd6b9', 'dbfa7311-7c27-43a4-8d96-3051053e1d54', '85c4db23-9a7a-45dc-8649-d548afea4b3d', '8a02267c-8f0f-48f2-bc12-ca741b509be7'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:53:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f133a09a-1b79-4d4e-9c29-0c08b3c351ab tempest-VolumesActionsTest-46902407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f133a09a-1b79-4d4e-9c29-0c08b3c351ab tempest-VolumesActionsTest-46902407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:40 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f133a09a-1b79-4d4e-9c29-0c08b3c351ab tempest-VolumesActionsTest-46902407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:53:40 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f133a09a-1b79-4d4e-9c29-0c08b3c351ab tempest-VolumesActionsTest-46902407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:53:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f133a09a-1b79-4d4e-9c29-0c08b3c351ab tempest-VolumesActionsTest-46902407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f133a09a-1b79-4d4e-9c29-0c08b3c351ab tempest-VolumesActionsTest-46902407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:40 devstack sudo[93886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:53:40 devstack sudo[93886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:41 devstack sudo[93886]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f133a09a-1b79-4d4e-9c29-0c08b3c351ab tempest-VolumesActionsTest-46902407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.335s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:41 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-f133a09a-1b79-4d4e-9c29-0c08b3c351ab tempest-VolumesActionsTest-46902407 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:53:41 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-f133a09a-1b79-4d4e-9c29-0c08b3c351ab tempest-VolumesActionsTest-46902407 None] Deleted volume successfully. Jul 30 16:53:41 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f133a09a-1b79-4d4e-9c29-0c08b3c351ab tempest-VolumesActionsTest-46902407 None] Lock "cinder-37b264dc-0256-4b2e-969d-872847384998-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:53:41 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-904b7d37-e5fc-4604-ae2f-5435f4241f20 tempest-VolumesActionsTest-1018607988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:53:41 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-904b7d37-e5fc-4604-ae2f-5435f4241f20 tempest-VolumesActionsTest-1018607988 None] Flow 'volume_create_manager' (de327e17-ea20-4231-b7b0-b5cf93ce9e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:41 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-904b7d37-e5fc-4604-ae2f-5435f4241f20 tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2900ccd-8395-4d91-a34e-3e34721295fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:41 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-904b7d37-e5fc-4604-ae2f-5435f4241f20 tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2900ccd-8395-4d91-a34e-3e34721295fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-943184046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=683dde20-fe17-459a-af7d-4c88af569277,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a7b0cb1f35f46b8937ad101219debac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:41Z,use_quota=True,user_id='0fefb055b10240b488b138ebb5f3dfd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:41 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-904b7d37-e5fc-4604-ae2f-5435f4241f20 tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbc533eb-0436-403e-a7fb-cf901ccfca6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:41 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-904b7d37-e5fc-4604-ae2f-5435f4241f20 tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbc533eb-0436-403e-a7fb-cf901ccfca6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:41 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-904b7d37-e5fc-4604-ae2f-5435f4241f20 tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a0d04ed-384d-44ed-b938-17d984ae37a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:41 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-904b7d37-e5fc-4604-ae2f-5435f4241f20 tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a0d04ed-384d-44ed-b938-17d984ae37a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '683dde20-fe17-459a-af7d-4c88af569277', 'volume_name': 'volume-683dde20-fe17-459a-af7d-4c88af569277', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:41 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-904b7d37-e5fc-4604-ae2f-5435f4241f20 tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f64dea8-cee0-45aa-bdfc-b88b0aab0b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:41 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-904b7d37-e5fc-4604-ae2f-5435f4241f20 tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f64dea8-cee0-45aa-bdfc-b88b0aab0b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:41 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-904b7d37-e5fc-4604-ae2f-5435f4241f20 tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab9b863b-5046-4a5d-be25-ba29d4eb3052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:41 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-904b7d37-e5fc-4604-ae2f-5435f4241f20 tempest-VolumesActionsTest-1018607988 None] Volume 683dde20-fe17-459a-af7d-4c88af569277: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-683dde20-fe17-459a-af7d-4c88af569277', 'volume_size': 1} Jul 30 16:53:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-904b7d37-e5fc-4604-ae2f-5435f4241f20 tempest-VolumesActionsTest-1018607988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-904b7d37-e5fc-4604-ae2f-5435f4241f20 tempest-VolumesActionsTest-1018607988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:41 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-904b7d37-e5fc-4604-ae2f-5435f4241f20 tempest-VolumesActionsTest-1018607988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-943184046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=683dde20-fe17-459a-af7d-4c88af569277,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a7b0cb1f35f46b8937ad101219debac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:41Z,use_quota=True,user_id='0fefb055b10240b488b138ebb5f3dfd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:53:41 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-904b7d37-e5fc-4604-ae2f-5435f4241f20 tempest-VolumesActionsTest-1018607988 None] Creating volume 683dde20-fe17-459a-af7d-4c88af569277 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:53:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-904b7d37-e5fc-4604-ae2f-5435f4241f20 tempest-VolumesActionsTest-1018607988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-904b7d37-e5fc-4604-ae2f-5435f4241f20 tempest-VolumesActionsTest-1018607988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:41 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-904b7d37-e5fc-4604-ae2f-5435f4241f20 tempest-VolumesActionsTest-1018607988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:53:41 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-904b7d37-e5fc-4604-ae2f-5435f4241f20 tempest-VolumesActionsTest-1018607988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:53:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-904b7d37-e5fc-4604-ae2f-5435f4241f20 tempest-VolumesActionsTest-1018607988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:41 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-904b7d37-e5fc-4604-ae2f-5435f4241f20 tempest-VolumesActionsTest-1018607988 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:53:41 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-904b7d37-e5fc-4604-ae2f-5435f4241f20 tempest-VolumesActionsTest-1018607988 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:53:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-904b7d37-e5fc-4604-ae2f-5435f4241f20 tempest-VolumesActionsTest-1018607988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-683dde20-fe17-459a-af7d-4c88af569277 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:41 devstack sudo[93890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-683dde20-fe17-459a-af7d-4c88af569277 1073741824 Jul 30 16:53:41 devstack sudo[93890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:42 devstack sudo[93890]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-904b7d37-e5fc-4604-ae2f-5435f4241f20 tempest-VolumesActionsTest-1018607988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-683dde20-fe17-459a-af7d-4c88af569277 1073741824" returned: 0 in 0.427s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-904b7d37-e5fc-4604-ae2f-5435f4241f20 tempest-VolumesActionsTest-1018607988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-683dde20-fe17-459a-af7d-4c88af569277 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:42 devstack sudo[93895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-683dde20-fe17-459a-af7d-4c88af569277 Jul 30 16:53:42 devstack sudo[93895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:42 devstack sudo[93895]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-904b7d37-e5fc-4604-ae2f-5435f4241f20 tempest-VolumesActionsTest-1018607988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-683dde20-fe17-459a-af7d-4c88af569277" returned: 0 in 0.306s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:42 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-904b7d37-e5fc-4604-ae2f-5435f4241f20 tempest-VolumesActionsTest-1018607988 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:53:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-904b7d37-e5fc-4604-ae2f-5435f4241f20 tempest-VolumesActionsTest-1018607988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:42 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-904b7d37-e5fc-4604-ae2f-5435f4241f20 tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab9b863b-5046-4a5d-be25-ba29d4eb3052) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-683dde20-fe17-459a-af7d-4c88af569277', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:42 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-904b7d37-e5fc-4604-ae2f-5435f4241f20 tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93b595b8-500c-4bd6-b256-479803dcddb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:42 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-904b7d37-e5fc-4604-ae2f-5435f4241f20 tempest-VolumesActionsTest-1018607988 None] Volume volume-683dde20-fe17-459a-af7d-4c88af569277 (683dde20-fe17-459a-af7d-4c88af569277): created successfully Jul 30 16:53:42 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-904b7d37-e5fc-4604-ae2f-5435f4241f20 tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93b595b8-500c-4bd6-b256-479803dcddb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:42 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-904b7d37-e5fc-4604-ae2f-5435f4241f20 tempest-VolumesActionsTest-1018607988 None] Flow 'volume_create_manager' (de327e17-ea20-4231-b7b0-b5cf93ce9e87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:42 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-904b7d37-e5fc-4604-ae2f-5435f4241f20 tempest-VolumesActionsTest-1018607988 None] Created volume successfully. Jul 30 16:53:43 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7e352550-f696-4e60-aaaa-0550e5709f84 tempest-VolumesActionsTest-46902407 None] Acquiring lock "cinder-683dde20-fe17-459a-af7d-4c88af569277-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:53:43 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7e352550-f696-4e60-aaaa-0550e5709f84 tempest-VolumesActionsTest-46902407 None] Lock "cinder-683dde20-fe17-459a-af7d-4c88af569277-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:53:43 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7e352550-f696-4e60-aaaa-0550e5709f84 tempest-VolumesActionsTest-46902407 None] Acquiring lock "cinder-quobyte-683dde20-fe17-459a-af7d-4c88af569277" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:53:43 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7e352550-f696-4e60-aaaa-0550e5709f84 tempest-VolumesActionsTest-46902407 None] Lock "cinder-quobyte-683dde20-fe17-459a-af7d-4c88af569277" acquired by "delete_volume" :: waited 0.035s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:53:44 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4eaba2e-5193-4628-89d9-0cc983e8489d]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:53:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7e352550-f696-4e60-aaaa-0550e5709f84 tempest-VolumesActionsTest-46902407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-683dde20-fe17-459a-af7d-4c88af569277 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:44 devstack sudo[93901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-683dde20-fe17-459a-af7d-4c88af569277 Jul 30 16:53:44 devstack sudo[93901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:44 devstack sudo[93901]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7e352550-f696-4e60-aaaa-0550e5709f84 tempest-VolumesActionsTest-46902407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-683dde20-fe17-459a-af7d-4c88af569277" returned: 0 in 0.423s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7e352550-f696-4e60-aaaa-0550e5709f84 tempest-VolumesActionsTest-46902407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-683dde20-fe17-459a-af7d-4c88af569277 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:44 devstack sudo[93907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-683dde20-fe17-459a-af7d-4c88af569277 Jul 30 16:53:44 devstack sudo[93907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:44 devstack sudo[93907]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7e352550-f696-4e60-aaaa-0550e5709f84 tempest-VolumesActionsTest-46902407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-683dde20-fe17-459a-af7d-4c88af569277" returned: 0 in 0.271s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:44 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7e352550-f696-4e60-aaaa-0550e5709f84 tempest-VolumesActionsTest-46902407 None] Lock "cinder-quobyte-683dde20-fe17-459a-af7d-4c88af569277" released by "delete_volume" :: held 0.763s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:53:44 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:SELECT=51,cinder:UPDATE=45,cinder:DELETE=6,cinder:INSERT=9 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:53:44 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-7e352550-f696-4e60-aaaa-0550e5709f84 tempest-VolumesActionsTest-46902407 None] Created reservations ['e7d790bd-4256-4ecf-a094-cc599ce59e9e', '430dbcf9-f4ea-4d9d-906d-fd39b1f931f0', 'af3c7e42-93eb-42ef-908c-278c087c7489', 'dc98eabc-043e-4829-a923-5845cbc23395'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:53:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7e352550-f696-4e60-aaaa-0550e5709f84 tempest-VolumesActionsTest-46902407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7e352550-f696-4e60-aaaa-0550e5709f84 tempest-VolumesActionsTest-46902407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:44 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7e352550-f696-4e60-aaaa-0550e5709f84 tempest-VolumesActionsTest-46902407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:53:44 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7e352550-f696-4e60-aaaa-0550e5709f84 tempest-VolumesActionsTest-46902407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:53:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7e352550-f696-4e60-aaaa-0550e5709f84 tempest-VolumesActionsTest-46902407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7e352550-f696-4e60-aaaa-0550e5709f84 tempest-VolumesActionsTest-46902407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:44 devstack sudo[93911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:53:44 devstack sudo[93911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:45 devstack sudo[93911]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7e352550-f696-4e60-aaaa-0550e5709f84 tempest-VolumesActionsTest-46902407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.310s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:45 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-7e352550-f696-4e60-aaaa-0550e5709f84 tempest-VolumesActionsTest-46902407 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:53:45 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-7e352550-f696-4e60-aaaa-0550e5709f84 tempest-VolumesActionsTest-46902407 None] Deleted volume successfully. Jul 30 16:53:45 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7e352550-f696-4e60-aaaa-0550e5709f84 tempest-VolumesActionsTest-46902407 None] Lock "cinder-683dde20-fe17-459a-af7d-4c88af569277-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:53:45 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-12a6f35e-a037-44c2-9040-eb1932c558c7 tempest-VolumesActionsTest-1018607988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:53:45 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-12a6f35e-a037-44c2-9040-eb1932c558c7 tempest-VolumesActionsTest-1018607988 None] Flow 'volume_create_manager' (3f7f5cde-886f-40dd-8287-bfb826d8474a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:45 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-12a6f35e-a037-44c2-9040-eb1932c558c7 tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b850040-619e-4795-aec4-39329bc8bab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:45 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-12a6f35e-a037-44c2-9040-eb1932c558c7 tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b850040-619e-4795-aec4-39329bc8bab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1613283780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fef92621-a28d-4e14-b09c-776e191a1942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a7b0cb1f35f46b8937ad101219debac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:46Z,use_quota=True,user_id='0fefb055b10240b488b138ebb5f3dfd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:45 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-12a6f35e-a037-44c2-9040-eb1932c558c7 tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f71441-2fec-457e-aae5-4cec56025cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:45 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-12a6f35e-a037-44c2-9040-eb1932c558c7 tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f71441-2fec-457e-aae5-4cec56025cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:45 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-12a6f35e-a037-44c2-9040-eb1932c558c7 tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fca9dff-6113-4840-a361-c62cd069d399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:45 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-12a6f35e-a037-44c2-9040-eb1932c558c7 tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fca9dff-6113-4840-a361-c62cd069d399) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fef92621-a28d-4e14-b09c-776e191a1942', 'volume_name': 'volume-fef92621-a28d-4e14-b09c-776e191a1942', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:45 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-12a6f35e-a037-44c2-9040-eb1932c558c7 tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfc036df-31dc-454d-995b-7455f3a947ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:45 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-12a6f35e-a037-44c2-9040-eb1932c558c7 tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfc036df-31dc-454d-995b-7455f3a947ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:45 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-12a6f35e-a037-44c2-9040-eb1932c558c7 tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e57c10fe-16e8-48be-85c8-55ab9a1617fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:45 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-12a6f35e-a037-44c2-9040-eb1932c558c7 tempest-VolumesActionsTest-1018607988 None] Volume fef92621-a28d-4e14-b09c-776e191a1942: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fef92621-a28d-4e14-b09c-776e191a1942', 'volume_size': 1} Jul 30 16:53:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-12a6f35e-a037-44c2-9040-eb1932c558c7 tempest-VolumesActionsTest-1018607988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-12a6f35e-a037-44c2-9040-eb1932c558c7 tempest-VolumesActionsTest-1018607988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:45 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-12a6f35e-a037-44c2-9040-eb1932c558c7 tempest-VolumesActionsTest-1018607988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1613283780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fef92621-a28d-4e14-b09c-776e191a1942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a7b0cb1f35f46b8937ad101219debac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:46Z,use_quota=True,user_id='0fefb055b10240b488b138ebb5f3dfd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:53:45 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-12a6f35e-a037-44c2-9040-eb1932c558c7 tempest-VolumesActionsTest-1018607988 None] Creating volume fef92621-a28d-4e14-b09c-776e191a1942 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:53:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-12a6f35e-a037-44c2-9040-eb1932c558c7 tempest-VolumesActionsTest-1018607988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-12a6f35e-a037-44c2-9040-eb1932c558c7 tempest-VolumesActionsTest-1018607988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:45 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-12a6f35e-a037-44c2-9040-eb1932c558c7 tempest-VolumesActionsTest-1018607988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:53:45 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-12a6f35e-a037-44c2-9040-eb1932c558c7 tempest-VolumesActionsTest-1018607988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:53:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-12a6f35e-a037-44c2-9040-eb1932c558c7 tempest-VolumesActionsTest-1018607988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:45 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-12a6f35e-a037-44c2-9040-eb1932c558c7 tempest-VolumesActionsTest-1018607988 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:53:45 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-12a6f35e-a037-44c2-9040-eb1932c558c7 tempest-VolumesActionsTest-1018607988 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:53:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-12a6f35e-a037-44c2-9040-eb1932c558c7 tempest-VolumesActionsTest-1018607988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef92621-a28d-4e14-b09c-776e191a1942 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:45 devstack sudo[93936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef92621-a28d-4e14-b09c-776e191a1942 1073741824 Jul 30 16:53:45 devstack sudo[93936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:46 devstack sudo[93936]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-12a6f35e-a037-44c2-9040-eb1932c558c7 tempest-VolumesActionsTest-1018607988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef92621-a28d-4e14-b09c-776e191a1942 1073741824" returned: 0 in 0.532s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-12a6f35e-a037-44c2-9040-eb1932c558c7 tempest-VolumesActionsTest-1018607988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef92621-a28d-4e14-b09c-776e191a1942 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:46 devstack sudo[93949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef92621-a28d-4e14-b09c-776e191a1942 Jul 30 16:53:46 devstack sudo[93949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:46 devstack sudo[93949]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-12a6f35e-a037-44c2-9040-eb1932c558c7 tempest-VolumesActionsTest-1018607988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef92621-a28d-4e14-b09c-776e191a1942" returned: 0 in 0.275s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:46 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-12a6f35e-a037-44c2-9040-eb1932c558c7 tempest-VolumesActionsTest-1018607988 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:53:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-12a6f35e-a037-44c2-9040-eb1932c558c7 tempest-VolumesActionsTest-1018607988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:46 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-12a6f35e-a037-44c2-9040-eb1932c558c7 tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e57c10fe-16e8-48be-85c8-55ab9a1617fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fef92621-a28d-4e14-b09c-776e191a1942', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:46 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-12a6f35e-a037-44c2-9040-eb1932c558c7 tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee6377ff-6b2b-4110-944e-e38c849a4447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:46 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-12a6f35e-a037-44c2-9040-eb1932c558c7 tempest-VolumesActionsTest-1018607988 None] Volume volume-fef92621-a28d-4e14-b09c-776e191a1942 (fef92621-a28d-4e14-b09c-776e191a1942): created successfully Jul 30 16:53:46 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-12a6f35e-a037-44c2-9040-eb1932c558c7 tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee6377ff-6b2b-4110-944e-e38c849a4447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:46 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-12a6f35e-a037-44c2-9040-eb1932c558c7 tempest-VolumesActionsTest-1018607988 None] Flow 'volume_create_manager' (3f7f5cde-886f-40dd-8287-bfb826d8474a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:46 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-12a6f35e-a037-44c2-9040-eb1932c558c7 tempest-VolumesActionsTest-1018607988 None] Created volume successfully. Jul 30 16:53:48 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-982dae67-7b6c-449f-9348-64fddc4fe641 tempest-VolumesActionsTest-46902407 None] Acquiring lock "cinder-fef92621-a28d-4e14-b09c-776e191a1942-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:53:48 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-982dae67-7b6c-449f-9348-64fddc4fe641 tempest-VolumesActionsTest-46902407 None] Lock "cinder-fef92621-a28d-4e14-b09c-776e191a1942-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:53:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-8cdef543-d60d-4f96-8f95-8919ebe3bf3f req-0ac9c8bc-1115-4446-b18f-aa4b0d1f1699 tempest-ServerActionsTestOtherA-277957863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-8cdef543-d60d-4f96-8f95-8919ebe3bf3f req-0ac9c8bc-1115-4446-b18f-aa4b0d1f1699 tempest-ServerActionsTestOtherA-277957863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-8cdef543-d60d-4f96-8f95-8919ebe3bf3f req-0ac9c8bc-1115-4446-b18f-aa4b0d1f1699 tempest-ServerActionsTestOtherA-277957863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:48 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-982dae67-7b6c-449f-9348-64fddc4fe641 tempest-VolumesActionsTest-46902407 None] Acquiring lock "cinder-quobyte-fef92621-a28d-4e14-b09c-776e191a1942" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:53:48 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-982dae67-7b6c-449f-9348-64fddc4fe641 tempest-VolumesActionsTest-46902407 None] Lock "cinder-quobyte-fef92621-a28d-4e14-b09c-776e191a1942" acquired by "delete_volume" :: waited 0.026s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:53:48 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f80943-e1a7-4c22-9323-2914fb88e533]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:53:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-982dae67-7b6c-449f-9348-64fddc4fe641 tempest-VolumesActionsTest-46902407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef92621-a28d-4e14-b09c-776e191a1942 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:48 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-8cdef543-d60d-4f96-8f95-8919ebe3bf3f req-0ac9c8bc-1115-4446-b18f-aa4b0d1f1699 tempest-ServerActionsTestOtherA-277957863 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202', 'name': 'volume-a9f8f412-523d-4ad2-9041-c2a96f63ce4f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bf97b205-f8f9-4178-bcaa-4e665c015d3e', 'enforce_multipath': True} {{(pid=88591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:53:48 devstack cinder-volume[88591]: INFO cinder.volume.manager [req-8cdef543-d60d-4f96-8f95-8919ebe3bf3f req-0ac9c8bc-1115-4446-b18f-aa4b0d1f1699 tempest-ServerActionsTestOtherA-277957863 None] attachment_update completed successfully. Jul 30 16:53:48 devstack sudo[93968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef92621-a28d-4e14-b09c-776e191a1942 Jul 30 16:53:48 devstack sudo[93968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:48 devstack sudo[93968]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-982dae67-7b6c-449f-9348-64fddc4fe641 tempest-VolumesActionsTest-46902407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef92621-a28d-4e14-b09c-776e191a1942" returned: 0 in 0.463s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-982dae67-7b6c-449f-9348-64fddc4fe641 tempest-VolumesActionsTest-46902407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef92621-a28d-4e14-b09c-776e191a1942 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:48 devstack sudo[94355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef92621-a28d-4e14-b09c-776e191a1942 Jul 30 16:53:48 devstack sudo[94355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:48 devstack sudo[94355]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-982dae67-7b6c-449f-9348-64fddc4fe641 tempest-VolumesActionsTest-46902407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef92621-a28d-4e14-b09c-776e191a1942" returned: 0 in 0.274s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:48 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-982dae67-7b6c-449f-9348-64fddc4fe641 tempest-VolumesActionsTest-46902407 None] Lock "cinder-quobyte-fef92621-a28d-4e14-b09c-776e191a1942" released by "delete_volume" :: held 0.787s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:53:49 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-982dae67-7b6c-449f-9348-64fddc4fe641 tempest-VolumesActionsTest-46902407 None] Created reservations ['22562a27-811d-4dc2-b867-c04b55d2749e', '7a6c9e7a-181d-445f-80c9-2b3d2a7206d2', '23c0aa95-b966-4d79-91cd-c116377d882e', '2aaf9529-fd35-43cb-9d1b-d59ce73454e8'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:53:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-982dae67-7b6c-449f-9348-64fddc4fe641 tempest-VolumesActionsTest-46902407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-982dae67-7b6c-449f-9348-64fddc4fe641 tempest-VolumesActionsTest-46902407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:49 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-982dae67-7b6c-449f-9348-64fddc4fe641 tempest-VolumesActionsTest-46902407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:53:49 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-982dae67-7b6c-449f-9348-64fddc4fe641 tempest-VolumesActionsTest-46902407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:53:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-982dae67-7b6c-449f-9348-64fddc4fe641 tempest-VolumesActionsTest-46902407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-982dae67-7b6c-449f-9348-64fddc4fe641 tempest-VolumesActionsTest-46902407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:49 devstack sudo[94362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:53:49 devstack sudo[94362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:49 devstack sudo[94362]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-982dae67-7b6c-449f-9348-64fddc4fe641 tempest-VolumesActionsTest-46902407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.338s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:49 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-982dae67-7b6c-449f-9348-64fddc4fe641 tempest-VolumesActionsTest-46902407 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:53:49 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-982dae67-7b6c-449f-9348-64fddc4fe641 tempest-VolumesActionsTest-46902407 None] Deleted volume successfully. Jul 30 16:53:49 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-982dae67-7b6c-449f-9348-64fddc4fe641 tempest-VolumesActionsTest-46902407 None] Lock "cinder-fef92621-a28d-4e14-b09c-776e191a1942-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:53:49 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c5ce547-f6eb-4356-8037-baf27f8c3e7b tempest-VolumesActionsTest-1018607988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:53:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2c5ce547-f6eb-4356-8037-baf27f8c3e7b tempest-VolumesActionsTest-1018607988 None] Flow 'volume_create_manager' (3db61061-1341-4936-950f-b67c00c68224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2c5ce547-f6eb-4356-8037-baf27f8c3e7b tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3eccbee-d54b-4411-81c2-f3c2d914ae28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2c5ce547-f6eb-4356-8037-baf27f8c3e7b tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3eccbee-d54b-4411-81c2-f3c2d914ae28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-983481840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58e16bb4-8409-49de-87c1-3a59b0539086,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a7b0cb1f35f46b8937ad101219debac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:50Z,use_quota=True,user_id='0fefb055b10240b488b138ebb5f3dfd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2c5ce547-f6eb-4356-8037-baf27f8c3e7b tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df017c6f-b841-4751-b41f-7ee43b12a1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2c5ce547-f6eb-4356-8037-baf27f8c3e7b tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df017c6f-b841-4751-b41f-7ee43b12a1ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2c5ce547-f6eb-4356-8037-baf27f8c3e7b tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77a65c36-b8a0-484a-ba16-28d5a0c0bcc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2c5ce547-f6eb-4356-8037-baf27f8c3e7b tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77a65c36-b8a0-484a-ba16-28d5a0c0bcc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58e16bb4-8409-49de-87c1-3a59b0539086', 'volume_name': 'volume-58e16bb4-8409-49de-87c1-3a59b0539086', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2c5ce547-f6eb-4356-8037-baf27f8c3e7b tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d38aa6b4-5a24-4daf-a090-c42ade5a0947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2c5ce547-f6eb-4356-8037-baf27f8c3e7b tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d38aa6b4-5a24-4daf-a090-c42ade5a0947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2c5ce547-f6eb-4356-8037-baf27f8c3e7b tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13df7144-8e62-4778-a365-59954409489e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:49 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-2c5ce547-f6eb-4356-8037-baf27f8c3e7b tempest-VolumesActionsTest-1018607988 None] Volume 58e16bb4-8409-49de-87c1-3a59b0539086: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58e16bb4-8409-49de-87c1-3a59b0539086', 'volume_size': 1} Jul 30 16:53:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2c5ce547-f6eb-4356-8037-baf27f8c3e7b tempest-VolumesActionsTest-1018607988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2c5ce547-f6eb-4356-8037-baf27f8c3e7b tempest-VolumesActionsTest-1018607988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:49 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-2c5ce547-f6eb-4356-8037-baf27f8c3e7b tempest-VolumesActionsTest-1018607988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-983481840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58e16bb4-8409-49de-87c1-3a59b0539086,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a7b0cb1f35f46b8937ad101219debac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:50Z,use_quota=True,user_id='0fefb055b10240b488b138ebb5f3dfd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:53:49 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-2c5ce547-f6eb-4356-8037-baf27f8c3e7b tempest-VolumesActionsTest-1018607988 None] Creating volume 58e16bb4-8409-49de-87c1-3a59b0539086 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:53:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2c5ce547-f6eb-4356-8037-baf27f8c3e7b tempest-VolumesActionsTest-1018607988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2c5ce547-f6eb-4356-8037-baf27f8c3e7b tempest-VolumesActionsTest-1018607988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:49 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-2c5ce547-f6eb-4356-8037-baf27f8c3e7b tempest-VolumesActionsTest-1018607988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:53:49 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-2c5ce547-f6eb-4356-8037-baf27f8c3e7b tempest-VolumesActionsTest-1018607988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:53:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2c5ce547-f6eb-4356-8037-baf27f8c3e7b tempest-VolumesActionsTest-1018607988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:49 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-2c5ce547-f6eb-4356-8037-baf27f8c3e7b tempest-VolumesActionsTest-1018607988 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:53:49 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-2c5ce547-f6eb-4356-8037-baf27f8c3e7b tempest-VolumesActionsTest-1018607988 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:53:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2c5ce547-f6eb-4356-8037-baf27f8c3e7b tempest-VolumesActionsTest-1018607988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-58e16bb4-8409-49de-87c1-3a59b0539086 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:50 devstack sudo[94371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-58e16bb4-8409-49de-87c1-3a59b0539086 1073741824 Jul 30 16:53:50 devstack sudo[94371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:50 devstack sudo[94371]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2c5ce547-f6eb-4356-8037-baf27f8c3e7b tempest-VolumesActionsTest-1018607988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-58e16bb4-8409-49de-87c1-3a59b0539086 1073741824" returned: 0 in 0.550s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2c5ce547-f6eb-4356-8037-baf27f8c3e7b tempest-VolumesActionsTest-1018607988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-58e16bb4-8409-49de-87c1-3a59b0539086 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:50 devstack sudo[94377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-58e16bb4-8409-49de-87c1-3a59b0539086 Jul 30 16:53:50 devstack sudo[94377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:51 devstack sudo[94377]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2c5ce547-f6eb-4356-8037-baf27f8c3e7b tempest-VolumesActionsTest-1018607988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-58e16bb4-8409-49de-87c1-3a59b0539086" returned: 0 in 0.426s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:51 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-2c5ce547-f6eb-4356-8037-baf27f8c3e7b tempest-VolumesActionsTest-1018607988 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:53:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2c5ce547-f6eb-4356-8037-baf27f8c3e7b tempest-VolumesActionsTest-1018607988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:51 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2c5ce547-f6eb-4356-8037-baf27f8c3e7b tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13df7144-8e62-4778-a365-59954409489e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58e16bb4-8409-49de-87c1-3a59b0539086', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:51 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2c5ce547-f6eb-4356-8037-baf27f8c3e7b tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d298308f-679d-456b-a4f8-eaeb53614126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:51 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-2c5ce547-f6eb-4356-8037-baf27f8c3e7b tempest-VolumesActionsTest-1018607988 None] Volume volume-58e16bb4-8409-49de-87c1-3a59b0539086 (58e16bb4-8409-49de-87c1-3a59b0539086): created successfully Jul 30 16:53:51 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2c5ce547-f6eb-4356-8037-baf27f8c3e7b tempest-VolumesActionsTest-1018607988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d298308f-679d-456b-a4f8-eaeb53614126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:51 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2c5ce547-f6eb-4356-8037-baf27f8c3e7b tempest-VolumesActionsTest-1018607988 None] Flow 'volume_create_manager' (3db61061-1341-4936-950f-b67c00c68224) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:51 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-2c5ce547-f6eb-4356-8037-baf27f8c3e7b tempest-VolumesActionsTest-1018607988 None] Created volume successfully. Jul 30 16:53:52 devstack cinder-volume[88591]: INFO cinder.volume.manager [req-00fd6099-faeb-4c74-a5d3-5488abc99c21 req-fae9a5a8-cfdb-410d-b598-f10119a3b7a5 tempest-ServerActionsTestOtherA-277957863 None] Terminate volume connection completed successfully. Jul 30 16:53:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-00fd6099-faeb-4c74-a5d3-5488abc99c21 req-fae9a5a8-cfdb-410d-b598-f10119a3b7a5 tempest-ServerActionsTestOtherA-277957863 None] Deleting attachment bf97b205-f8f9-4178-bcaa-4e665c015d3e. {{(pid=88591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:53:52 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-5300da3a-1673-4f15-adf0-c069d14db6cd tempest-VolumesActionsTest-1018607988 None] Acquiring lock "cinder-58e16bb4-8409-49de-87c1-3a59b0539086-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:53:52 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-5300da3a-1673-4f15-adf0-c069d14db6cd tempest-VolumesActionsTest-1018607988 None] Lock "cinder-58e16bb4-8409-49de-87c1-3a59b0539086-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:53:52 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-5300da3a-1673-4f15-adf0-c069d14db6cd tempest-VolumesActionsTest-1018607988 None] Acquiring lock "cinder-quobyte-58e16bb4-8409-49de-87c1-3a59b0539086" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:53:52 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-5300da3a-1673-4f15-adf0-c069d14db6cd tempest-VolumesActionsTest-1018607988 None] Lock "cinder-quobyte-58e16bb4-8409-49de-87c1-3a59b0539086" acquired by "delete_volume" :: waited 0.026s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:53:53 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e5fbd7-fd27-4b7d-87c3-2963ca7957f3]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:53:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5300da3a-1673-4f15-adf0-c069d14db6cd tempest-VolumesActionsTest-1018607988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-58e16bb4-8409-49de-87c1-3a59b0539086 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:53 devstack sudo[94456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-58e16bb4-8409-49de-87c1-3a59b0539086 Jul 30 16:53:53 devstack sudo[94456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-00fd6099-faeb-4c74-a5d3-5488abc99c21 req-95179ee3-6cfc-4f5a-ab00-a4f6c43b5876 tempest-ServerActionsTestOtherA-277957863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-00fd6099-faeb-4c74-a5d3-5488abc99c21 req-95179ee3-6cfc-4f5a-ab00-a4f6c43b5876 tempest-ServerActionsTestOtherA-277957863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-00fd6099-faeb-4c74-a5d3-5488abc99c21 req-95179ee3-6cfc-4f5a-ab00-a4f6c43b5876 tempest-ServerActionsTestOtherA-277957863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:53 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-00fd6099-faeb-4c74-a5d3-5488abc99c21 req-95179ee3-6cfc-4f5a-ab00-a4f6c43b5876 tempest-ServerActionsTestOtherA-277957863 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202', 'name': 'volume-a9f8f412-523d-4ad2-9041-c2a96f63ce4f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8abbaf1b-b0b8-4724-aeb4-c69e2bedb447', 'enforce_multipath': True} {{(pid=88591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:53:53 devstack cinder-volume[88591]: INFO cinder.volume.manager [req-00fd6099-faeb-4c74-a5d3-5488abc99c21 req-95179ee3-6cfc-4f5a-ab00-a4f6c43b5876 tempest-ServerActionsTestOtherA-277957863 None] attachment_update completed successfully. Jul 30 16:53:53 devstack sudo[94456]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5300da3a-1673-4f15-adf0-c069d14db6cd tempest-VolumesActionsTest-1018607988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-58e16bb4-8409-49de-87c1-3a59b0539086" returned: 0 in 0.444s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5300da3a-1673-4f15-adf0-c069d14db6cd tempest-VolumesActionsTest-1018607988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-58e16bb4-8409-49de-87c1-3a59b0539086 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:53 devstack sudo[94470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-58e16bb4-8409-49de-87c1-3a59b0539086 Jul 30 16:53:53 devstack sudo[94470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:53 devstack sudo[94470]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5300da3a-1673-4f15-adf0-c069d14db6cd tempest-VolumesActionsTest-1018607988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-58e16bb4-8409-49de-87c1-3a59b0539086" returned: 0 in 0.258s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:53 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-5300da3a-1673-4f15-adf0-c069d14db6cd tempest-VolumesActionsTest-1018607988 None] Lock "cinder-quobyte-58e16bb4-8409-49de-87c1-3a59b0539086" released by "delete_volume" :: held 0.766s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:53:53 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-5300da3a-1673-4f15-adf0-c069d14db6cd tempest-VolumesActionsTest-1018607988 None] Created reservations ['e6c01fc5-7ec1-40e4-8cc0-48b50e2c14f1', 'f7193e72-2cc5-4b98-a3c2-e51e60b60873', 'a65a29f5-cbb2-46f6-846d-40e66f424c0f', 'e6be8a98-97c0-41d8-9974-6df032496c12'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:53:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5300da3a-1673-4f15-adf0-c069d14db6cd tempest-VolumesActionsTest-1018607988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5300da3a-1673-4f15-adf0-c069d14db6cd tempest-VolumesActionsTest-1018607988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:53 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-5300da3a-1673-4f15-adf0-c069d14db6cd tempest-VolumesActionsTest-1018607988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:53:53 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-5300da3a-1673-4f15-adf0-c069d14db6cd tempest-VolumesActionsTest-1018607988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:53:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5300da3a-1673-4f15-adf0-c069d14db6cd tempest-VolumesActionsTest-1018607988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5300da3a-1673-4f15-adf0-c069d14db6cd tempest-VolumesActionsTest-1018607988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:53 devstack sudo[94476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:53:53 devstack sudo[94476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:54 devstack sudo[94476]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5300da3a-1673-4f15-adf0-c069d14db6cd tempest-VolumesActionsTest-1018607988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.270s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:54 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-5300da3a-1673-4f15-adf0-c069d14db6cd tempest-VolumesActionsTest-1018607988 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:53:54 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-5300da3a-1673-4f15-adf0-c069d14db6cd tempest-VolumesActionsTest-1018607988 None] Deleted volume successfully. Jul 30 16:53:54 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-5300da3a-1673-4f15-adf0-c069d14db6cd tempest-VolumesActionsTest-1018607988 None] Lock "cinder-58e16bb4-8409-49de-87c1-3a59b0539086-delete_volume" released by "delete_volume" :: held 1.298s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:02 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-88a69de7-31e6-4291-85c2-ccdf2bca3269 tempest-AttachVolumeNegativeTest-1135644984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:54:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-88a69de7-31e6-4291-85c2-ccdf2bca3269 tempest-AttachVolumeNegativeTest-1135644984 None] Flow 'volume_create_manager' (af773e10-35e1-416b-8836-5d7f4d3331e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-88a69de7-31e6-4291-85c2-ccdf2bca3269 tempest-AttachVolumeNegativeTest-1135644984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19cf079f-8dcc-42e4-aa6d-b06b36d5f39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-88a69de7-31e6-4291-85c2-ccdf2bca3269 tempest-AttachVolumeNegativeTest-1135644984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19cf079f-8dcc-42e4-aa6d-b06b36d5f39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-143509074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36f61baf-fffb-404c-ad45-90cbdd67b356,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='731ad24ec4834b3aafb0fd86002127f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:02Z,use_quota=True,user_id='dc12f9071eda4283b96f21bc61636311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-88a69de7-31e6-4291-85c2-ccdf2bca3269 tempest-AttachVolumeNegativeTest-1135644984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (832878ad-9766-4765-883a-f12cf5521c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-88a69de7-31e6-4291-85c2-ccdf2bca3269 tempest-AttachVolumeNegativeTest-1135644984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (832878ad-9766-4765-883a-f12cf5521c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-88a69de7-31e6-4291-85c2-ccdf2bca3269 tempest-AttachVolumeNegativeTest-1135644984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (624c1e0d-9b06-47a0-9a82-371b93f9b315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-88a69de7-31e6-4291-85c2-ccdf2bca3269 tempest-AttachVolumeNegativeTest-1135644984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (624c1e0d-9b06-47a0-9a82-371b93f9b315) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36f61baf-fffb-404c-ad45-90cbdd67b356', 'volume_name': 'volume-36f61baf-fffb-404c-ad45-90cbdd67b356', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-88a69de7-31e6-4291-85c2-ccdf2bca3269 tempest-AttachVolumeNegativeTest-1135644984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (786851f3-865a-404c-9632-a26dbea48022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-88a69de7-31e6-4291-85c2-ccdf2bca3269 tempest-AttachVolumeNegativeTest-1135644984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (786851f3-865a-404c-9632-a26dbea48022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-88a69de7-31e6-4291-85c2-ccdf2bca3269 tempest-AttachVolumeNegativeTest-1135644984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61e71b70-22f7-4c5c-80fe-566e72c0a508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:02 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-88a69de7-31e6-4291-85c2-ccdf2bca3269 tempest-AttachVolumeNegativeTest-1135644984 None] Volume 36f61baf-fffb-404c-ad45-90cbdd67b356: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36f61baf-fffb-404c-ad45-90cbdd67b356', 'volume_size': 1} Jul 30 16:54:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-88a69de7-31e6-4291-85c2-ccdf2bca3269 tempest-AttachVolumeNegativeTest-1135644984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-88a69de7-31e6-4291-85c2-ccdf2bca3269 tempest-AttachVolumeNegativeTest-1135644984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:02 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-88a69de7-31e6-4291-85c2-ccdf2bca3269 tempest-AttachVolumeNegativeTest-1135644984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-143509074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36f61baf-fffb-404c-ad45-90cbdd67b356,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='731ad24ec4834b3aafb0fd86002127f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:02Z,use_quota=True,user_id='dc12f9071eda4283b96f21bc61636311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:54:02 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-88a69de7-31e6-4291-85c2-ccdf2bca3269 tempest-AttachVolumeNegativeTest-1135644984 None] Creating volume 36f61baf-fffb-404c-ad45-90cbdd67b356 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:54:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-88a69de7-31e6-4291-85c2-ccdf2bca3269 tempest-AttachVolumeNegativeTest-1135644984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-88a69de7-31e6-4291-85c2-ccdf2bca3269 tempest-AttachVolumeNegativeTest-1135644984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:02 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-88a69de7-31e6-4291-85c2-ccdf2bca3269 tempest-AttachVolumeNegativeTest-1135644984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:02 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-88a69de7-31e6-4291-85c2-ccdf2bca3269 tempest-AttachVolumeNegativeTest-1135644984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-88a69de7-31e6-4291-85c2-ccdf2bca3269 tempest-AttachVolumeNegativeTest-1135644984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:02 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-88a69de7-31e6-4291-85c2-ccdf2bca3269 tempest-AttachVolumeNegativeTest-1135644984 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:54:02 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-88a69de7-31e6-4291-85c2-ccdf2bca3269 tempest-AttachVolumeNegativeTest-1135644984 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:54:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-88a69de7-31e6-4291-85c2-ccdf2bca3269 tempest-AttachVolumeNegativeTest-1135644984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-36f61baf-fffb-404c-ad45-90cbdd67b356 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:02 devstack sudo[94951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-36f61baf-fffb-404c-ad45-90cbdd67b356 1073741824 Jul 30 16:54:02 devstack sudo[94951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:03 devstack sudo[94951]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-88a69de7-31e6-4291-85c2-ccdf2bca3269 tempest-AttachVolumeNegativeTest-1135644984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-36f61baf-fffb-404c-ad45-90cbdd67b356 1073741824" returned: 0 in 0.515s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-88a69de7-31e6-4291-85c2-ccdf2bca3269 tempest-AttachVolumeNegativeTest-1135644984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-36f61baf-fffb-404c-ad45-90cbdd67b356 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:03 devstack sudo[94958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-36f61baf-fffb-404c-ad45-90cbdd67b356 Jul 30 16:54:03 devstack sudo[94958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:03 devstack sudo[94958]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-88a69de7-31e6-4291-85c2-ccdf2bca3269 tempest-AttachVolumeNegativeTest-1135644984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-36f61baf-fffb-404c-ad45-90cbdd67b356" returned: 0 in 0.291s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:03 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-88a69de7-31e6-4291-85c2-ccdf2bca3269 tempest-AttachVolumeNegativeTest-1135644984 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:54:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-88a69de7-31e6-4291-85c2-ccdf2bca3269 tempest-AttachVolumeNegativeTest-1135644984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:03 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-88a69de7-31e6-4291-85c2-ccdf2bca3269 tempest-AttachVolumeNegativeTest-1135644984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61e71b70-22f7-4c5c-80fe-566e72c0a508) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36f61baf-fffb-404c-ad45-90cbdd67b356', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:03 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-88a69de7-31e6-4291-85c2-ccdf2bca3269 tempest-AttachVolumeNegativeTest-1135644984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51318f97-fdf9-49ba-9860-86a547a54bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:03 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-88a69de7-31e6-4291-85c2-ccdf2bca3269 tempest-AttachVolumeNegativeTest-1135644984 None] Volume volume-36f61baf-fffb-404c-ad45-90cbdd67b356 (36f61baf-fffb-404c-ad45-90cbdd67b356): created successfully Jul 30 16:54:03 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-88a69de7-31e6-4291-85c2-ccdf2bca3269 tempest-AttachVolumeNegativeTest-1135644984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51318f97-fdf9-49ba-9860-86a547a54bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:03 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-88a69de7-31e6-4291-85c2-ccdf2bca3269 tempest-AttachVolumeNegativeTest-1135644984 None] Flow 'volume_create_manager' (af773e10-35e1-416b-8836-5d7f4d3331e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:03 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-88a69de7-31e6-4291-85c2-ccdf2bca3269 tempest-AttachVolumeNegativeTest-1135644984 None] Created volume successfully. Jul 30 16:54:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-5d20b1db-5eaa-4f7b-a4ac-3b134fe031a3 req-33259ed0-6629-4c4b-a780-0f1d4d725de0 tempest-AttachVolumeNegativeTest-1135644984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-5d20b1db-5eaa-4f7b-a4ac-3b134fe031a3 req-33259ed0-6629-4c4b-a780-0f1d4d725de0 tempest-AttachVolumeNegativeTest-1135644984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-5d20b1db-5eaa-4f7b-a4ac-3b134fe031a3 req-33259ed0-6629-4c4b-a780-0f1d4d725de0 tempest-AttachVolumeNegativeTest-1135644984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:05 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-5d20b1db-5eaa-4f7b-a4ac-3b134fe031a3 req-33259ed0-6629-4c4b-a780-0f1d4d725de0 tempest-AttachVolumeNegativeTest-1135644984 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202', 'name': 'volume-36f61baf-fffb-404c-ad45-90cbdd67b356', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e13a5449-39d4-4b7f-ac6c-7784214b8610', 'enforce_multipath': True} {{(pid=88591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:54:05 devstack cinder-volume[88591]: INFO cinder.volume.manager [req-5d20b1db-5eaa-4f7b-a4ac-3b134fe031a3 req-33259ed0-6629-4c4b-a780-0f1d4d725de0 tempest-AttachVolumeNegativeTest-1135644984 None] attachment_update completed successfully. Jul 30 16:54:09 devstack cinder-volume[88591]: INFO cinder.volume.manager [req-ba248fd9-1138-4495-84cc-82c4287fad6c req-f71489dd-8ca2-4e46-83af-cdc9bc570ddf tempest-AttachVolumeNegativeTest-1135644984 None] Terminate volume connection completed successfully. Jul 30 16:54:09 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-ba248fd9-1138-4495-84cc-82c4287fad6c req-f71489dd-8ca2-4e46-83af-cdc9bc570ddf tempest-AttachVolumeNegativeTest-1135644984 None] Deleting attachment e13a5449-39d4-4b7f-ac6c-7784214b8610. {{(pid=88591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:54:12 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ecf89c22-b792-43c5-b4a4-a8468206f795 tempest-AttachVolumeShelveTestJSON-1173435809 None] Acquiring lock "cinder-8156db28-831f-40e3-bafb-805f0ee591ea-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:12 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ecf89c22-b792-43c5-b4a4-a8468206f795 tempest-AttachVolumeShelveTestJSON-1173435809 None] Lock "cinder-8156db28-831f-40e3-bafb-805f0ee591ea-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:12 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ecf89c22-b792-43c5-b4a4-a8468206f795 tempest-AttachVolumeShelveTestJSON-1173435809 None] Acquiring lock "cinder-quobyte-8156db28-831f-40e3-bafb-805f0ee591ea" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:12 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ecf89c22-b792-43c5-b4a4-a8468206f795 tempest-AttachVolumeShelveTestJSON-1173435809 None] Lock "cinder-quobyte-8156db28-831f-40e3-bafb-805f0ee591ea" acquired by "delete_volume" :: waited 0.019s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:12 devstack cinder-volume[88591]: DEBUG oslo_service.periodic_task [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:54:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:12 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c08da7-7f36-4b00-b47f-d4464e590957]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ecf89c22-b792-43c5-b4a4-a8468206f795 tempest-AttachVolumeShelveTestJSON-1173435809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8156db28-831f-40e3-bafb-805f0ee591ea {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:12 devstack sudo[95065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:54:12 devstack sudo[95065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:12 devstack sudo[95066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8156db28-831f-40e3-bafb-805f0ee591ea Jul 30 16:54:12 devstack sudo[95066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:13 devstack sudo[95065]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.510s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:13 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:54:13 devstack cinder-volume[88591]: DEBUG oslo_service.periodic_task [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running periodic task VolumeManager._thread_info {{(pid=88591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:54:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] thread count: 8 {{(pid=88591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:54:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] thread info: [<_MainThread(MainThread, started 140677178003584)>, , , , , , , ] {{(pid=88591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:54:13 devstack sudo[95066]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ecf89c22-b792-43c5-b4a4-a8468206f795 tempest-AttachVolumeShelveTestJSON-1173435809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8156db28-831f-40e3-bafb-805f0ee591ea" returned: 0 in 0.585s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ecf89c22-b792-43c5-b4a4-a8468206f795 tempest-AttachVolumeShelveTestJSON-1173435809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8156db28-831f-40e3-bafb-805f0ee591ea {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:13 devstack sudo[95074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8156db28-831f-40e3-bafb-805f0ee591ea Jul 30 16:54:13 devstack sudo[95074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:13 devstack sudo[95074]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ecf89c22-b792-43c5-b4a4-a8468206f795 tempest-AttachVolumeShelveTestJSON-1173435809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8156db28-831f-40e3-bafb-805f0ee591ea" returned: 0 in 0.301s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:13 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ecf89c22-b792-43c5-b4a4-a8468206f795 tempest-AttachVolumeShelveTestJSON-1173435809 None] Lock "cinder-quobyte-8156db28-831f-40e3-bafb-805f0ee591ea" released by "delete_volume" :: held 0.994s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:13 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-ecf89c22-b792-43c5-b4a4-a8468206f795 tempest-AttachVolumeShelveTestJSON-1173435809 None] Created reservations ['8d5ba2f6-fcd9-4a52-abc8-eef394d95aaa', '8fe23798-ff5d-4ed6-8d61-0fc047a48ca5', 'af888918-4f90-41c4-b634-eec7d98c538d', '4e1d08b0-5ace-4ec6-9051-9a06ff704a41'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ecf89c22-b792-43c5-b4a4-a8468206f795 tempest-AttachVolumeShelveTestJSON-1173435809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ecf89c22-b792-43c5-b4a4-a8468206f795 tempest-AttachVolumeShelveTestJSON-1173435809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:13 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ecf89c22-b792-43c5-b4a4-a8468206f795 tempest-AttachVolumeShelveTestJSON-1173435809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:13 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ecf89c22-b792-43c5-b4a4-a8468206f795 tempest-AttachVolumeShelveTestJSON-1173435809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ecf89c22-b792-43c5-b4a4-a8468206f795 tempest-AttachVolumeShelveTestJSON-1173435809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ecf89c22-b792-43c5-b4a4-a8468206f795 tempest-AttachVolumeShelveTestJSON-1173435809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:13 devstack sudo[95077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:54:13 devstack sudo[95077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:14 devstack sudo[95077]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ecf89c22-b792-43c5-b4a4-a8468206f795 tempest-AttachVolumeShelveTestJSON-1173435809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.320s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:14 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-ecf89c22-b792-43c5-b4a4-a8468206f795 tempest-AttachVolumeShelveTestJSON-1173435809 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:54:14 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-ecf89c22-b792-43c5-b4a4-a8468206f795 tempest-AttachVolumeShelveTestJSON-1173435809 None] Deleted volume successfully. Jul 30 16:54:14 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ecf89c22-b792-43c5-b4a4-a8468206f795 tempest-AttachVolumeShelveTestJSON-1173435809 None] Lock "cinder-8156db28-831f-40e3-bafb-805f0ee591ea-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:14 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d3c7406a-334c-4070-87aa-453fcdf5eac6 tempest-AttachVolumeNegativeTest-1135644984 None] Acquiring lock "cinder-36f61baf-fffb-404c-ad45-90cbdd67b356-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:14 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d3c7406a-334c-4070-87aa-453fcdf5eac6 tempest-AttachVolumeNegativeTest-1135644984 None] Lock "cinder-36f61baf-fffb-404c-ad45-90cbdd67b356-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:15 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d3c7406a-334c-4070-87aa-453fcdf5eac6 tempest-AttachVolumeNegativeTest-1135644984 None] Acquiring lock "cinder-quobyte-36f61baf-fffb-404c-ad45-90cbdd67b356" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:15 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d3c7406a-334c-4070-87aa-453fcdf5eac6 tempest-AttachVolumeNegativeTest-1135644984 None] Lock "cinder-quobyte-36f61baf-fffb-404c-ad45-90cbdd67b356" acquired by "delete_volume" :: waited 0.026s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:15 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8f8c51-b849-4e1a-8b62-471433066717]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d3c7406a-334c-4070-87aa-453fcdf5eac6 tempest-AttachVolumeNegativeTest-1135644984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-36f61baf-fffb-404c-ad45-90cbdd67b356 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:15 devstack sudo[95104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-36f61baf-fffb-404c-ad45-90cbdd67b356 Jul 30 16:54:15 devstack sudo[95104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:15 devstack sudo[95104]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d3c7406a-334c-4070-87aa-453fcdf5eac6 tempest-AttachVolumeNegativeTest-1135644984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-36f61baf-fffb-404c-ad45-90cbdd67b356" returned: 0 in 0.389s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d3c7406a-334c-4070-87aa-453fcdf5eac6 tempest-AttachVolumeNegativeTest-1135644984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-36f61baf-fffb-404c-ad45-90cbdd67b356 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:15 devstack sudo[95109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-36f61baf-fffb-404c-ad45-90cbdd67b356 Jul 30 16:54:15 devstack sudo[95109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:15 devstack sudo[95109]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d3c7406a-334c-4070-87aa-453fcdf5eac6 tempest-AttachVolumeNegativeTest-1135644984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-36f61baf-fffb-404c-ad45-90cbdd67b356" returned: 0 in 0.285s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:15 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d3c7406a-334c-4070-87aa-453fcdf5eac6 tempest-AttachVolumeNegativeTest-1135644984 None] Lock "cinder-quobyte-36f61baf-fffb-404c-ad45-90cbdd67b356" released by "delete_volume" :: held 0.730s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:15 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-d3c7406a-334c-4070-87aa-453fcdf5eac6 tempest-AttachVolumeNegativeTest-1135644984 None] Created reservations ['e6b2c983-fd22-447d-a4f0-f9084defbc8a', '1138d95f-09d5-4980-9dfe-a981406eceb9', 'cab4f302-0bc1-4262-ad13-d279ba2394fb', 'ddbfbc59-ebb0-4c69-878a-381aa6298f9c'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d3c7406a-334c-4070-87aa-453fcdf5eac6 tempest-AttachVolumeNegativeTest-1135644984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d3c7406a-334c-4070-87aa-453fcdf5eac6 tempest-AttachVolumeNegativeTest-1135644984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:15 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d3c7406a-334c-4070-87aa-453fcdf5eac6 tempest-AttachVolumeNegativeTest-1135644984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:15 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d3c7406a-334c-4070-87aa-453fcdf5eac6 tempest-AttachVolumeNegativeTest-1135644984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d3c7406a-334c-4070-87aa-453fcdf5eac6 tempest-AttachVolumeNegativeTest-1135644984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d3c7406a-334c-4070-87aa-453fcdf5eac6 tempest-AttachVolumeNegativeTest-1135644984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:15 devstack sudo[95112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:54:15 devstack sudo[95112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:16 devstack sudo[95112]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:16 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d3c7406a-334c-4070-87aa-453fcdf5eac6 tempest-AttachVolumeNegativeTest-1135644984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.287s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:16 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-d3c7406a-334c-4070-87aa-453fcdf5eac6 tempest-AttachVolumeNegativeTest-1135644984 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:54:16 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-d3c7406a-334c-4070-87aa-453fcdf5eac6 tempest-AttachVolumeNegativeTest-1135644984 None] Deleted volume successfully. Jul 30 16:54:16 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d3c7406a-334c-4070-87aa-453fcdf5eac6 tempest-AttachVolumeNegativeTest-1135644984 None] Lock "cinder-36f61baf-fffb-404c-ad45-90cbdd67b356-delete_volume" released by "delete_volume" :: held 1.283s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:16 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-4b504b0f-86b1-4284-a851-d8f75f958c14 tempest-AttachVolumeNegativeTest-1135644984 None] Acquiring lock "cinder-bcdc52ab-53d8-43c7-ab24-1735aca4d12c-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:16 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-4b504b0f-86b1-4284-a851-d8f75f958c14 tempest-AttachVolumeNegativeTest-1135644984 None] Lock "cinder-bcdc52ab-53d8-43c7-ab24-1735aca4d12c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:16 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-4b504b0f-86b1-4284-a851-d8f75f958c14 tempest-AttachVolumeNegativeTest-1135644984 None] Acquiring lock "cinder-quobyte-bcdc52ab-53d8-43c7-ab24-1735aca4d12c" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:16 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-4b504b0f-86b1-4284-a851-d8f75f958c14 tempest-AttachVolumeNegativeTest-1135644984 None] Lock "cinder-quobyte-bcdc52ab-53d8-43c7-ab24-1735aca4d12c" acquired by "delete_volume" :: waited 0.021s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:16 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9faea0b-09a6-4e26-bf32-a98f7f06410b]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:16 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4b504b0f-86b1-4284-a851-d8f75f958c14 tempest-AttachVolumeNegativeTest-1135644984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bcdc52ab-53d8-43c7-ab24-1735aca4d12c {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:16 devstack sudo[95115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bcdc52ab-53d8-43c7-ab24-1735aca4d12c Jul 30 16:54:16 devstack sudo[95115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:16 devstack sudo[95115]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:16 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4b504b0f-86b1-4284-a851-d8f75f958c14 tempest-AttachVolumeNegativeTest-1135644984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bcdc52ab-53d8-43c7-ab24-1735aca4d12c" returned: 0 in 0.458s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:16 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4b504b0f-86b1-4284-a851-d8f75f958c14 tempest-AttachVolumeNegativeTest-1135644984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bcdc52ab-53d8-43c7-ab24-1735aca4d12c {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:16 devstack sudo[95121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bcdc52ab-53d8-43c7-ab24-1735aca4d12c Jul 30 16:54:16 devstack sudo[95121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:17 devstack sudo[95121]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4b504b0f-86b1-4284-a851-d8f75f958c14 tempest-AttachVolumeNegativeTest-1135644984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bcdc52ab-53d8-43c7-ab24-1735aca4d12c" returned: 0 in 0.292s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:17 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-4b504b0f-86b1-4284-a851-d8f75f958c14 tempest-AttachVolumeNegativeTest-1135644984 None] Lock "cinder-quobyte-bcdc52ab-53d8-43c7-ab24-1735aca4d12c" released by "delete_volume" :: held 0.804s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:17 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-4b504b0f-86b1-4284-a851-d8f75f958c14 tempest-AttachVolumeNegativeTest-1135644984 None] Created reservations ['f1b1a299-40a5-4b8f-96d9-825346eb2793', '5d86aff1-ecc0-46b5-a7b5-386b706c0dac', '0dfc0b5f-c5eb-4ba1-b735-575ab367e327', '80eaabd3-12b4-4749-b087-cef252a16ab7'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-4b504b0f-86b1-4284-a851-d8f75f958c14 tempest-AttachVolumeNegativeTest-1135644984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-4b504b0f-86b1-4284-a851-d8f75f958c14 tempest-AttachVolumeNegativeTest-1135644984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:17 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-4b504b0f-86b1-4284-a851-d8f75f958c14 tempest-AttachVolumeNegativeTest-1135644984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:17 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-4b504b0f-86b1-4284-a851-d8f75f958c14 tempest-AttachVolumeNegativeTest-1135644984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-4b504b0f-86b1-4284-a851-d8f75f958c14 tempest-AttachVolumeNegativeTest-1135644984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4b504b0f-86b1-4284-a851-d8f75f958c14 tempest-AttachVolumeNegativeTest-1135644984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:17 devstack sudo[95124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:54:17 devstack sudo[95124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:17 devstack sudo[95124]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4b504b0f-86b1-4284-a851-d8f75f958c14 tempest-AttachVolumeNegativeTest-1135644984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.294s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:17 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-4b504b0f-86b1-4284-a851-d8f75f958c14 tempest-AttachVolumeNegativeTest-1135644984 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:54:17 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-4b504b0f-86b1-4284-a851-d8f75f958c14 tempest-AttachVolumeNegativeTest-1135644984 None] Deleted volume successfully. Jul 30 16:54:17 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-4b504b0f-86b1-4284-a851-d8f75f958c14 tempest-AttachVolumeNegativeTest-1135644984 None] Lock "cinder-bcdc52ab-53d8-43c7-ab24-1735aca4d12c-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:17 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-86237c34-b76f-4428-a46d-2c6a84d84a68 tempest-AttachVolumeNegativeTest-1135644984 None] Acquiring lock "cinder-28b193d5-cea8-4ef5-8f95-6e1658bfba68-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:17 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-86237c34-b76f-4428-a46d-2c6a84d84a68 tempest-AttachVolumeNegativeTest-1135644984 None] Lock "cinder-28b193d5-cea8-4ef5-8f95-6e1658bfba68-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:17 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-86237c34-b76f-4428-a46d-2c6a84d84a68 tempest-AttachVolumeNegativeTest-1135644984 None] Acquiring lock "cinder-quobyte-28b193d5-cea8-4ef5-8f95-6e1658bfba68" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:17 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-86237c34-b76f-4428-a46d-2c6a84d84a68 tempest-AttachVolumeNegativeTest-1135644984 None] Lock "cinder-quobyte-28b193d5-cea8-4ef5-8f95-6e1658bfba68" acquired by "delete_volume" :: waited 0.018s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:17 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[666b6ffd-c24d-4fb5-9a40-c6158997732d]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-86237c34-b76f-4428-a46d-2c6a84d84a68 tempest-AttachVolumeNegativeTest-1135644984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-28b193d5-cea8-4ef5-8f95-6e1658bfba68 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:18 devstack sudo[95127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-28b193d5-cea8-4ef5-8f95-6e1658bfba68 Jul 30 16:54:18 devstack sudo[95127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:18 devstack sudo[95127]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-86237c34-b76f-4428-a46d-2c6a84d84a68 tempest-AttachVolumeNegativeTest-1135644984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-28b193d5-cea8-4ef5-8f95-6e1658bfba68" returned: 0 in 0.448s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-86237c34-b76f-4428-a46d-2c6a84d84a68 tempest-AttachVolumeNegativeTest-1135644984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-28b193d5-cea8-4ef5-8f95-6e1658bfba68 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:18 devstack sudo[95133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-28b193d5-cea8-4ef5-8f95-6e1658bfba68 Jul 30 16:54:18 devstack sudo[95133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:18 devstack sudo[95133]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-86237c34-b76f-4428-a46d-2c6a84d84a68 tempest-AttachVolumeNegativeTest-1135644984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-28b193d5-cea8-4ef5-8f95-6e1658bfba68" returned: 0 in 0.424s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:18 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-86237c34-b76f-4428-a46d-2c6a84d84a68 tempest-AttachVolumeNegativeTest-1135644984 None] Lock "cinder-quobyte-28b193d5-cea8-4ef5-8f95-6e1658bfba68" released by "delete_volume" :: held 0.926s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:18 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-86237c34-b76f-4428-a46d-2c6a84d84a68 tempest-AttachVolumeNegativeTest-1135644984 None] Created reservations ['3822a292-75d6-4701-92d4-e590ebe91e41', 'd21ae0d6-d7d7-4d1b-8378-53baeb605591', '904e0daf-9a29-4101-933c-876862c00801', 'bd1f06f5-c8d3-4692-9428-310c58f7b6c7'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-86237c34-b76f-4428-a46d-2c6a84d84a68 tempest-AttachVolumeNegativeTest-1135644984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-86237c34-b76f-4428-a46d-2c6a84d84a68 tempest-AttachVolumeNegativeTest-1135644984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:19 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-86237c34-b76f-4428-a46d-2c6a84d84a68 tempest-AttachVolumeNegativeTest-1135644984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:19 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-86237c34-b76f-4428-a46d-2c6a84d84a68 tempest-AttachVolumeNegativeTest-1135644984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-86237c34-b76f-4428-a46d-2c6a84d84a68 tempest-AttachVolumeNegativeTest-1135644984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-86237c34-b76f-4428-a46d-2c6a84d84a68 tempest-AttachVolumeNegativeTest-1135644984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:19 devstack sudo[95136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:54:19 devstack sudo[95136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:19 devstack sudo[95136]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-86237c34-b76f-4428-a46d-2c6a84d84a68 tempest-AttachVolumeNegativeTest-1135644984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.366s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:19 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-86237c34-b76f-4428-a46d-2c6a84d84a68 tempest-AttachVolumeNegativeTest-1135644984 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:54:19 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-86237c34-b76f-4428-a46d-2c6a84d84a68 tempest-AttachVolumeNegativeTest-1135644984 None] Deleted volume successfully. Jul 30 16:54:19 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-86237c34-b76f-4428-a46d-2c6a84d84a68 tempest-AttachVolumeNegativeTest-1135644984 None] Lock "cinder-28b193d5-cea8-4ef5-8f95-6e1658bfba68-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:25 devstack cinder-volume[88591]: INFO cinder.volume.manager [req-aeba378b-700d-4c7c-85c3-b47eb00864e0 req-8d1f3cad-ce38-4bf7-9148-ddd325ba33b8 tempest-ServerActionsTestOtherA-277957863 None] Terminate volume connection completed successfully. Jul 30 16:54:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-aeba378b-700d-4c7c-85c3-b47eb00864e0 req-8d1f3cad-ce38-4bf7-9148-ddd325ba33b8 tempest-ServerActionsTestOtherA-277957863 None] Deleting attachment 8abbaf1b-b0b8-4724-aeb4-c69e2bedb447. {{(pid=88591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:54:27 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [req-1c10c09a-1099-48c5-941c-d73908670690 req-843970d4-e0b3-4e27-991c-357a07502bec tempest-VolumesSnapshotsTestJSON-234903903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:54:27 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-1c10c09a-1099-48c5-941c-d73908670690 req-843970d4-e0b3-4e27-991c-357a07502bec tempest-VolumesSnapshotsTestJSON-234903903 None] Flow 'volume_create_manager' (bb576298-2669-4a75-afcb-118a1d9b2ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:27 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-1c10c09a-1099-48c5-941c-d73908670690 req-843970d4-e0b3-4e27-991c-357a07502bec tempest-VolumesSnapshotsTestJSON-234903903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e196bc57-b127-4317-b8b8-89d16226c556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:27 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-1c10c09a-1099-48c5-941c-d73908670690 req-843970d4-e0b3-4e27-991c-357a07502bec tempest-VolumesSnapshotsTestJSON-234903903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e196bc57-b127-4317-b8b8-89d16226c556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1551332597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b84694d0-7c8f-4713-9900-9bcfabe053a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5902306140e94f2ca0797241d1949781',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:28Z,use_quota=True,user_id='7de0592178c6477dbc555540aaca7c9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:27 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-1c10c09a-1099-48c5-941c-d73908670690 req-843970d4-e0b3-4e27-991c-357a07502bec tempest-VolumesSnapshotsTestJSON-234903903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff9cef32-4ca8-4a88-ba08-543257c5ab2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:27 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-1c10c09a-1099-48c5-941c-d73908670690 req-843970d4-e0b3-4e27-991c-357a07502bec tempest-VolumesSnapshotsTestJSON-234903903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff9cef32-4ca8-4a88-ba08-543257c5ab2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:27 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-1c10c09a-1099-48c5-941c-d73908670690 req-843970d4-e0b3-4e27-991c-357a07502bec tempest-VolumesSnapshotsTestJSON-234903903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28ee72cb-9aef-46e6-b115-1421f7b0c25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:27 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-1c10c09a-1099-48c5-941c-d73908670690 req-843970d4-e0b3-4e27-991c-357a07502bec tempest-VolumesSnapshotsTestJSON-234903903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28ee72cb-9aef-46e6-b115-1421f7b0c25f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b84694d0-7c8f-4713-9900-9bcfabe053a3', 'volume_name': 'volume-b84694d0-7c8f-4713-9900-9bcfabe053a3', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:27 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-1c10c09a-1099-48c5-941c-d73908670690 req-843970d4-e0b3-4e27-991c-357a07502bec tempest-VolumesSnapshotsTestJSON-234903903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46dc8ee4-3418-40c5-8297-bc7f40e22106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:27 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-1c10c09a-1099-48c5-941c-d73908670690 req-843970d4-e0b3-4e27-991c-357a07502bec tempest-VolumesSnapshotsTestJSON-234903903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46dc8ee4-3418-40c5-8297-bc7f40e22106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:27 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-1c10c09a-1099-48c5-941c-d73908670690 req-843970d4-e0b3-4e27-991c-357a07502bec tempest-VolumesSnapshotsTestJSON-234903903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1f0c8cc-be0b-4cbd-9a3a-76de2b2646c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:27 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [req-1c10c09a-1099-48c5-941c-d73908670690 req-843970d4-e0b3-4e27-991c-357a07502bec tempest-VolumesSnapshotsTestJSON-234903903 None] Volume b84694d0-7c8f-4713-9900-9bcfabe053a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b84694d0-7c8f-4713-9900-9bcfabe053a3', 'volume_size': 1} Jul 30 16:54:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-1c10c09a-1099-48c5-941c-d73908670690 req-843970d4-e0b3-4e27-991c-357a07502bec tempest-VolumesSnapshotsTestJSON-234903903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-1c10c09a-1099-48c5-941c-d73908670690 req-843970d4-e0b3-4e27-991c-357a07502bec tempest-VolumesSnapshotsTestJSON-234903903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:27 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [req-1c10c09a-1099-48c5-941c-d73908670690 req-843970d4-e0b3-4e27-991c-357a07502bec tempest-VolumesSnapshotsTestJSON-234903903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1551332597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b84694d0-7c8f-4713-9900-9bcfabe053a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5902306140e94f2ca0797241d1949781',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:28Z,use_quota=True,user_id='7de0592178c6477dbc555540aaca7c9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:54:27 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [req-1c10c09a-1099-48c5-941c-d73908670690 req-843970d4-e0b3-4e27-991c-357a07502bec tempest-VolumesSnapshotsTestJSON-234903903 None] Creating volume b84694d0-7c8f-4713-9900-9bcfabe053a3 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:54:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-1c10c09a-1099-48c5-941c-d73908670690 req-843970d4-e0b3-4e27-991c-357a07502bec tempest-VolumesSnapshotsTestJSON-234903903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-1c10c09a-1099-48c5-941c-d73908670690 req-843970d4-e0b3-4e27-991c-357a07502bec tempest-VolumesSnapshotsTestJSON-234903903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:27 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [req-1c10c09a-1099-48c5-941c-d73908670690 req-843970d4-e0b3-4e27-991c-357a07502bec tempest-VolumesSnapshotsTestJSON-234903903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:27 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [req-1c10c09a-1099-48c5-941c-d73908670690 req-843970d4-e0b3-4e27-991c-357a07502bec tempest-VolumesSnapshotsTestJSON-234903903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-1c10c09a-1099-48c5-941c-d73908670690 req-843970d4-e0b3-4e27-991c-357a07502bec tempest-VolumesSnapshotsTestJSON-234903903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:27 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [req-1c10c09a-1099-48c5-941c-d73908670690 req-843970d4-e0b3-4e27-991c-357a07502bec tempest-VolumesSnapshotsTestJSON-234903903 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:54:27 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [req-1c10c09a-1099-48c5-941c-d73908670690 req-843970d4-e0b3-4e27-991c-357a07502bec tempest-VolumesSnapshotsTestJSON-234903903 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:54:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [req-1c10c09a-1099-48c5-941c-d73908670690 req-843970d4-e0b3-4e27-991c-357a07502bec tempest-VolumesSnapshotsTestJSON-234903903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b84694d0-7c8f-4713-9900-9bcfabe053a3 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:28 devstack sudo[95183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b84694d0-7c8f-4713-9900-9bcfabe053a3 1073741824 Jul 30 16:54:28 devstack sudo[95183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:28 devstack sudo[95183]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [req-1c10c09a-1099-48c5-941c-d73908670690 req-843970d4-e0b3-4e27-991c-357a07502bec tempest-VolumesSnapshotsTestJSON-234903903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b84694d0-7c8f-4713-9900-9bcfabe053a3 1073741824" returned: 0 in 0.706s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [req-1c10c09a-1099-48c5-941c-d73908670690 req-843970d4-e0b3-4e27-991c-357a07502bec tempest-VolumesSnapshotsTestJSON-234903903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b84694d0-7c8f-4713-9900-9bcfabe053a3 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:28 devstack sudo[95191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b84694d0-7c8f-4713-9900-9bcfabe053a3 Jul 30 16:54:28 devstack sudo[95191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:29 devstack sudo[95191]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [req-1c10c09a-1099-48c5-941c-d73908670690 req-843970d4-e0b3-4e27-991c-357a07502bec tempest-VolumesSnapshotsTestJSON-234903903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b84694d0-7c8f-4713-9900-9bcfabe053a3" returned: 0 in 0.359s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:29 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [req-1c10c09a-1099-48c5-941c-d73908670690 req-843970d4-e0b3-4e27-991c-357a07502bec tempest-VolumesSnapshotsTestJSON-234903903 None] <== create_volume: return (1197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:54:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-1c10c09a-1099-48c5-941c-d73908670690 req-843970d4-e0b3-4e27-991c-357a07502bec tempest-VolumesSnapshotsTestJSON-234903903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.200s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:29 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-1c10c09a-1099-48c5-941c-d73908670690 req-843970d4-e0b3-4e27-991c-357a07502bec tempest-VolumesSnapshotsTestJSON-234903903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1f0c8cc-be0b-4cbd-9a3a-76de2b2646c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b84694d0-7c8f-4713-9900-9bcfabe053a3', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:29 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-1c10c09a-1099-48c5-941c-d73908670690 req-843970d4-e0b3-4e27-991c-357a07502bec tempest-VolumesSnapshotsTestJSON-234903903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10e37745-a090-401c-93d8-9ee6f939aebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:29 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [req-1c10c09a-1099-48c5-941c-d73908670690 req-843970d4-e0b3-4e27-991c-357a07502bec tempest-VolumesSnapshotsTestJSON-234903903 None] Volume volume-b84694d0-7c8f-4713-9900-9bcfabe053a3 (b84694d0-7c8f-4713-9900-9bcfabe053a3): created successfully Jul 30 16:54:29 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-1c10c09a-1099-48c5-941c-d73908670690 req-843970d4-e0b3-4e27-991c-357a07502bec tempest-VolumesSnapshotsTestJSON-234903903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10e37745-a090-401c-93d8-9ee6f939aebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:29 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-1c10c09a-1099-48c5-941c-d73908670690 req-843970d4-e0b3-4e27-991c-357a07502bec tempest-VolumesSnapshotsTestJSON-234903903 None] Flow 'volume_create_manager' (bb576298-2669-4a75-afcb-118a1d9b2ad8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:29 devstack cinder-volume[88591]: INFO cinder.volume.manager [req-1c10c09a-1099-48c5-941c-d73908670690 req-843970d4-e0b3-4e27-991c-357a07502bec tempest-VolumesSnapshotsTestJSON-234903903 None] Created volume successfully. Jul 30 16:54:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-92fbd2e8-8f22-4c15-a5da-73cce4f088a3 req-f4f6d77a-1d30-4cfd-877c-f7d60b2311d0 tempest-VolumesSnapshotsTestJSON-234903903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-92fbd2e8-8f22-4c15-a5da-73cce4f088a3 req-f4f6d77a-1d30-4cfd-877c-f7d60b2311d0 tempest-VolumesSnapshotsTestJSON-234903903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:30 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [req-92fbd2e8-8f22-4c15-a5da-73cce4f088a3 req-f4f6d77a-1d30-4cfd-877c-f7d60b2311d0 tempest-VolumesSnapshotsTestJSON-234903903 None] Creating offline snapshot 8581b3f1-6380-42c3-9fad-da9061dab6b8 of volume b84694d0-7c8f-4713-9900-9bcfabe053a3 {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:54:30 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[175511a7-71ab-40b3-85ef-62a78bc3146e]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [req-92fbd2e8-8f22-4c15-a5da-73cce4f088a3 req-f4f6d77a-1d30-4cfd-877c-f7d60b2311d0 tempest-VolumesSnapshotsTestJSON-234903903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b84694d0-7c8f-4713-9900-9bcfabe053a3 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:30 devstack sudo[95194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b84694d0-7c8f-4713-9900-9bcfabe053a3 Jul 30 16:54:30 devstack sudo[95194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:31 devstack sudo[95194]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [req-92fbd2e8-8f22-4c15-a5da-73cce4f088a3 req-f4f6d77a-1d30-4cfd-877c-f7d60b2311d0 tempest-VolumesSnapshotsTestJSON-234903903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b84694d0-7c8f-4713-9900-9bcfabe053a3" returned: 0 in 0.533s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [req-92fbd2e8-8f22-4c15-a5da-73cce4f088a3 req-f4f6d77a-1d30-4cfd-877c-f7d60b2311d0 tempest-VolumesSnapshotsTestJSON-234903903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b84694d0-7c8f-4713-9900-9bcfabe053a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b84694d0-7c8f-4713-9900-9bcfabe053a3.8581b3f1-6380-42c3-9fad-da9061dab6b8 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:31 devstack sudo[95199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b84694d0-7c8f-4713-9900-9bcfabe053a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b84694d0-7c8f-4713-9900-9bcfabe053a3.8581b3f1-6380-42c3-9fad-da9061dab6b8 1G Jul 30 16:54:31 devstack sudo[95199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:31 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [req-c39ff9b3-a7b3-4e5d-a9a3-24b61ea3356c req-6b79eb21-32b3-4f51-a0f9-713c7b75e972 tempest-VolumesGetTestJSON-898928988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:54:31 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-c39ff9b3-a7b3-4e5d-a9a3-24b61ea3356c req-6b79eb21-32b3-4f51-a0f9-713c7b75e972 tempest-VolumesGetTestJSON-898928988 None] Flow 'volume_create_manager' (b82cc978-f5f7-46d4-be71-4583317a093e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:31 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-c39ff9b3-a7b3-4e5d-a9a3-24b61ea3356c req-6b79eb21-32b3-4f51-a0f9-713c7b75e972 tempest-VolumesGetTestJSON-898928988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e5e70b1-4fc2-4efa-93e7-2063ede787f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:31 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-c39ff9b3-a7b3-4e5d-a9a3-24b61ea3356c req-6b79eb21-32b3-4f51-a0f9-713c7b75e972 tempest-VolumesGetTestJSON-898928988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e5e70b1-4fc2-4efa-93e7-2063ede787f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1401123755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96e35882-640b-4f25-892b-1c8bd356e38b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8a4a95e3e6a44e669a1fc197791f2aa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:31Z,use_quota=True,user_id='919cd199d6e441ecaf34ea541bfe01b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:31 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-c39ff9b3-a7b3-4e5d-a9a3-24b61ea3356c req-6b79eb21-32b3-4f51-a0f9-713c7b75e972 tempest-VolumesGetTestJSON-898928988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dd6b373-54a8-42fe-afc8-bfc7ce94ee44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:31 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-c39ff9b3-a7b3-4e5d-a9a3-24b61ea3356c req-6b79eb21-32b3-4f51-a0f9-713c7b75e972 tempest-VolumesGetTestJSON-898928988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dd6b373-54a8-42fe-afc8-bfc7ce94ee44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:31 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-c39ff9b3-a7b3-4e5d-a9a3-24b61ea3356c req-6b79eb21-32b3-4f51-a0f9-713c7b75e972 tempest-VolumesGetTestJSON-898928988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37b945ca-bb34-441e-a611-3f3b650e6bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:31 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-c39ff9b3-a7b3-4e5d-a9a3-24b61ea3356c req-6b79eb21-32b3-4f51-a0f9-713c7b75e972 tempest-VolumesGetTestJSON-898928988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37b945ca-bb34-441e-a611-3f3b650e6bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96e35882-640b-4f25-892b-1c8bd356e38b', 'volume_name': 'volume-96e35882-640b-4f25-892b-1c8bd356e38b', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:31 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-c39ff9b3-a7b3-4e5d-a9a3-24b61ea3356c req-6b79eb21-32b3-4f51-a0f9-713c7b75e972 tempest-VolumesGetTestJSON-898928988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c713cd7b-ffe7-4147-9bf9-1c2d92d3fe25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:31 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-c39ff9b3-a7b3-4e5d-a9a3-24b61ea3356c req-6b79eb21-32b3-4f51-a0f9-713c7b75e972 tempest-VolumesGetTestJSON-898928988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c713cd7b-ffe7-4147-9bf9-1c2d92d3fe25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:31 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-c39ff9b3-a7b3-4e5d-a9a3-24b61ea3356c req-6b79eb21-32b3-4f51-a0f9-713c7b75e972 tempest-VolumesGetTestJSON-898928988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b10a1824-7873-484b-9da3-402f2ac66ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:31 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [req-c39ff9b3-a7b3-4e5d-a9a3-24b61ea3356c req-6b79eb21-32b3-4f51-a0f9-713c7b75e972 tempest-VolumesGetTestJSON-898928988 None] Volume 96e35882-640b-4f25-892b-1c8bd356e38b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96e35882-640b-4f25-892b-1c8bd356e38b', 'volume_size': 1} Jul 30 16:54:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-c39ff9b3-a7b3-4e5d-a9a3-24b61ea3356c req-6b79eb21-32b3-4f51-a0f9-713c7b75e972 tempest-VolumesGetTestJSON-898928988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:31 devstack sudo[95199]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [req-92fbd2e8-8f22-4c15-a5da-73cce4f088a3 req-f4f6d77a-1d30-4cfd-877c-f7d60b2311d0 tempest-VolumesSnapshotsTestJSON-234903903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b84694d0-7c8f-4713-9900-9bcfabe053a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b84694d0-7c8f-4713-9900-9bcfabe053a3.8581b3f1-6380-42c3-9fad-da9061dab6b8 1G" returned: 0 in 0.562s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [req-92fbd2e8-8f22-4c15-a5da-73cce4f088a3 req-f4f6d77a-1d30-4cfd-877c-f7d60b2311d0 tempest-VolumesSnapshotsTestJSON-234903903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b84694d0-7c8f-4713-9900-9bcfabe053a3 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b84694d0-7c8f-4713-9900-9bcfabe053a3.8581b3f1-6380-42c3-9fad-da9061dab6b8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:31 devstack sudo[95206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b84694d0-7c8f-4713-9900-9bcfabe053a3 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b84694d0-7c8f-4713-9900-9bcfabe053a3.8581b3f1-6380-42c3-9fad-da9061dab6b8 Jul 30 16:54:31 devstack sudo[95206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:32 devstack sudo[95206]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [req-92fbd2e8-8f22-4c15-a5da-73cce4f088a3 req-f4f6d77a-1d30-4cfd-877c-f7d60b2311d0 tempest-VolumesSnapshotsTestJSON-234903903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b84694d0-7c8f-4713-9900-9bcfabe053a3 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b84694d0-7c8f-4713-9900-9bcfabe053a3.8581b3f1-6380-42c3-9fad-da9061dab6b8" returned: 0 in 0.370s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:32 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [req-92fbd2e8-8f22-4c15-a5da-73cce4f088a3 req-f4f6d77a-1d30-4cfd-877c-f7d60b2311d0 tempest-VolumesSnapshotsTestJSON-234903903 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b84694d0-7c8f-4713-9900-9bcfabe053a3.8581b3f1-6380-42c3-9fad-da9061dab6b8 is being set with open permissions: ugo+rw Jul 30 16:54:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [req-92fbd2e8-8f22-4c15-a5da-73cce4f088a3 req-f4f6d77a-1d30-4cfd-877c-f7d60b2311d0 tempest-VolumesSnapshotsTestJSON-234903903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b84694d0-7c8f-4713-9900-9bcfabe053a3.8581b3f1-6380-42c3-9fad-da9061dab6b8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:32 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-2bf3cef8-a31b-4667-9b4f-4e03509e739d tempest-ServerActionsTestOtherA-277957863 None] Acquiring lock "cinder-a9f8f412-523d-4ad2-9041-c2a96f63ce4f-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:32 devstack sudo[95211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b84694d0-7c8f-4713-9900-9bcfabe053a3.8581b3f1-6380-42c3-9fad-da9061dab6b8 Jul 30 16:54:32 devstack sudo[95211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:32 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-2bf3cef8-a31b-4667-9b4f-4e03509e739d tempest-ServerActionsTestOtherA-277957863 None] Lock "cinder-a9f8f412-523d-4ad2-9041-c2a96f63ce4f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:32 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:SELECT=79,cinder:INSERT=24,cinder:UPDATE=105,cinder:DELETE=8 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:54:32 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-2bf3cef8-a31b-4667-9b4f-4e03509e739d tempest-ServerActionsTestOtherA-277957863 None] Acquiring lock "cinder-quobyte-a9f8f412-523d-4ad2-9041-c2a96f63ce4f" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:32 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-2bf3cef8-a31b-4667-9b4f-4e03509e739d tempest-ServerActionsTestOtherA-277957863 None] Lock "cinder-quobyte-a9f8f412-523d-4ad2-9041-c2a96f63ce4f" acquired by "delete_volume" :: waited 0.021s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:32 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b974b09-a1c5-41dc-a5db-64eae8b72893]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2bf3cef8-a31b-4667-9b4f-4e03509e739d tempest-ServerActionsTestOtherA-277957863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f8f412-523d-4ad2-9041-c2a96f63ce4f {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:32 devstack sudo[95213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f8f412-523d-4ad2-9041-c2a96f63ce4f Jul 30 16:54:32 devstack sudo[95213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:32 devstack sudo[95211]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [req-92fbd2e8-8f22-4c15-a5da-73cce4f088a3 req-f4f6d77a-1d30-4cfd-877c-f7d60b2311d0 tempest-VolumesSnapshotsTestJSON-234903903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b84694d0-7c8f-4713-9900-9bcfabe053a3.8581b3f1-6380-42c3-9fad-da9061dab6b8" returned: 0 in 0.326s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [req-92fbd2e8-8f22-4c15-a5da-73cce4f088a3 req-f4f6d77a-1d30-4cfd-877c-f7d60b2311d0 tempest-VolumesSnapshotsTestJSON-234903903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b84694d0-7c8f-4713-9900-9bcfabe053a3.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:32 devstack sudo[95216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b84694d0-7c8f-4713-9900-9bcfabe053a3.info Jul 30 16:54:32 devstack sudo[95216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:32 devstack sudo[95213]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2bf3cef8-a31b-4667-9b4f-4e03509e739d tempest-ServerActionsTestOtherA-277957863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f8f412-523d-4ad2-9041-c2a96f63ce4f" returned: 0 in 0.418s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2bf3cef8-a31b-4667-9b4f-4e03509e739d tempest-ServerActionsTestOtherA-277957863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f8f412-523d-4ad2-9041-c2a96f63ce4f {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:32 devstack sudo[95222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f8f412-523d-4ad2-9041-c2a96f63ce4f Jul 30 16:54:32 devstack sudo[95222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:32 devstack sudo[95216]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [req-92fbd2e8-8f22-4c15-a5da-73cce4f088a3 req-f4f6d77a-1d30-4cfd-877c-f7d60b2311d0 tempest-VolumesSnapshotsTestJSON-234903903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b84694d0-7c8f-4713-9900-9bcfabe053a3.info" returned: 0 in 0.275s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:32 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [req-92fbd2e8-8f22-4c15-a5da-73cce4f088a3 req-f4f6d77a-1d30-4cfd-877c-f7d60b2311d0 tempest-VolumesSnapshotsTestJSON-234903903 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b84694d0-7c8f-4713-9900-9bcfabe053a3.info is being set with open permissions: ugo+rw Jul 30 16:54:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [req-92fbd2e8-8f22-4c15-a5da-73cce4f088a3 req-f4f6d77a-1d30-4cfd-877c-f7d60b2311d0 tempest-VolumesSnapshotsTestJSON-234903903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b84694d0-7c8f-4713-9900-9bcfabe053a3.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:32 devstack sudo[95224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b84694d0-7c8f-4713-9900-9bcfabe053a3.info Jul 30 16:54:32 devstack sudo[95224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:32 devstack sudo[95222]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2bf3cef8-a31b-4667-9b4f-4e03509e739d tempest-ServerActionsTestOtherA-277957863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f8f412-523d-4ad2-9041-c2a96f63ce4f" returned: 0 in 0.283s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:32 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-2bf3cef8-a31b-4667-9b4f-4e03509e739d tempest-ServerActionsTestOtherA-277957863 None] Lock "cinder-quobyte-a9f8f412-523d-4ad2-9041-c2a96f63ce4f" released by "delete_volume" :: held 0.743s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:32 devstack sudo[95224]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [req-92fbd2e8-8f22-4c15-a5da-73cce4f088a3 req-f4f6d77a-1d30-4cfd-877c-f7d60b2311d0 tempest-VolumesSnapshotsTestJSON-234903903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b84694d0-7c8f-4713-9900-9bcfabe053a3.info" returned: 0 in 0.256s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-92fbd2e8-8f22-4c15-a5da-73cce4f088a3 req-f4f6d77a-1d30-4cfd-877c-f7d60b2311d0 tempest-VolumesSnapshotsTestJSON-234903903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.453s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-c39ff9b3-a7b3-4e5d-a9a3-24b61ea3356c req-6b79eb21-32b3-4f51-a0f9-713c7b75e972 tempest-VolumesGetTestJSON-898928988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.701s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:32 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [req-c39ff9b3-a7b3-4e5d-a9a3-24b61ea3356c req-6b79eb21-32b3-4f51-a0f9-713c7b75e972 tempest-VolumesGetTestJSON-898928988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1401123755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96e35882-640b-4f25-892b-1c8bd356e38b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8a4a95e3e6a44e669a1fc197791f2aa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:31Z,use_quota=True,user_id='919cd199d6e441ecaf34ea541bfe01b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:54:32 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [req-c39ff9b3-a7b3-4e5d-a9a3-24b61ea3356c req-6b79eb21-32b3-4f51-a0f9-713c7b75e972 tempest-VolumesGetTestJSON-898928988 None] Creating volume 96e35882-640b-4f25-892b-1c8bd356e38b {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:54:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-c39ff9b3-a7b3-4e5d-a9a3-24b61ea3356c req-6b79eb21-32b3-4f51-a0f9-713c7b75e972 tempest-VolumesGetTestJSON-898928988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-c39ff9b3-a7b3-4e5d-a9a3-24b61ea3356c req-6b79eb21-32b3-4f51-a0f9-713c7b75e972 tempest-VolumesGetTestJSON-898928988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:32 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [req-c39ff9b3-a7b3-4e5d-a9a3-24b61ea3356c req-6b79eb21-32b3-4f51-a0f9-713c7b75e972 tempest-VolumesGetTestJSON-898928988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:32 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [req-c39ff9b3-a7b3-4e5d-a9a3-24b61ea3356c req-6b79eb21-32b3-4f51-a0f9-713c7b75e972 tempest-VolumesGetTestJSON-898928988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-c39ff9b3-a7b3-4e5d-a9a3-24b61ea3356c req-6b79eb21-32b3-4f51-a0f9-713c7b75e972 tempest-VolumesGetTestJSON-898928988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:32 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [req-c39ff9b3-a7b3-4e5d-a9a3-24b61ea3356c req-6b79eb21-32b3-4f51-a0f9-713c7b75e972 tempest-VolumesGetTestJSON-898928988 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:54:32 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [req-c39ff9b3-a7b3-4e5d-a9a3-24b61ea3356c req-6b79eb21-32b3-4f51-a0f9-713c7b75e972 tempest-VolumesGetTestJSON-898928988 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:54:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [req-c39ff9b3-a7b3-4e5d-a9a3-24b61ea3356c req-6b79eb21-32b3-4f51-a0f9-713c7b75e972 tempest-VolumesGetTestJSON-898928988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-96e35882-640b-4f25-892b-1c8bd356e38b 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:32 devstack sudo[95228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-96e35882-640b-4f25-892b-1c8bd356e38b 1073741824 Jul 30 16:54:32 devstack sudo[95228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:33 devstack cinder-volume[88591]: INFO cinder.volume.manager [req-92fbd2e8-8f22-4c15-a5da-73cce4f088a3 req-f4f6d77a-1d30-4cfd-877c-f7d60b2311d0 tempest-VolumesSnapshotsTestJSON-234903903 None] Create snapshot completed successfully Jul 30 16:54:33 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-2bf3cef8-a31b-4667-9b4f-4e03509e739d tempest-ServerActionsTestOtherA-277957863 None] Created reservations ['8ff91d38-bf0e-4eff-86a4-6c99e58cdd87', 'f341f0e2-d5a6-4bdb-bc33-101a385fd4b1', '4f9ad9f0-7c97-4c8d-bd68-6319652e4db9', '247c7f2b-6a80-44fe-806d-c52e4498cda6'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2bf3cef8-a31b-4667-9b4f-4e03509e739d tempest-ServerActionsTestOtherA-277957863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2bf3cef8-a31b-4667-9b4f-4e03509e739d tempest-ServerActionsTestOtherA-277957863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:33 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-2bf3cef8-a31b-4667-9b4f-4e03509e739d tempest-ServerActionsTestOtherA-277957863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:33 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-2bf3cef8-a31b-4667-9b4f-4e03509e739d tempest-ServerActionsTestOtherA-277957863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2bf3cef8-a31b-4667-9b4f-4e03509e739d tempest-ServerActionsTestOtherA-277957863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2bf3cef8-a31b-4667-9b4f-4e03509e739d tempest-ServerActionsTestOtherA-277957863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:33 devstack sudo[95230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:54:33 devstack sudo[95230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:33 devstack cinder-volume[88591]: DEBUG cinder.coordination [req-32e745d4-3257-4d49-b198-3504252e9338 req-04ef6374-ccf2-48b1-8f7b-dde6ac209fe1 tempest-VolumesSnapshotsTestJSON-234903903 None] Acquiring lock "cinder-8581b3f1-6380-42c3-9fad-da9061dab6b8-delete_snapshot" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:33 devstack cinder-volume[88591]: DEBUG cinder.coordination [req-32e745d4-3257-4d49-b198-3504252e9338 req-04ef6374-ccf2-48b1-8f7b-dde6ac209fe1 tempest-VolumesSnapshotsTestJSON-234903903 None] Lock "cinder-8581b3f1-6380-42c3-9fad-da9061dab6b8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:33 devstack cinder-volume[88591]: DEBUG cinder.coordination [req-32e745d4-3257-4d49-b198-3504252e9338 req-04ef6374-ccf2-48b1-8f7b-dde6ac209fe1 tempest-VolumesSnapshotsTestJSON-234903903 None] Acquiring lock "cinder-quobyte-b84694d0-7c8f-4713-9900-9bcfabe053a3" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:33 devstack cinder-volume[88591]: DEBUG cinder.coordination [req-32e745d4-3257-4d49-b198-3504252e9338 req-04ef6374-ccf2-48b1-8f7b-dde6ac209fe1 tempest-VolumesSnapshotsTestJSON-234903903 None] Lock "cinder-quobyte-b84694d0-7c8f-4713-9900-9bcfabe053a3" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:33 devstack cinder-volume[88591]: DEBUG cinder.coordination [req-32e745d4-3257-4d49-b198-3504252e9338 req-04ef6374-ccf2-48b1-8f7b-dde6ac209fe1 tempest-VolumesSnapshotsTestJSON-234903903 None] Acquiring lock "cinder-quobyte-8581b3f1-6380-42c3-9fad-da9061dab6b8" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:33 devstack cinder-volume[88591]: DEBUG cinder.coordination [req-32e745d4-3257-4d49-b198-3504252e9338 req-04ef6374-ccf2-48b1-8f7b-dde6ac209fe1 tempest-VolumesSnapshotsTestJSON-234903903 None] Lock "cinder-quobyte-8581b3f1-6380-42c3-9fad-da9061dab6b8" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:33 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [req-32e745d4-3257-4d49-b198-3504252e9338 req-04ef6374-ccf2-48b1-8f7b-dde6ac209fe1 tempest-VolumesSnapshotsTestJSON-234903903 None] Deleting offline snapshot 8581b3f1-6380-42c3-9fad-da9061dab6b8 of volume b84694d0-7c8f-4713-9900-9bcfabe053a3 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:54:33 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [req-32e745d4-3257-4d49-b198-3504252e9338 req-04ef6374-ccf2-48b1-8f7b-dde6ac209fe1 tempest-VolumesSnapshotsTestJSON-234903903 None] snapshot_file for this snap is: volume-b84694d0-7c8f-4713-9900-9bcfabe053a3.8581b3f1-6380-42c3-9fad-da9061dab6b8 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:54:33 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[61122ffa-c94c-4e84-894d-555a7e81018b]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [req-32e745d4-3257-4d49-b198-3504252e9338 req-04ef6374-ccf2-48b1-8f7b-dde6ac209fe1 tempest-VolumesSnapshotsTestJSON-234903903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b84694d0-7c8f-4713-9900-9bcfabe053a3.8581b3f1-6380-42c3-9fad-da9061dab6b8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:33 devstack sudo[95230]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2bf3cef8-a31b-4667-9b4f-4e03509e739d tempest-ServerActionsTestOtherA-277957863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.427s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:33 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-2bf3cef8-a31b-4667-9b4f-4e03509e739d tempest-ServerActionsTestOtherA-277957863 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:54:33 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-2bf3cef8-a31b-4667-9b4f-4e03509e739d tempest-ServerActionsTestOtherA-277957863 None] Deleted volume successfully. Jul 30 16:54:33 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-2bf3cef8-a31b-4667-9b4f-4e03509e739d tempest-ServerActionsTestOtherA-277957863 None] Lock "cinder-a9f8f412-523d-4ad2-9041-c2a96f63ce4f-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:33 devstack sudo[95239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b84694d0-7c8f-4713-9900-9bcfabe053a3.8581b3f1-6380-42c3-9fad-da9061dab6b8 Jul 30 16:54:33 devstack sudo[95239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:33 devstack sudo[95228]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [req-c39ff9b3-a7b3-4e5d-a9a3-24b61ea3356c req-6b79eb21-32b3-4f51-a0f9-713c7b75e972 tempest-VolumesGetTestJSON-898928988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-96e35882-640b-4f25-892b-1c8bd356e38b 1073741824" returned: 0 in 0.796s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [req-c39ff9b3-a7b3-4e5d-a9a3-24b61ea3356c req-6b79eb21-32b3-4f51-a0f9-713c7b75e972 tempest-VolumesGetTestJSON-898928988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-96e35882-640b-4f25-892b-1c8bd356e38b {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:33 devstack sudo[95243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-96e35882-640b-4f25-892b-1c8bd356e38b Jul 30 16:54:33 devstack sudo[95243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:34 devstack sudo[95239]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [req-32e745d4-3257-4d49-b198-3504252e9338 req-04ef6374-ccf2-48b1-8f7b-dde6ac209fe1 tempest-VolumesSnapshotsTestJSON-234903903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b84694d0-7c8f-4713-9900-9bcfabe053a3.8581b3f1-6380-42c3-9fad-da9061dab6b8" returned: 0 in 0.503s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:34 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [req-32e745d4-3257-4d49-b198-3504252e9338 req-04ef6374-ccf2-48b1-8f7b-dde6ac209fe1 tempest-VolumesSnapshotsTestJSON-234903903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b84694d0-7c8f-4713-9900-9bcfabe053a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:54:34 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d2a58f-b922-4502-8253-00b68a91a3be]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [req-32e745d4-3257-4d49-b198-3504252e9338 req-04ef6374-ccf2-48b1-8f7b-dde6ac209fe1 tempest-VolumesSnapshotsTestJSON-234903903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b84694d0-7c8f-4713-9900-9bcfabe053a3 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:34 devstack sudo[95243]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [req-c39ff9b3-a7b3-4e5d-a9a3-24b61ea3356c req-6b79eb21-32b3-4f51-a0f9-713c7b75e972 tempest-VolumesGetTestJSON-898928988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-96e35882-640b-4f25-892b-1c8bd356e38b" returned: 0 in 0.342s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:34 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [req-c39ff9b3-a7b3-4e5d-a9a3-24b61ea3356c req-6b79eb21-32b3-4f51-a0f9-713c7b75e972 tempest-VolumesGetTestJSON-898928988 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:54:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-c39ff9b3-a7b3-4e5d-a9a3-24b61ea3356c req-6b79eb21-32b3-4f51-a0f9-713c7b75e972 tempest-VolumesGetTestJSON-898928988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.191s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-c39ff9b3-a7b3-4e5d-a9a3-24b61ea3356c req-6b79eb21-32b3-4f51-a0f9-713c7b75e972 tempest-VolumesGetTestJSON-898928988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b10a1824-7873-484b-9da3-402f2ac66ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96e35882-640b-4f25-892b-1c8bd356e38b', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-c39ff9b3-a7b3-4e5d-a9a3-24b61ea3356c req-6b79eb21-32b3-4f51-a0f9-713c7b75e972 tempest-VolumesGetTestJSON-898928988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (befb6183-28e4-441f-9b82-e038af00592f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:34 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [req-c39ff9b3-a7b3-4e5d-a9a3-24b61ea3356c req-6b79eb21-32b3-4f51-a0f9-713c7b75e972 tempest-VolumesGetTestJSON-898928988 None] Volume volume-96e35882-640b-4f25-892b-1c8bd356e38b (96e35882-640b-4f25-892b-1c8bd356e38b): created successfully Jul 30 16:54:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-c39ff9b3-a7b3-4e5d-a9a3-24b61ea3356c req-6b79eb21-32b3-4f51-a0f9-713c7b75e972 tempest-VolumesGetTestJSON-898928988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (befb6183-28e4-441f-9b82-e038af00592f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-c39ff9b3-a7b3-4e5d-a9a3-24b61ea3356c req-6b79eb21-32b3-4f51-a0f9-713c7b75e972 tempest-VolumesGetTestJSON-898928988 None] Flow 'volume_create_manager' (b82cc978-f5f7-46d4-be71-4583317a093e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:34 devstack cinder-volume[88591]: INFO cinder.volume.manager [req-c39ff9b3-a7b3-4e5d-a9a3-24b61ea3356c req-6b79eb21-32b3-4f51-a0f9-713c7b75e972 tempest-VolumesGetTestJSON-898928988 None] Created volume successfully. Jul 30 16:54:34 devstack sudo[95257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b84694d0-7c8f-4713-9900-9bcfabe053a3 Jul 30 16:54:34 devstack sudo[95257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:34 devstack sudo[95257]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [req-32e745d4-3257-4d49-b198-3504252e9338 req-04ef6374-ccf2-48b1-8f7b-dde6ac209fe1 tempest-VolumesSnapshotsTestJSON-234903903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b84694d0-7c8f-4713-9900-9bcfabe053a3" returned: 0 in 0.654s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [req-32e745d4-3257-4d49-b198-3504252e9338 req-04ef6374-ccf2-48b1-8f7b-dde6ac209fe1 tempest-VolumesSnapshotsTestJSON-234903903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b84694d0-7c8f-4713-9900-9bcfabe053a3.8581b3f1-6380-42c3-9fad-da9061dab6b8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:34 devstack cinder-volume[88591]: DEBUG cinder.coordination [req-63f4d14e-07e0-40ce-be66-2054c896a2c3 req-3b59a3bb-3087-4177-8fa3-4ce4bd152054 tempest-VolumesGetTestJSON-898928988 None] Acquiring lock "cinder-96e35882-640b-4f25-892b-1c8bd356e38b-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:34 devstack sudo[95278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b84694d0-7c8f-4713-9900-9bcfabe053a3.8581b3f1-6380-42c3-9fad-da9061dab6b8 Jul 30 16:54:34 devstack sudo[95278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:34 devstack cinder-volume[88591]: DEBUG cinder.coordination [req-63f4d14e-07e0-40ce-be66-2054c896a2c3 req-3b59a3bb-3087-4177-8fa3-4ce4bd152054 tempest-VolumesGetTestJSON-898928988 None] Lock "cinder-96e35882-640b-4f25-892b-1c8bd356e38b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:34 devstack cinder-volume[88591]: DEBUG cinder.coordination [req-63f4d14e-07e0-40ce-be66-2054c896a2c3 req-3b59a3bb-3087-4177-8fa3-4ce4bd152054 tempest-VolumesGetTestJSON-898928988 None] Acquiring lock "cinder-quobyte-96e35882-640b-4f25-892b-1c8bd356e38b" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:34 devstack cinder-volume[88591]: DEBUG cinder.coordination [req-63f4d14e-07e0-40ce-be66-2054c896a2c3 req-3b59a3bb-3087-4177-8fa3-4ce4bd152054 tempest-VolumesGetTestJSON-898928988 None] Lock "cinder-quobyte-96e35882-640b-4f25-892b-1c8bd356e38b" acquired by "delete_volume" :: waited 0.020s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:34 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8384c8af-038d-4ded-aa90-2eb774e13846]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [req-63f4d14e-07e0-40ce-be66-2054c896a2c3 req-3b59a3bb-3087-4177-8fa3-4ce4bd152054 tempest-VolumesGetTestJSON-898928988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-96e35882-640b-4f25-892b-1c8bd356e38b {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:35 devstack sudo[95280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-96e35882-640b-4f25-892b-1c8bd356e38b Jul 30 16:54:35 devstack sudo[95280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:35 devstack sudo[95278]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [req-32e745d4-3257-4d49-b198-3504252e9338 req-04ef6374-ccf2-48b1-8f7b-dde6ac209fe1 tempest-VolumesSnapshotsTestJSON-234903903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b84694d0-7c8f-4713-9900-9bcfabe053a3.8581b3f1-6380-42c3-9fad-da9061dab6b8" returned: 0 in 0.562s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [req-32e745d4-3257-4d49-b198-3504252e9338 req-04ef6374-ccf2-48b1-8f7b-dde6ac209fe1 tempest-VolumesSnapshotsTestJSON-234903903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b84694d0-7c8f-4713-9900-9bcfabe053a3.8581b3f1-6380-42c3-9fad-da9061dab6b8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:35 devstack sudo[95285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b84694d0-7c8f-4713-9900-9bcfabe053a3.8581b3f1-6380-42c3-9fad-da9061dab6b8 Jul 30 16:54:35 devstack sudo[95285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:35 devstack sudo[95280]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [req-63f4d14e-07e0-40ce-be66-2054c896a2c3 req-3b59a3bb-3087-4177-8fa3-4ce4bd152054 tempest-VolumesGetTestJSON-898928988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-96e35882-640b-4f25-892b-1c8bd356e38b" returned: 0 in 0.634s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [req-63f4d14e-07e0-40ce-be66-2054c896a2c3 req-3b59a3bb-3087-4177-8fa3-4ce4bd152054 tempest-VolumesGetTestJSON-898928988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-96e35882-640b-4f25-892b-1c8bd356e38b {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:35 devstack sudo[95290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-96e35882-640b-4f25-892b-1c8bd356e38b Jul 30 16:54:35 devstack sudo[95290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:35 devstack sudo[95285]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [req-32e745d4-3257-4d49-b198-3504252e9338 req-04ef6374-ccf2-48b1-8f7b-dde6ac209fe1 tempest-VolumesSnapshotsTestJSON-234903903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b84694d0-7c8f-4713-9900-9bcfabe053a3.8581b3f1-6380-42c3-9fad-da9061dab6b8" returned: 0 in 0.456s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:35 devstack cinder-volume[88591]: DEBUG cinder.coordination [req-32e745d4-3257-4d49-b198-3504252e9338 req-04ef6374-ccf2-48b1-8f7b-dde6ac209fe1 tempest-VolumesSnapshotsTestJSON-234903903 None] Lock "cinder-quobyte-8581b3f1-6380-42c3-9fad-da9061dab6b8" released by "_delete_snapshot" :: held 2.381s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:35 devstack cinder-volume[88591]: DEBUG cinder.coordination [req-32e745d4-3257-4d49-b198-3504252e9338 req-04ef6374-ccf2-48b1-8f7b-dde6ac209fe1 tempest-VolumesSnapshotsTestJSON-234903903 None] Lock "cinder-quobyte-b84694d0-7c8f-4713-9900-9bcfabe053a3" released by "delete_snapshot" :: held 2.443s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:35 devstack sudo[95290]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [req-63f4d14e-07e0-40ce-be66-2054c896a2c3 req-3b59a3bb-3087-4177-8fa3-4ce4bd152054 tempest-VolumesGetTestJSON-898928988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-96e35882-640b-4f25-892b-1c8bd356e38b" returned: 0 in 0.333s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:35 devstack cinder-volume[88591]: DEBUG cinder.coordination [req-63f4d14e-07e0-40ce-be66-2054c896a2c3 req-3b59a3bb-3087-4177-8fa3-4ce4bd152054 tempest-VolumesGetTestJSON-898928988 None] Lock "cinder-quobyte-96e35882-640b-4f25-892b-1c8bd356e38b" released by "delete_volume" :: held 1.026s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:35 devstack cinder-volume[88591]: WARNING cinder.quota [req-32e745d4-3257-4d49-b198-3504252e9338 req-04ef6374-ccf2-48b1-8f7b-dde6ac209fe1 tempest-VolumesSnapshotsTestJSON-234903903 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:54:36 devstack cinder-volume[88591]: DEBUG cinder.quota [req-32e745d4-3257-4d49-b198-3504252e9338 req-04ef6374-ccf2-48b1-8f7b-dde6ac209fe1 tempest-VolumesSnapshotsTestJSON-234903903 None] Created reservations ['9e1d0c4f-4582-476b-b674-2df421d3ce05', 'bd7cab73-e369-4b7b-b1e8-6c3759c8055d', 'abc3e3f7-1016-47f7-aa63-64ec5a7db0b9', '013525d9-5884-4ed2-9916-355a10b6cb4c'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:36 devstack cinder-volume[88591]: DEBUG cinder.quota [req-63f4d14e-07e0-40ce-be66-2054c896a2c3 req-3b59a3bb-3087-4177-8fa3-4ce4bd152054 tempest-VolumesGetTestJSON-898928988 None] Created reservations ['80520697-9b49-44ad-8420-460e16ca1f9a', '6f5d2d3f-2e98-4f52-9f92-bb291e7c8033', '11b9c497-b5e8-4845-963b-d34a9e352ef1', 'cb290cce-423d-49fa-bf88-ccd1d0899659'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:36 devstack cinder-volume[88591]: INFO cinder.volume.manager [req-32e745d4-3257-4d49-b198-3504252e9338 req-04ef6374-ccf2-48b1-8f7b-dde6ac209fe1 tempest-VolumesSnapshotsTestJSON-234903903 None] Delete snapshot completed successfully. Jul 30 16:54:36 devstack cinder-volume[88591]: DEBUG cinder.coordination [req-32e745d4-3257-4d49-b198-3504252e9338 req-04ef6374-ccf2-48b1-8f7b-dde6ac209fe1 tempest-VolumesSnapshotsTestJSON-234903903 None] Lock "cinder-8581b3f1-6380-42c3-9fad-da9061dab6b8-delete_snapshot" released by "delete_snapshot" :: held 2.796s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-63f4d14e-07e0-40ce-be66-2054c896a2c3 req-3b59a3bb-3087-4177-8fa3-4ce4bd152054 tempest-VolumesGetTestJSON-898928988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-63f4d14e-07e0-40ce-be66-2054c896a2c3 req-3b59a3bb-3087-4177-8fa3-4ce4bd152054 tempest-VolumesGetTestJSON-898928988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:36 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [req-63f4d14e-07e0-40ce-be66-2054c896a2c3 req-3b59a3bb-3087-4177-8fa3-4ce4bd152054 tempest-VolumesGetTestJSON-898928988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:36 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [req-63f4d14e-07e0-40ce-be66-2054c896a2c3 req-3b59a3bb-3087-4177-8fa3-4ce4bd152054 tempest-VolumesGetTestJSON-898928988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-63f4d14e-07e0-40ce-be66-2054c896a2c3 req-3b59a3bb-3087-4177-8fa3-4ce4bd152054 tempest-VolumesGetTestJSON-898928988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [req-63f4d14e-07e0-40ce-be66-2054c896a2c3 req-3b59a3bb-3087-4177-8fa3-4ce4bd152054 tempest-VolumesGetTestJSON-898928988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:36 devstack sudo[95296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:54:36 devstack sudo[95296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:36 devstack sudo[95296]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [req-63f4d14e-07e0-40ce-be66-2054c896a2c3 req-3b59a3bb-3087-4177-8fa3-4ce4bd152054 tempest-VolumesGetTestJSON-898928988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.354s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:36 devstack cinder-volume[88591]: DEBUG cinder.manager [req-63f4d14e-07e0-40ce-be66-2054c896a2c3 req-3b59a3bb-3087-4177-8fa3-4ce4bd152054 tempest-VolumesGetTestJSON-898928988 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:54:36 devstack cinder-volume[88591]: INFO cinder.volume.manager [req-63f4d14e-07e0-40ce-be66-2054c896a2c3 req-3b59a3bb-3087-4177-8fa3-4ce4bd152054 tempest-VolumesGetTestJSON-898928988 None] Deleted volume successfully. Jul 30 16:54:36 devstack cinder-volume[88591]: DEBUG cinder.coordination [req-63f4d14e-07e0-40ce-be66-2054c896a2c3 req-3b59a3bb-3087-4177-8fa3-4ce4bd152054 tempest-VolumesGetTestJSON-898928988 None] Lock "cinder-96e35882-640b-4f25-892b-1c8bd356e38b-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:36 devstack cinder-volume[88591]: DEBUG cinder.coordination [req-99daafbb-bc1f-41c2-9565-3b1eb8bba9f8 req-9842d1f1-7400-4564-afef-40626a3e7783 tempest-VolumesSnapshotsTestJSON-234903903 None] Acquiring lock "cinder-b84694d0-7c8f-4713-9900-9bcfabe053a3-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:36 devstack cinder-volume[88591]: DEBUG cinder.coordination [req-99daafbb-bc1f-41c2-9565-3b1eb8bba9f8 req-9842d1f1-7400-4564-afef-40626a3e7783 tempest-VolumesSnapshotsTestJSON-234903903 None] Lock "cinder-b84694d0-7c8f-4713-9900-9bcfabe053a3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:37 devstack cinder-volume[88591]: DEBUG cinder.coordination [req-99daafbb-bc1f-41c2-9565-3b1eb8bba9f8 req-9842d1f1-7400-4564-afef-40626a3e7783 tempest-VolumesSnapshotsTestJSON-234903903 None] Acquiring lock "cinder-quobyte-b84694d0-7c8f-4713-9900-9bcfabe053a3" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:37 devstack cinder-volume[88591]: DEBUG cinder.coordination [req-99daafbb-bc1f-41c2-9565-3b1eb8bba9f8 req-9842d1f1-7400-4564-afef-40626a3e7783 tempest-VolumesSnapshotsTestJSON-234903903 None] Lock "cinder-quobyte-b84694d0-7c8f-4713-9900-9bcfabe053a3" acquired by "delete_volume" :: waited 0.025s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:37 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a971628f-4bab-4ba8-8ede-20d538604fa0]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [req-99daafbb-bc1f-41c2-9565-3b1eb8bba9f8 req-9842d1f1-7400-4564-afef-40626a3e7783 tempest-VolumesSnapshotsTestJSON-234903903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b84694d0-7c8f-4713-9900-9bcfabe053a3 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:37 devstack sudo[95300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b84694d0-7c8f-4713-9900-9bcfabe053a3 Jul 30 16:54:37 devstack sudo[95300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:37 devstack sudo[95300]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [req-99daafbb-bc1f-41c2-9565-3b1eb8bba9f8 req-9842d1f1-7400-4564-afef-40626a3e7783 tempest-VolumesSnapshotsTestJSON-234903903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b84694d0-7c8f-4713-9900-9bcfabe053a3" returned: 0 in 0.550s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [req-99daafbb-bc1f-41c2-9565-3b1eb8bba9f8 req-9842d1f1-7400-4564-afef-40626a3e7783 tempest-VolumesSnapshotsTestJSON-234903903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b84694d0-7c8f-4713-9900-9bcfabe053a3 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:37 devstack sudo[95305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b84694d0-7c8f-4713-9900-9bcfabe053a3 Jul 30 16:54:37 devstack sudo[95305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:38 devstack sudo[95305]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [req-99daafbb-bc1f-41c2-9565-3b1eb8bba9f8 req-9842d1f1-7400-4564-afef-40626a3e7783 tempest-VolumesSnapshotsTestJSON-234903903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b84694d0-7c8f-4713-9900-9bcfabe053a3" returned: 0 in 0.392s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:38 devstack cinder-volume[88591]: DEBUG cinder.coordination [req-99daafbb-bc1f-41c2-9565-3b1eb8bba9f8 req-9842d1f1-7400-4564-afef-40626a3e7783 tempest-VolumesSnapshotsTestJSON-234903903 None] Lock "cinder-quobyte-b84694d0-7c8f-4713-9900-9bcfabe053a3" released by "delete_volume" :: held 1.047s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:38 devstack cinder-volume[88591]: DEBUG cinder.quota [req-99daafbb-bc1f-41c2-9565-3b1eb8bba9f8 req-9842d1f1-7400-4564-afef-40626a3e7783 tempest-VolumesSnapshotsTestJSON-234903903 None] Created reservations ['cda66496-3449-44ba-9640-7bb3411677ae', 'a4c99153-6986-478b-aea9-e934a1b8d4fb', 'c2b20970-2c47-4c09-8c9e-bbd5ba42a35f', '790f47f3-08b8-4649-a22c-fcb7d9c606ea'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-99daafbb-bc1f-41c2-9565-3b1eb8bba9f8 req-9842d1f1-7400-4564-afef-40626a3e7783 tempest-VolumesSnapshotsTestJSON-234903903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-99daafbb-bc1f-41c2-9565-3b1eb8bba9f8 req-9842d1f1-7400-4564-afef-40626a3e7783 tempest-VolumesSnapshotsTestJSON-234903903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:38 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [req-99daafbb-bc1f-41c2-9565-3b1eb8bba9f8 req-9842d1f1-7400-4564-afef-40626a3e7783 tempest-VolumesSnapshotsTestJSON-234903903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:38 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [req-99daafbb-bc1f-41c2-9565-3b1eb8bba9f8 req-9842d1f1-7400-4564-afef-40626a3e7783 tempest-VolumesSnapshotsTestJSON-234903903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-99daafbb-bc1f-41c2-9565-3b1eb8bba9f8 req-9842d1f1-7400-4564-afef-40626a3e7783 tempest-VolumesSnapshotsTestJSON-234903903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [req-99daafbb-bc1f-41c2-9565-3b1eb8bba9f8 req-9842d1f1-7400-4564-afef-40626a3e7783 tempest-VolumesSnapshotsTestJSON-234903903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:38 devstack sudo[95308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:54:38 devstack sudo[95308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:38 devstack sudo[95308]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [req-99daafbb-bc1f-41c2-9565-3b1eb8bba9f8 req-9842d1f1-7400-4564-afef-40626a3e7783 tempest-VolumesSnapshotsTestJSON-234903903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.305s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:38 devstack cinder-volume[88591]: DEBUG cinder.manager [req-99daafbb-bc1f-41c2-9565-3b1eb8bba9f8 req-9842d1f1-7400-4564-afef-40626a3e7783 tempest-VolumesSnapshotsTestJSON-234903903 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:54:38 devstack cinder-volume[88591]: INFO cinder.volume.manager [req-99daafbb-bc1f-41c2-9565-3b1eb8bba9f8 req-9842d1f1-7400-4564-afef-40626a3e7783 tempest-VolumesSnapshotsTestJSON-234903903 None] Deleted volume successfully. Jul 30 16:54:38 devstack cinder-volume[88591]: DEBUG cinder.coordination [req-99daafbb-bc1f-41c2-9565-3b1eb8bba9f8 req-9842d1f1-7400-4564-afef-40626a3e7783 tempest-VolumesSnapshotsTestJSON-234903903 None] Lock "cinder-b84694d0-7c8f-4713-9900-9bcfabe053a3-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:45 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:INSERT=26,cinder:UPDATE=98,cinder:SELECT=94,cinder:DELETE=9 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:54:45 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-26ede219-4fbe-44c5-8a21-156ee2cba050 tempest-GroupsTest-1275132889 None] Group tempest-Group1-1657695241: creating Jul 30 16:54:45 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-26ede219-4fbe-44c5-8a21-156ee2cba050 tempest-GroupsTest-1275132889 None] Group tempest-Group1-1657695241: created successfully Jul 30 16:54:45 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-26ede219-4fbe-44c5-8a21-156ee2cba050 tempest-GroupsTest-1275132889 None] Create group completed successfully. Jul 30 16:54:46 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-d3570b4a-fe8f-4716-941d-ae1cd8dc1596 tempest-GroupsTest-1275132889 None] Group tempest-Group2-1999320631: creating Jul 30 16:54:46 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-d3570b4a-fe8f-4716-941d-ae1cd8dc1596 tempest-GroupsTest-1275132889 None] Group tempest-Group2-1999320631: created successfully Jul 30 16:54:46 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-d3570b4a-fe8f-4716-941d-ae1cd8dc1596 tempest-GroupsTest-1275132889 None] Create group completed successfully. Jul 30 16:54:46 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-76b0b8b5-94f1-4e70-97ca-24b52ba0347c tempest-GroupSnapshotsTest-894339262 None] Group tempest-GroupSnapshotsTest-Group-1936517642: creating Jul 30 16:54:46 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-76b0b8b5-94f1-4e70-97ca-24b52ba0347c tempest-GroupSnapshotsTest-894339262 None] Group tempest-GroupSnapshotsTest-Group-1936517642: created successfully Jul 30 16:54:46 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-76b0b8b5-94f1-4e70-97ca-24b52ba0347c tempest-GroupSnapshotsTest-894339262 None] Create group completed successfully. Jul 30 16:54:48 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-0826c4b2-ec3f-41fe-be47-741bd9ad16bb tempest-GroupsTest-1275132889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:54:48 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0826c4b2-ec3f-41fe-be47-741bd9ad16bb tempest-GroupsTest-1275132889 None] Flow 'volume_create_manager' (d22ce430-858a-4e7b-8592-842a6a9f9678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:48 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0826c4b2-ec3f-41fe-be47-741bd9ad16bb tempest-GroupsTest-1275132889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df0e5ab9-b6fc-4f7f-9845-86f74308f052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:48 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0826c4b2-ec3f-41fe-be47-741bd9ad16bb tempest-GroupsTest-1275132889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df0e5ab9-b6fc-4f7f-9845-86f74308f052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1366701602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dcf95855-13df-4f75-b621-6afee4b714b9,host='devstack@QuobyteHD#QuobyteHD',id=a92d17eb-7fd9-4f65-a9a2-ccd73c6fd3c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86f0ff562125400a97c53c42b63c3c6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:48Z,use_quota=True,user_id='edd9ca7eb21744f7be6550f3f4e7bc65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3a99213-504d-42cf-b0ce-bde41f0353f0),volume_type_id=b3a99213-504d-42cf-b0ce-bde41f0353f0)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:48 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0826c4b2-ec3f-41fe-be47-741bd9ad16bb tempest-GroupsTest-1275132889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (364623d8-869f-4bf8-bbf1-3a4d4488c54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:48 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0826c4b2-ec3f-41fe-be47-741bd9ad16bb tempest-GroupsTest-1275132889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (364623d8-869f-4bf8-bbf1-3a4d4488c54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:48 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0826c4b2-ec3f-41fe-be47-741bd9ad16bb tempest-GroupsTest-1275132889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82dade4a-9c9d-4dd4-b96a-8dfe13383ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:48 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0826c4b2-ec3f-41fe-be47-741bd9ad16bb tempest-GroupsTest-1275132889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82dade4a-9c9d-4dd4-b96a-8dfe13383ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a92d17eb-7fd9-4f65-a9a2-ccd73c6fd3c3', 'volume_name': 'volume-a92d17eb-7fd9-4f65-a9a2-ccd73c6fd3c3', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:48 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0826c4b2-ec3f-41fe-be47-741bd9ad16bb tempest-GroupsTest-1275132889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d67b8f99-b57f-4be6-8195-0ea9892bb621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:48 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0826c4b2-ec3f-41fe-be47-741bd9ad16bb tempest-GroupsTest-1275132889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d67b8f99-b57f-4be6-8195-0ea9892bb621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:48 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0826c4b2-ec3f-41fe-be47-741bd9ad16bb tempest-GroupsTest-1275132889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a9f8097-e6d9-431c-b26f-8806bf5e755b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:48 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-0826c4b2-ec3f-41fe-be47-741bd9ad16bb tempest-GroupsTest-1275132889 None] Volume a92d17eb-7fd9-4f65-a9a2-ccd73c6fd3c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a92d17eb-7fd9-4f65-a9a2-ccd73c6fd3c3', 'volume_size': 1} Jul 30 16:54:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0826c4b2-ec3f-41fe-be47-741bd9ad16bb tempest-GroupsTest-1275132889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0826c4b2-ec3f-41fe-be47-741bd9ad16bb tempest-GroupsTest-1275132889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:48 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-0826c4b2-ec3f-41fe-be47-741bd9ad16bb tempest-GroupsTest-1275132889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=dcf95855-13df-4f75-b621-6afee4b714b9,created_at=2026-07-30T14:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1366701602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dcf95855-13df-4f75-b621-6afee4b714b9,host='devstack@QuobyteHD#QuobyteHD',id=a92d17eb-7fd9-4f65-a9a2-ccd73c6fd3c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86f0ff562125400a97c53c42b63c3c6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:48Z,use_quota=True,user_id='edd9ca7eb21744f7be6550f3f4e7bc65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3a99213-504d-42cf-b0ce-bde41f0353f0),volume_type_id=b3a99213-504d-42cf-b0ce-bde41f0353f0)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:54:48 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-0826c4b2-ec3f-41fe-be47-741bd9ad16bb tempest-GroupsTest-1275132889 None] Creating volume a92d17eb-7fd9-4f65-a9a2-ccd73c6fd3c3 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:54:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0826c4b2-ec3f-41fe-be47-741bd9ad16bb tempest-GroupsTest-1275132889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0826c4b2-ec3f-41fe-be47-741bd9ad16bb tempest-GroupsTest-1275132889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:48 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-0826c4b2-ec3f-41fe-be47-741bd9ad16bb tempest-GroupsTest-1275132889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:48 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-0826c4b2-ec3f-41fe-be47-741bd9ad16bb tempest-GroupsTest-1275132889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0826c4b2-ec3f-41fe-be47-741bd9ad16bb tempest-GroupsTest-1275132889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:48 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-0826c4b2-ec3f-41fe-be47-741bd9ad16bb tempest-GroupsTest-1275132889 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:54:48 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-0826c4b2-ec3f-41fe-be47-741bd9ad16bb tempest-GroupsTest-1275132889 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:54:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0826c4b2-ec3f-41fe-be47-741bd9ad16bb tempest-GroupsTest-1275132889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a92d17eb-7fd9-4f65-a9a2-ccd73c6fd3c3 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:48 devstack sudo[95357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a92d17eb-7fd9-4f65-a9a2-ccd73c6fd3c3 1073741824 Jul 30 16:54:48 devstack sudo[95357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:48 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd68400a-0fb0-41d3-aa16-3b3981b493eb tempest-GroupSnapshotsTest-894339262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:54:48 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bd68400a-0fb0-41d3-aa16-3b3981b493eb tempest-GroupSnapshotsTest-894339262 None] Flow 'volume_create_manager' (57123337-fd3a-4312-883f-53f56993a4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:48 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bd68400a-0fb0-41d3-aa16-3b3981b493eb tempest-GroupSnapshotsTest-894339262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31cfa3a2-af1a-45fe-9ddb-cad4e60cae3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:48 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bd68400a-0fb0-41d3-aa16-3b3981b493eb tempest-GroupSnapshotsTest-894339262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31cfa3a2-af1a-45fe-9ddb-cad4e60cae3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-773740929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a75760a3-e49e-4556-92a8-7624a34a2ca3,host='devstack@QuobyteHD#QuobyteHD',id=78aeb2c4-ffa5-4f82-a6d1-fae1dd934182,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83a0d1d09329442397d9fb171d5d9bf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:49Z,use_quota=True,user_id='b2dffab8703341f598abb31c84441738',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd77be3d-3f47-4e35-903c-7642f7ed8ada),volume_type_id=bd77be3d-3f47-4e35-903c-7642f7ed8ada)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:48 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bd68400a-0fb0-41d3-aa16-3b3981b493eb tempest-GroupSnapshotsTest-894339262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26c9b477-482a-4b2e-b8e6-5d09aee3b5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:48 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bd68400a-0fb0-41d3-aa16-3b3981b493eb tempest-GroupSnapshotsTest-894339262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26c9b477-482a-4b2e-b8e6-5d09aee3b5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:48 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bd68400a-0fb0-41d3-aa16-3b3981b493eb tempest-GroupSnapshotsTest-894339262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70746e3a-b9ca-438e-ba1b-32b38d8de8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:48 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bd68400a-0fb0-41d3-aa16-3b3981b493eb tempest-GroupSnapshotsTest-894339262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70746e3a-b9ca-438e-ba1b-32b38d8de8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78aeb2c4-ffa5-4f82-a6d1-fae1dd934182', 'volume_name': 'volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:48 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bd68400a-0fb0-41d3-aa16-3b3981b493eb tempest-GroupSnapshotsTest-894339262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64c8324f-eac1-4a23-8650-6af77625360a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:48 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bd68400a-0fb0-41d3-aa16-3b3981b493eb tempest-GroupSnapshotsTest-894339262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64c8324f-eac1-4a23-8650-6af77625360a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:48 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bd68400a-0fb0-41d3-aa16-3b3981b493eb tempest-GroupSnapshotsTest-894339262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc782136-c452-46ff-b5ee-4cbaff586d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:48 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-bd68400a-0fb0-41d3-aa16-3b3981b493eb tempest-GroupSnapshotsTest-894339262 None] Volume 78aeb2c4-ffa5-4f82-a6d1-fae1dd934182: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182', 'volume_size': 1} Jul 30 16:54:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-bd68400a-0fb0-41d3-aa16-3b3981b493eb tempest-GroupSnapshotsTest-894339262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:49 devstack sudo[95357]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0826c4b2-ec3f-41fe-be47-741bd9ad16bb tempest-GroupsTest-1275132889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a92d17eb-7fd9-4f65-a9a2-ccd73c6fd3c3 1073741824" returned: 0 in 0.548s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0826c4b2-ec3f-41fe-be47-741bd9ad16bb tempest-GroupsTest-1275132889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a92d17eb-7fd9-4f65-a9a2-ccd73c6fd3c3 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:49 devstack sudo[95363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a92d17eb-7fd9-4f65-a9a2-ccd73c6fd3c3 Jul 30 16:54:49 devstack sudo[95363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:49 devstack sudo[95363]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0826c4b2-ec3f-41fe-be47-741bd9ad16bb tempest-GroupsTest-1275132889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a92d17eb-7fd9-4f65-a9a2-ccd73c6fd3c3" returned: 0 in 0.338s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:49 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-0826c4b2-ec3f-41fe-be47-741bd9ad16bb tempest-GroupsTest-1275132889 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:54:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0826c4b2-ec3f-41fe-be47-741bd9ad16bb tempest-GroupsTest-1275132889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-bd68400a-0fb0-41d3-aa16-3b3981b493eb tempest-GroupSnapshotsTest-894339262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.799s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:49 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-bd68400a-0fb0-41d3-aa16-3b3981b493eb tempest-GroupSnapshotsTest-894339262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a75760a3-e49e-4556-92a8-7624a34a2ca3,created_at=2026-07-30T14:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-773740929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a75760a3-e49e-4556-92a8-7624a34a2ca3,host='devstack@QuobyteHD#QuobyteHD',id=78aeb2c4-ffa5-4f82-a6d1-fae1dd934182,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83a0d1d09329442397d9fb171d5d9bf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:49Z,use_quota=True,user_id='b2dffab8703341f598abb31c84441738',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd77be3d-3f47-4e35-903c-7642f7ed8ada),volume_type_id=bd77be3d-3f47-4e35-903c-7642f7ed8ada)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:54:49 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-bd68400a-0fb0-41d3-aa16-3b3981b493eb tempest-GroupSnapshotsTest-894339262 None] Creating volume 78aeb2c4-ffa5-4f82-a6d1-fae1dd934182 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:54:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-bd68400a-0fb0-41d3-aa16-3b3981b493eb tempest-GroupSnapshotsTest-894339262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-bd68400a-0fb0-41d3-aa16-3b3981b493eb tempest-GroupSnapshotsTest-894339262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:49 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-bd68400a-0fb0-41d3-aa16-3b3981b493eb tempest-GroupSnapshotsTest-894339262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:49 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-bd68400a-0fb0-41d3-aa16-3b3981b493eb tempest-GroupSnapshotsTest-894339262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-bd68400a-0fb0-41d3-aa16-3b3981b493eb tempest-GroupSnapshotsTest-894339262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:49 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-bd68400a-0fb0-41d3-aa16-3b3981b493eb tempest-GroupSnapshotsTest-894339262 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:54:49 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-bd68400a-0fb0-41d3-aa16-3b3981b493eb tempest-GroupSnapshotsTest-894339262 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:54:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bd68400a-0fb0-41d3-aa16-3b3981b493eb tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0826c4b2-ec3f-41fe-be47-741bd9ad16bb tempest-GroupsTest-1275132889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a9f8097-e6d9-431c-b26f-8806bf5e755b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a92d17eb-7fd9-4f65-a9a2-ccd73c6fd3c3', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0826c4b2-ec3f-41fe-be47-741bd9ad16bb tempest-GroupsTest-1275132889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a1d4154-8e2c-46d8-bc3a-ab9d1b8ef387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:49 devstack sudo[95372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182 1073741824 Jul 30 16:54:49 devstack sudo[95372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:49 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-0826c4b2-ec3f-41fe-be47-741bd9ad16bb tempest-GroupsTest-1275132889 None] Volume volume-a92d17eb-7fd9-4f65-a9a2-ccd73c6fd3c3 (a92d17eb-7fd9-4f65-a9a2-ccd73c6fd3c3): created successfully Jul 30 16:54:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0826c4b2-ec3f-41fe-be47-741bd9ad16bb tempest-GroupsTest-1275132889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a1d4154-8e2c-46d8-bc3a-ab9d1b8ef387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0826c4b2-ec3f-41fe-be47-741bd9ad16bb tempest-GroupsTest-1275132889 None] Flow 'volume_create_manager' (d22ce430-858a-4e7b-8592-842a6a9f9678) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:49 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-0826c4b2-ec3f-41fe-be47-741bd9ad16bb tempest-GroupsTest-1275132889 None] Created volume successfully. Jul 30 16:54:50 devstack sudo[95372]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bd68400a-0fb0-41d3-aa16-3b3981b493eb tempest-GroupSnapshotsTest-894339262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182 1073741824" returned: 0 in 0.674s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bd68400a-0fb0-41d3-aa16-3b3981b493eb tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:50 devstack sudo[95378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182 Jul 30 16:54:50 devstack sudo[95378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:50 devstack sudo[95378]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bd68400a-0fb0-41d3-aa16-3b3981b493eb tempest-GroupSnapshotsTest-894339262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182" returned: 0 in 0.478s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:50 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-bd68400a-0fb0-41d3-aa16-3b3981b493eb tempest-GroupSnapshotsTest-894339262 None] <== create_volume: return (1217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:54:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-bd68400a-0fb0-41d3-aa16-3b3981b493eb tempest-GroupSnapshotsTest-894339262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.230s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bd68400a-0fb0-41d3-aa16-3b3981b493eb tempest-GroupSnapshotsTest-894339262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc782136-c452-46ff-b5ee-4cbaff586d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bd68400a-0fb0-41d3-aa16-3b3981b493eb tempest-GroupSnapshotsTest-894339262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa7c4198-75d2-4dc8-b723-fa03ecea9631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:50 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-bd68400a-0fb0-41d3-aa16-3b3981b493eb tempest-GroupSnapshotsTest-894339262 None] Volume volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182 (78aeb2c4-ffa5-4f82-a6d1-fae1dd934182): created successfully Jul 30 16:54:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bd68400a-0fb0-41d3-aa16-3b3981b493eb tempest-GroupSnapshotsTest-894339262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa7c4198-75d2-4dc8-b723-fa03ecea9631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bd68400a-0fb0-41d3-aa16-3b3981b493eb tempest-GroupSnapshotsTest-894339262 None] Flow 'volume_create_manager' (57123337-fd3a-4312-883f-53f56993a4b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:50 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-bd68400a-0fb0-41d3-aa16-3b3981b493eb tempest-GroupSnapshotsTest-894339262 None] Created volume successfully. Jul 30 16:54:51 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-26dfcd1c-aa22-47e0-aad4-fe541c9b8d55 tempest-GroupsTest-1275132889 None] Acquiring lock "cinder-quobyte-a92d17eb-7fd9-4f65-a9a2-ccd73c6fd3c3" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:51 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-26dfcd1c-aa22-47e0-aad4-fe541c9b8d55 tempest-GroupsTest-1275132889 None] Lock "cinder-quobyte-a92d17eb-7fd9-4f65-a9a2-ccd73c6fd3c3" acquired by "delete_volume" :: waited 0.027s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:51 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2927b10-57a5-466e-9c97-e3d6370eb2f7]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-26dfcd1c-aa22-47e0-aad4-fe541c9b8d55 tempest-GroupsTest-1275132889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a92d17eb-7fd9-4f65-a9a2-ccd73c6fd3c3 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:52 devstack sudo[95408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a92d17eb-7fd9-4f65-a9a2-ccd73c6fd3c3 Jul 30 16:54:52 devstack sudo[95408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:52 devstack sudo[95408]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:52 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-a40548c0-ed3c-4763-955a-ed5f9cbb55b5 tempest-GroupSnapshotsTest-894339262 None] GroupSnapshot 78e75cdd-649d-4844-bb36-a9e1150c9dca: creating. Jul 30 16:54:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-26dfcd1c-aa22-47e0-aad4-fe541c9b8d55 tempest-GroupsTest-1275132889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a92d17eb-7fd9-4f65-a9a2-ccd73c6fd3c3" returned: 0 in 0.556s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-26dfcd1c-aa22-47e0-aad4-fe541c9b8d55 tempest-GroupsTest-1275132889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a92d17eb-7fd9-4f65-a9a2-ccd73c6fd3c3 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:52 devstack sudo[95417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a92d17eb-7fd9-4f65-a9a2-ccd73c6fd3c3 Jul 30 16:54:52 devstack sudo[95417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a40548c0-ed3c-4763-955a-ed5f9cbb55b5 tempest-GroupSnapshotsTest-894339262 None] Group snapshot 78e75cdd-649d-4844-bb36-a9e1150c9dca: creating. {{(pid=88591) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 30 16:54:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a40548c0-ed3c-4763-955a-ed5f9cbb55b5 tempest-GroupSnapshotsTest-894339262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a40548c0-ed3c-4763-955a-ed5f9cbb55b5 tempest-GroupSnapshotsTest-894339262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:52 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-a40548c0-ed3c-4763-955a-ed5f9cbb55b5 tempest-GroupSnapshotsTest-894339262 None] Creating offline snapshot f73759c3-5e7c-4e5d-b8c0-bfcbaafdfea8 of volume 78aeb2c4-ffa5-4f82-a6d1-fae1dd934182 {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:54:52 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ef0b0b-cae2-4214-bc99-f33a5f496086]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a40548c0-ed3c-4763-955a-ed5f9cbb55b5 tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:52 devstack sudo[95419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182 Jul 30 16:54:52 devstack sudo[95419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:52 devstack sudo[95417]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-26dfcd1c-aa22-47e0-aad4-fe541c9b8d55 tempest-GroupsTest-1275132889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a92d17eb-7fd9-4f65-a9a2-ccd73c6fd3c3" returned: 0 in 0.370s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:52 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-26dfcd1c-aa22-47e0-aad4-fe541c9b8d55 tempest-GroupsTest-1275132889 None] Lock "cinder-quobyte-a92d17eb-7fd9-4f65-a9a2-ccd73c6fd3c3" released by "delete_volume" :: held 1.017s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:53 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-26dfcd1c-aa22-47e0-aad4-fe541c9b8d55 tempest-GroupsTest-1275132889 None] Created reservations ['74cdc278-8181-4327-ae4a-e24a2a6530f9'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:53 devstack cinder-volume[88591]: WARNING cinder.quota [None req-26dfcd1c-aa22-47e0-aad4-fe541c9b8d55 tempest-GroupsTest-1275132889 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1001598563 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1001598563, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:54:53 devstack cinder-volume[88591]: WARNING cinder.quota [None req-26dfcd1c-aa22-47e0-aad4-fe541c9b8d55 tempest-GroupsTest-1275132889 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1001598563 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1001598563, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:54:53 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-26dfcd1c-aa22-47e0-aad4-fe541c9b8d55 tempest-GroupsTest-1275132889 None] Created reservations ['b6eea191-da95-42e6-83d7-bcb8b4e0fa91', '3f3fd11f-88c6-4e06-9c5d-0b01a3eb4b1b', '2400c7da-009d-46df-b0a9-ca5e92e59933', '021aed2e-4e4e-4f51-b597-d92aefbfa802'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:53 devstack sudo[95419]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a40548c0-ed3c-4763-955a-ed5f9cbb55b5 tempest-GroupSnapshotsTest-894339262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182" returned: 0 in 0.655s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a40548c0-ed3c-4763-955a-ed5f9cbb55b5 tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182.f73759c3-5e7c-4e5d-b8c0-bfcbaafdfea8 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:53 devstack sudo[95437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182.f73759c3-5e7c-4e5d-b8c0-bfcbaafdfea8 1G Jul 30 16:54:53 devstack sudo[95437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-26dfcd1c-aa22-47e0-aad4-fe541c9b8d55 tempest-GroupsTest-1275132889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-26dfcd1c-aa22-47e0-aad4-fe541c9b8d55 tempest-GroupsTest-1275132889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:53 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-26dfcd1c-aa22-47e0-aad4-fe541c9b8d55 tempest-GroupsTest-1275132889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:53 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-26dfcd1c-aa22-47e0-aad4-fe541c9b8d55 tempest-GroupsTest-1275132889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-26dfcd1c-aa22-47e0-aad4-fe541c9b8d55 tempest-GroupsTest-1275132889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-26dfcd1c-aa22-47e0-aad4-fe541c9b8d55 tempest-GroupsTest-1275132889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:53 devstack sudo[95445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:54:53 devstack sudo[95445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:53 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-0212f433-c721-4dd8-aaef-89b57a58cad1 tempest-GroupsTest-1275132889 None] Created reservations ['787b6bc7-b494-4c64-8f99-6f3a11a675ec'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:53 devstack sudo[95445]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-26dfcd1c-aa22-47e0-aad4-fe541c9b8d55 tempest-GroupsTest-1275132889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.466s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:53 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-26dfcd1c-aa22-47e0-aad4-fe541c9b8d55 tempest-GroupsTest-1275132889 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:54:53 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-26dfcd1c-aa22-47e0-aad4-fe541c9b8d55 tempest-GroupsTest-1275132889 None] Delete group completed successfully. Jul 30 16:54:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0212f433-c721-4dd8-aaef-89b57a58cad1 tempest-GroupsTest-1275132889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0212f433-c721-4dd8-aaef-89b57a58cad1 tempest-GroupsTest-1275132889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:53 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-0212f433-c721-4dd8-aaef-89b57a58cad1 tempest-GroupsTest-1275132889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:53 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-0212f433-c721-4dd8-aaef-89b57a58cad1 tempest-GroupsTest-1275132889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0212f433-c721-4dd8-aaef-89b57a58cad1 tempest-GroupsTest-1275132889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0212f433-c721-4dd8-aaef-89b57a58cad1 tempest-GroupsTest-1275132889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:54 devstack sudo[95476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:54:54 devstack sudo[95476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:54 devstack sudo[95437]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a40548c0-ed3c-4763-955a-ed5f9cbb55b5 tempest-GroupSnapshotsTest-894339262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182.f73759c3-5e7c-4e5d-b8c0-bfcbaafdfea8 1G" returned: 0 in 0.885s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a40548c0-ed3c-4763-955a-ed5f9cbb55b5 tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182.f73759c3-5e7c-4e5d-b8c0-bfcbaafdfea8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:54 devstack sudo[95488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182.f73759c3-5e7c-4e5d-b8c0-bfcbaafdfea8 Jul 30 16:54:54 devstack sudo[95488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:54 devstack sudo[95476]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0212f433-c721-4dd8-aaef-89b57a58cad1 tempest-GroupsTest-1275132889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.547s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:54 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-0212f433-c721-4dd8-aaef-89b57a58cad1 tempest-GroupsTest-1275132889 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:54:54 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-0212f433-c721-4dd8-aaef-89b57a58cad1 tempest-GroupsTest-1275132889 None] Delete group completed successfully. Jul 30 16:54:54 devstack sudo[95488]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a40548c0-ed3c-4763-955a-ed5f9cbb55b5 tempest-GroupSnapshotsTest-894339262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182.f73759c3-5e7c-4e5d-b8c0-bfcbaafdfea8" returned: 0 in 0.532s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:54 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-a40548c0-ed3c-4763-955a-ed5f9cbb55b5 tempest-GroupSnapshotsTest-894339262 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182.f73759c3-5e7c-4e5d-b8c0-bfcbaafdfea8 is being set with open permissions: ugo+rw: NotImplementedError Jul 30 16:54:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a40548c0-ed3c-4763-955a-ed5f9cbb55b5 tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182.f73759c3-5e7c-4e5d-b8c0-bfcbaafdfea8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:54 devstack sudo[95513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182.f73759c3-5e7c-4e5d-b8c0-bfcbaafdfea8 Jul 30 16:54:54 devstack sudo[95513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:55 devstack sudo[95513]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a40548c0-ed3c-4763-955a-ed5f9cbb55b5 tempest-GroupSnapshotsTest-894339262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182.f73759c3-5e7c-4e5d-b8c0-bfcbaafdfea8" returned: 0 in 0.351s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a40548c0-ed3c-4763-955a-ed5f9cbb55b5 tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:55 devstack sudo[95525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182.info Jul 30 16:54:55 devstack sudo[95525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:55 devstack sudo[95525]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a40548c0-ed3c-4763-955a-ed5f9cbb55b5 tempest-GroupSnapshotsTest-894339262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182.info" returned: 0 in 0.310s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:55 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-a40548c0-ed3c-4763-955a-ed5f9cbb55b5 tempest-GroupSnapshotsTest-894339262 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182.info is being set with open permissions: ugo+rw: NotImplementedError Jul 30 16:54:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a40548c0-ed3c-4763-955a-ed5f9cbb55b5 tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:55 devstack sudo[95528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182.info Jul 30 16:54:55 devstack sudo[95528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:55 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-29ab57ec-87dc-4bbd-b2d5-74c50d1349d1 tempest-GroupsTest-1275132889 None] Group tempest-GroupsTest-Group-119809825: creating Jul 30 16:54:55 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-29ab57ec-87dc-4bbd-b2d5-74c50d1349d1 tempest-GroupsTest-1275132889 None] Group tempest-GroupsTest-Group-119809825: created successfully Jul 30 16:54:55 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-29ab57ec-87dc-4bbd-b2d5-74c50d1349d1 tempest-GroupsTest-1275132889 None] Create group completed successfully. Jul 30 16:54:55 devstack sudo[95528]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a40548c0-ed3c-4763-955a-ed5f9cbb55b5 tempest-GroupSnapshotsTest-894339262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182.info" returned: 0 in 0.419s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a40548c0-ed3c-4763-955a-ed5f9cbb55b5 tempest-GroupSnapshotsTest-894339262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.293s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:56 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-a40548c0-ed3c-4763-955a-ed5f9cbb55b5 tempest-GroupSnapshotsTest-894339262 None] group_snapshot 78e75cdd-649d-4844-bb36-a9e1150c9dca: created successfully Jul 30 16:54:58 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-88203ffc-a673-4530-829f-f9151b97d523 tempest-GroupsTest-1275132889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:54:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-88203ffc-a673-4530-829f-f9151b97d523 tempest-GroupsTest-1275132889 None] Flow 'volume_create_manager' (47d5dbb7-8998-4197-9ad1-d3fd32f4725d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-88203ffc-a673-4530-829f-f9151b97d523 tempest-GroupsTest-1275132889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90d359a2-975a-463f-80b7-fbbd58911cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-88203ffc-a673-4530-829f-f9151b97d523 tempest-GroupsTest-1275132889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90d359a2-975a-463f-80b7-fbbd58911cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-961418320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7be6e846-a058-4fca-822b-285d32407e06,host='devstack@QuobyteHD#QuobyteHD',id=ef128026-6a5c-4eb6-bce5-558af382e4f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86f0ff562125400a97c53c42b63c3c6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:58Z,use_quota=True,user_id='edd9ca7eb21744f7be6550f3f4e7bc65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a91e714b-eea3-4a73-8471-a7a181e9fb15),volume_type_id=a91e714b-eea3-4a73-8471-a7a181e9fb15)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-88203ffc-a673-4530-829f-f9151b97d523 tempest-GroupsTest-1275132889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1664d2a0-83dc-437b-9635-4d0b41587661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-88203ffc-a673-4530-829f-f9151b97d523 tempest-GroupsTest-1275132889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1664d2a0-83dc-437b-9635-4d0b41587661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-88203ffc-a673-4530-829f-f9151b97d523 tempest-GroupsTest-1275132889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01297313-6ac0-4dc2-b29b-79a818c356be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-88203ffc-a673-4530-829f-f9151b97d523 tempest-GroupsTest-1275132889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01297313-6ac0-4dc2-b29b-79a818c356be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef128026-6a5c-4eb6-bce5-558af382e4f8', 'volume_name': 'volume-ef128026-6a5c-4eb6-bce5-558af382e4f8', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-88203ffc-a673-4530-829f-f9151b97d523 tempest-GroupsTest-1275132889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf9bb7f8-69c4-4ab4-9374-b7155478d17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-88203ffc-a673-4530-829f-f9151b97d523 tempest-GroupsTest-1275132889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf9bb7f8-69c4-4ab4-9374-b7155478d17d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-88203ffc-a673-4530-829f-f9151b97d523 tempest-GroupsTest-1275132889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edfba0f1-765b-40c8-87f8-dfb08f2cfe33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:58 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-88203ffc-a673-4530-829f-f9151b97d523 tempest-GroupsTest-1275132889 None] Volume ef128026-6a5c-4eb6-bce5-558af382e4f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef128026-6a5c-4eb6-bce5-558af382e4f8', 'volume_size': 1} Jul 30 16:54:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-88203ffc-a673-4530-829f-f9151b97d523 tempest-GroupsTest-1275132889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-88203ffc-a673-4530-829f-f9151b97d523 tempest-GroupsTest-1275132889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:58 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-88203ffc-a673-4530-829f-f9151b97d523 tempest-GroupsTest-1275132889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7be6e846-a058-4fca-822b-285d32407e06,created_at=2026-07-30T14:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-961418320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7be6e846-a058-4fca-822b-285d32407e06,host='devstack@QuobyteHD#QuobyteHD',id=ef128026-6a5c-4eb6-bce5-558af382e4f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86f0ff562125400a97c53c42b63c3c6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:58Z,use_quota=True,user_id='edd9ca7eb21744f7be6550f3f4e7bc65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a91e714b-eea3-4a73-8471-a7a181e9fb15),volume_type_id=a91e714b-eea3-4a73-8471-a7a181e9fb15)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:54:58 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-88203ffc-a673-4530-829f-f9151b97d523 tempest-GroupsTest-1275132889 None] Creating volume ef128026-6a5c-4eb6-bce5-558af382e4f8 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:54:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-88203ffc-a673-4530-829f-f9151b97d523 tempest-GroupsTest-1275132889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-88203ffc-a673-4530-829f-f9151b97d523 tempest-GroupsTest-1275132889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:58 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-88203ffc-a673-4530-829f-f9151b97d523 tempest-GroupsTest-1275132889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:58 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-88203ffc-a673-4530-829f-f9151b97d523 tempest-GroupsTest-1275132889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-88203ffc-a673-4530-829f-f9151b97d523 tempest-GroupsTest-1275132889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:58 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-88203ffc-a673-4530-829f-f9151b97d523 tempest-GroupsTest-1275132889 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:54:58 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-88203ffc-a673-4530-829f-f9151b97d523 tempest-GroupsTest-1275132889 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:54:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-88203ffc-a673-4530-829f-f9151b97d523 tempest-GroupsTest-1275132889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ef128026-6a5c-4eb6-bce5-558af382e4f8 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:58 devstack sudo[95534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ef128026-6a5c-4eb6-bce5-558af382e4f8 1073741824 Jul 30 16:54:58 devstack sudo[95534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-91bd3eb2-9447-4c50-949a-2189c37e2200 tempest-GroupSnapshotsTest-894339262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:59 devstack sudo[95534]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-88203ffc-a673-4530-829f-f9151b97d523 tempest-GroupsTest-1275132889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ef128026-6a5c-4eb6-bce5-558af382e4f8 1073741824" returned: 0 in 0.775s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-88203ffc-a673-4530-829f-f9151b97d523 tempest-GroupsTest-1275132889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ef128026-6a5c-4eb6-bce5-558af382e4f8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:59 devstack sudo[95540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ef128026-6a5c-4eb6-bce5-558af382e4f8 Jul 30 16:54:59 devstack sudo[95540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:59 devstack sudo[95540]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-88203ffc-a673-4530-829f-f9151b97d523 tempest-GroupsTest-1275132889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ef128026-6a5c-4eb6-bce5-558af382e4f8" returned: 0 in 0.397s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:59 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-88203ffc-a673-4530-829f-f9151b97d523 tempest-GroupsTest-1275132889 None] <== create_volume: return (1275ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:54:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-88203ffc-a673-4530-829f-f9151b97d523 tempest-GroupsTest-1275132889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.286s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-91bd3eb2-9447-4c50-949a-2189c37e2200 tempest-GroupSnapshotsTest-894339262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:59 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-91bd3eb2-9447-4c50-949a-2189c37e2200 tempest-GroupSnapshotsTest-894339262 None] Acquiring lock "cinder-quobyte-f73759c3-5e7c-4e5d-b8c0-bfcbaafdfea8-4eb96a7f-45c4-4a54-8019-d6b45454f0cf" by "_create_volume_from_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:59 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-88203ffc-a673-4530-829f-f9151b97d523 tempest-GroupsTest-1275132889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edfba0f1-765b-40c8-87f8-dfb08f2cfe33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef128026-6a5c-4eb6-bce5-558af382e4f8', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:59 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-88203ffc-a673-4530-829f-f9151b97d523 tempest-GroupsTest-1275132889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7372beb7-95f3-4e95-b827-62dcf7a26089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:59 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-91bd3eb2-9447-4c50-949a-2189c37e2200 tempest-GroupSnapshotsTest-894339262 None] Lock "cinder-quobyte-f73759c3-5e7c-4e5d-b8c0-bfcbaafdfea8-4eb96a7f-45c4-4a54-8019-d6b45454f0cf" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:59 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-91bd3eb2-9447-4c50-949a-2189c37e2200 tempest-GroupSnapshotsTest-894339262 None] Creating volume 4eb96a7f-45c4-4a54-8019-d6b45454f0cf from snapshot f73759c3-5e7c-4e5d-b8c0-bfcbaafdfea8 {{(pid=88591) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 30 16:54:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-91bd3eb2-9447-4c50-949a-2189c37e2200 tempest-GroupSnapshotsTest-894339262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-91bd3eb2-9447-4c50-949a-2189c37e2200 tempest-GroupSnapshotsTest-894339262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:59 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-91bd3eb2-9447-4c50-949a-2189c37e2200 tempest-GroupSnapshotsTest-894339262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:59 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-91bd3eb2-9447-4c50-949a-2189c37e2200 tempest-GroupSnapshotsTest-894339262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-91bd3eb2-9447-4c50-949a-2189c37e2200 tempest-GroupSnapshotsTest-894339262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:59 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-91bd3eb2-9447-4c50-949a-2189c37e2200 tempest-GroupSnapshotsTest-894339262 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:54:59 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-91bd3eb2-9447-4c50-949a-2189c37e2200 tempest-GroupSnapshotsTest-894339262 None] Acquiring lock "cinder-quobyte-4eb96a7f-45c4-4a54-8019-d6b45454f0cf" by "_copy_volume_from_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:59 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-88203ffc-a673-4530-829f-f9151b97d523 tempest-GroupsTest-1275132889 None] Volume volume-ef128026-6a5c-4eb6-bce5-558af382e4f8 (ef128026-6a5c-4eb6-bce5-558af382e4f8): created successfully Jul 30 16:54:59 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-88203ffc-a673-4530-829f-f9151b97d523 tempest-GroupsTest-1275132889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7372beb7-95f3-4e95-b827-62dcf7a26089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:59 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-88203ffc-a673-4530-829f-f9151b97d523 tempest-GroupsTest-1275132889 None] Flow 'volume_create_manager' (47d5dbb7-8998-4197-9ad1-d3fd32f4725d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:59 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-91bd3eb2-9447-4c50-949a-2189c37e2200 tempest-GroupSnapshotsTest-894339262 None] Lock "cinder-quobyte-4eb96a7f-45c4-4a54-8019-d6b45454f0cf" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:59 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-91bd3eb2-9447-4c50-949a-2189c37e2200 tempest-GroupSnapshotsTest-894339262 None] snapshot: f73759c3-5e7c-4e5d-b8c0-bfcbaafdfea8, volume: 4eb96a7f-45c4-4a54-8019-d6b45454f0cf, {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 16:54:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-91bd3eb2-9447-4c50-949a-2189c37e2200 tempest-GroupSnapshotsTest-894339262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-91bd3eb2-9447-4c50-949a-2189c37e2200 tempest-GroupSnapshotsTest-894339262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:59 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-91bd3eb2-9447-4c50-949a-2189c37e2200 tempest-GroupSnapshotsTest-894339262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:59 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-91bd3eb2-9447-4c50-949a-2189c37e2200 tempest-GroupSnapshotsTest-894339262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-91bd3eb2-9447-4c50-949a-2189c37e2200 tempest-GroupSnapshotsTest-894339262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:59 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-88203ffc-a673-4530-829f-f9151b97d523 tempest-GroupsTest-1275132889 None] Created volume successfully. Jul 30 16:54:59 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dea2625-d9d2-4eba-ae22-f6e80c84bda2]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-91bd3eb2-9447-4c50-949a-2189c37e2200 tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182.f73759c3-5e7c-4e5d-b8c0-bfcbaafdfea8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:59 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-60405212-2cf0-40b9-be89-15c9bc3ce257 tempest-TestMinimumBasicScenario-417990955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:54:59 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-60405212-2cf0-40b9-be89-15c9bc3ce257 tempest-TestMinimumBasicScenario-417990955 None] Flow 'volume_create_manager' (d1b1d458-4d66-4525-a6c5-9fa3a132d93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:59 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-60405212-2cf0-40b9-be89-15c9bc3ce257 tempest-TestMinimumBasicScenario-417990955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c23d01ae-c65e-469e-a5aa-2d0e6709fd0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:59 devstack sudo[95543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182.f73759c3-5e7c-4e5d-b8c0-bfcbaafdfea8 Jul 30 16:54:59 devstack sudo[95543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:59 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-60405212-2cf0-40b9-be89-15c9bc3ce257 tempest-TestMinimumBasicScenario-417990955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c23d01ae-c65e-469e-a5aa-2d0e6709fd0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2139246826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10691e0c-c37e-4528-a994-778eae5e9c99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37882e0181134df98c1059c679afe7c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:55:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:55:00Z,use_quota=True,user_id='c7fffd450b114f55a2e0be2400fa5a14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:59 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-60405212-2cf0-40b9-be89-15c9bc3ce257 tempest-TestMinimumBasicScenario-417990955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb8b610c-939f-4cfb-bb64-da52ce6879d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:59 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-60405212-2cf0-40b9-be89-15c9bc3ce257 tempest-TestMinimumBasicScenario-417990955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb8b610c-939f-4cfb-bb64-da52ce6879d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:59 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-60405212-2cf0-40b9-be89-15c9bc3ce257 tempest-TestMinimumBasicScenario-417990955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3968afc-14b2-4d10-a25b-9435beb839bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:59 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-60405212-2cf0-40b9-be89-15c9bc3ce257 tempest-TestMinimumBasicScenario-417990955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3968afc-14b2-4d10-a25b-9435beb839bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10691e0c-c37e-4528-a994-778eae5e9c99', 'volume_name': 'volume-10691e0c-c37e-4528-a994-778eae5e9c99', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:59 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-60405212-2cf0-40b9-be89-15c9bc3ce257 tempest-TestMinimumBasicScenario-417990955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcf28ff4-eeb1-4d56-adaa-3e726b3e2644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:59 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-60405212-2cf0-40b9-be89-15c9bc3ce257 tempest-TestMinimumBasicScenario-417990955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcf28ff4-eeb1-4d56-adaa-3e726b3e2644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:59 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-60405212-2cf0-40b9-be89-15c9bc3ce257 tempest-TestMinimumBasicScenario-417990955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fd68088-9cf9-4bf0-806b-338283722b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:59 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-60405212-2cf0-40b9-be89-15c9bc3ce257 tempest-TestMinimumBasicScenario-417990955 None] Volume 10691e0c-c37e-4528-a994-778eae5e9c99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10691e0c-c37e-4528-a994-778eae5e9c99', 'volume_size': 1} Jul 30 16:54:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-60405212-2cf0-40b9-be89-15c9bc3ce257 tempest-TestMinimumBasicScenario-417990955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:00 devstack sudo[95543]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-91bd3eb2-9447-4c50-949a-2189c37e2200 tempest-GroupSnapshotsTest-894339262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182.f73759c3-5e7c-4e5d-b8c0-bfcbaafdfea8" returned: 0 in 0.440s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:00 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-91bd3eb2-9447-4c50-949a-2189c37e2200 tempest-GroupSnapshotsTest-894339262 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:55:00 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[79cc000d-5ff5-49f7-80e9-153cde1ef1f4]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-91bd3eb2-9447-4c50-949a-2189c37e2200 tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:00 devstack sudo[95548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182 Jul 30 16:55:00 devstack sudo[95548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:00 devstack sudo[95548]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-91bd3eb2-9447-4c50-949a-2189c37e2200 tempest-GroupSnapshotsTest-894339262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182" returned: 0 in 0.586s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:00 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-91bd3eb2-9447-4c50-949a-2189c37e2200 tempest-GroupSnapshotsTest-894339262 None] will copy from snapshot at /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182 {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 16:55:00 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-91bd3eb2-9447-4c50-949a-2189c37e2200 tempest-GroupSnapshotsTest-894339262 None] Creating direct copy from snapshot {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 16:55:00 devstack cinder-volume[88591]: DEBUG cinder.utils [None req-91bd3eb2-9447-4c50-949a-2189c37e2200 tempest-GroupSnapshotsTest-894339262 None] Path /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-4eb96a7f-45c4-4a54-8019-d6b45454f0cf not found in is_blk_device check {{(pid=88591) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 16:55:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-91bd3eb2-9447-4c50-949a-2189c37e2200 tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-4eb96a7f-45c4-4a54-8019-d6b45454f0cf {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:00 devstack sudo[95553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-4eb96a7f-45c4-4a54-8019-d6b45454f0cf Jul 30 16:55:00 devstack sudo[95553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:02 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-d718a1c4-597e-4965-a966-3d95c358bcec tempest-GroupsTest-1275132889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:55:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d718a1c4-597e-4965-a966-3d95c358bcec tempest-GroupsTest-1275132889 None] Flow 'volume_create_manager' (50378e75-86f4-4927-b9a8-d88b846ad9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:55:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d718a1c4-597e-4965-a966-3d95c358bcec tempest-GroupsTest-1275132889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa260929-6e77-4164-95c8-579ba37db271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d718a1c4-597e-4965-a966-3d95c358bcec tempest-GroupsTest-1275132889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa260929-6e77-4164-95c8-579ba37db271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:55:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1541089681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7be6e846-a058-4fca-822b-285d32407e06,host='devstack@QuobyteHD#QuobyteHD',id=20c4c6a2-7f29-4965-96c6-84607a3c14b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86f0ff562125400a97c53c42b63c3c6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:55:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:55:02Z,use_quota=True,user_id='edd9ca7eb21744f7be6550f3f4e7bc65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a91e714b-eea3-4a73-8471-a7a181e9fb15),volume_type_id=a91e714b-eea3-4a73-8471-a7a181e9fb15)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d718a1c4-597e-4965-a966-3d95c358bcec tempest-GroupsTest-1275132889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cfce0ac-c8a0-417a-acaa-584812de447c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d718a1c4-597e-4965-a966-3d95c358bcec tempest-GroupsTest-1275132889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cfce0ac-c8a0-417a-acaa-584812de447c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d718a1c4-597e-4965-a966-3d95c358bcec tempest-GroupsTest-1275132889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0140f50e-6759-433c-a0f6-1e4162d7b0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d718a1c4-597e-4965-a966-3d95c358bcec tempest-GroupsTest-1275132889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0140f50e-6759-433c-a0f6-1e4162d7b0a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20c4c6a2-7f29-4965-96c6-84607a3c14b5', 'volume_name': 'volume-20c4c6a2-7f29-4965-96c6-84607a3c14b5', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d718a1c4-597e-4965-a966-3d95c358bcec tempest-GroupsTest-1275132889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d011b18b-e24d-48d5-8d6d-f6a217878827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d718a1c4-597e-4965-a966-3d95c358bcec tempest-GroupsTest-1275132889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d011b18b-e24d-48d5-8d6d-f6a217878827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d718a1c4-597e-4965-a966-3d95c358bcec tempest-GroupsTest-1275132889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17e728c4-1c91-4c68-abd3-2e053b5563a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:02 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-d718a1c4-597e-4965-a966-3d95c358bcec tempest-GroupsTest-1275132889 None] Volume 20c4c6a2-7f29-4965-96c6-84607a3c14b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20c4c6a2-7f29-4965-96c6-84607a3c14b5', 'volume_size': 1} Jul 30 16:55:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d718a1c4-597e-4965-a966-3d95c358bcec tempest-GroupsTest-1275132889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:08 devstack sudo[95553]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-91bd3eb2-9447-4c50-949a-2189c37e2200 tempest-GroupSnapshotsTest-894339262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-4eb96a7f-45c4-4a54-8019-d6b45454f0cf" returned: 0 in 7.480s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:08 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-91bd3eb2-9447-4c50-949a-2189c37e2200 tempest-GroupSnapshotsTest-894339262 None] Image conversion details: src /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182, size 1024.00 MB, duration 7.48 sec, destination /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-4eb96a7f-45c4-4a54-8019-d6b45454f0cf {{(pid=88591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:55:08 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-91bd3eb2-9447-4c50-949a-2189c37e2200 tempest-GroupSnapshotsTest-894339262 None] Converted 1024.00 MB image at 136.89 MB/s Jul 30 16:55:08 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-91bd3eb2-9447-4c50-949a-2189c37e2200 tempest-GroupSnapshotsTest-894339262 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-4eb96a7f-45c4-4a54-8019-d6b45454f0cf is being set with open permissions: ugo+rw: NotImplementedError Jul 30 16:55:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-91bd3eb2-9447-4c50-949a-2189c37e2200 tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-4eb96a7f-45c4-4a54-8019-d6b45454f0cf {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:08 devstack sudo[95584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-4eb96a7f-45c4-4a54-8019-d6b45454f0cf Jul 30 16:55:08 devstack sudo[95584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:08 devstack sudo[95584]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-91bd3eb2-9447-4c50-949a-2189c37e2200 tempest-GroupSnapshotsTest-894339262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-4eb96a7f-45c4-4a54-8019-d6b45454f0cf" returned: 0 in 0.333s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:08 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-91bd3eb2-9447-4c50-949a-2189c37e2200 tempest-GroupSnapshotsTest-894339262 None] Lock "cinder-quobyte-4eb96a7f-45c4-4a54-8019-d6b45454f0cf" released by "_copy_volume_from_snapshot" :: held 8.981s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:08 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-91bd3eb2-9447-4c50-949a-2189c37e2200 tempest-GroupSnapshotsTest-894339262 None] Lock "cinder-quobyte-f73759c3-5e7c-4e5d-b8c0-bfcbaafdfea8-4eb96a7f-45c4-4a54-8019-d6b45454f0cf" released by "_create_volume_from_snapshot" :: held 9.089s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-91bd3eb2-9447-4c50-949a-2189c37e2200 tempest-GroupSnapshotsTest-894339262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.134s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-60405212-2cf0-40b9-be89-15c9bc3ce257 tempest-TestMinimumBasicScenario-417990955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.712s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:08 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-60405212-2cf0-40b9-be89-15c9bc3ce257 tempest-TestMinimumBasicScenario-417990955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2139246826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10691e0c-c37e-4528-a994-778eae5e9c99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37882e0181134df98c1059c679afe7c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:55:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:55:00Z,use_quota=True,user_id='c7fffd450b114f55a2e0be2400fa5a14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:55:08 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-60405212-2cf0-40b9-be89-15c9bc3ce257 tempest-TestMinimumBasicScenario-417990955 None] Creating volume 10691e0c-c37e-4528-a994-778eae5e9c99 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:55:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-60405212-2cf0-40b9-be89-15c9bc3ce257 tempest-TestMinimumBasicScenario-417990955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-60405212-2cf0-40b9-be89-15c9bc3ce257 tempest-TestMinimumBasicScenario-417990955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:08 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-60405212-2cf0-40b9-be89-15c9bc3ce257 tempest-TestMinimumBasicScenario-417990955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:55:08 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-60405212-2cf0-40b9-be89-15c9bc3ce257 tempest-TestMinimumBasicScenario-417990955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:55:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-60405212-2cf0-40b9-be89-15c9bc3ce257 tempest-TestMinimumBasicScenario-417990955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:08 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-60405212-2cf0-40b9-be89-15c9bc3ce257 tempest-TestMinimumBasicScenario-417990955 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:55:08 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-60405212-2cf0-40b9-be89-15c9bc3ce257 tempest-TestMinimumBasicScenario-417990955 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:55:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-60405212-2cf0-40b9-be89-15c9bc3ce257 tempest-TestMinimumBasicScenario-417990955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-10691e0c-c37e-4528-a994-778eae5e9c99 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:08 devstack sudo[95631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-10691e0c-c37e-4528-a994-778eae5e9c99 1073741824 Jul 30 16:55:08 devstack sudo[95631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:08 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-91bd3eb2-9447-4c50-949a-2189c37e2200 tempest-GroupSnapshotsTest-894339262 None] Create group from source-snapshot-78e75cdd-649d-4844-bb36-a9e1150c9dca completed successfully. Jul 30 16:55:09 devstack sudo[95631]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-60405212-2cf0-40b9-be89-15c9bc3ce257 tempest-TestMinimumBasicScenario-417990955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-10691e0c-c37e-4528-a994-778eae5e9c99 1073741824" returned: 0 in 0.556s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-60405212-2cf0-40b9-be89-15c9bc3ce257 tempest-TestMinimumBasicScenario-417990955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-10691e0c-c37e-4528-a994-778eae5e9c99 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:09 devstack sudo[95637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-10691e0c-c37e-4528-a994-778eae5e9c99 Jul 30 16:55:09 devstack sudo[95637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:09 devstack sudo[95637]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-60405212-2cf0-40b9-be89-15c9bc3ce257 tempest-TestMinimumBasicScenario-417990955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-10691e0c-c37e-4528-a994-778eae5e9c99" returned: 0 in 0.443s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:09 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-60405212-2cf0-40b9-be89-15c9bc3ce257 tempest-TestMinimumBasicScenario-417990955 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:55:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-60405212-2cf0-40b9-be89-15c9bc3ce257 tempest-TestMinimumBasicScenario-417990955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d718a1c4-597e-4965-a966-3d95c358bcec tempest-GroupsTest-1275132889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.484s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:09 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d718a1c4-597e-4965-a966-3d95c358bcec tempest-GroupsTest-1275132889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7be6e846-a058-4fca-822b-285d32407e06,created_at=2026-07-30T14:55:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1541089681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7be6e846-a058-4fca-822b-285d32407e06,host='devstack@QuobyteHD#QuobyteHD',id=20c4c6a2-7f29-4965-96c6-84607a3c14b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86f0ff562125400a97c53c42b63c3c6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:55:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:55:02Z,use_quota=True,user_id='edd9ca7eb21744f7be6550f3f4e7bc65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a91e714b-eea3-4a73-8471-a7a181e9fb15),volume_type_id=a91e714b-eea3-4a73-8471-a7a181e9fb15)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:55:09 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-d718a1c4-597e-4965-a966-3d95c358bcec tempest-GroupsTest-1275132889 None] Creating volume 20c4c6a2-7f29-4965-96c6-84607a3c14b5 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:55:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d718a1c4-597e-4965-a966-3d95c358bcec tempest-GroupsTest-1275132889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d718a1c4-597e-4965-a966-3d95c358bcec tempest-GroupsTest-1275132889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:09 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d718a1c4-597e-4965-a966-3d95c358bcec tempest-GroupsTest-1275132889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:55:09 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d718a1c4-597e-4965-a966-3d95c358bcec tempest-GroupsTest-1275132889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:55:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d718a1c4-597e-4965-a966-3d95c358bcec tempest-GroupsTest-1275132889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:09 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d718a1c4-597e-4965-a966-3d95c358bcec tempest-GroupsTest-1275132889 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:55:09 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-d718a1c4-597e-4965-a966-3d95c358bcec tempest-GroupsTest-1275132889 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:55:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d718a1c4-597e-4965-a966-3d95c358bcec tempest-GroupsTest-1275132889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-20c4c6a2-7f29-4965-96c6-84607a3c14b5 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:09 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-60405212-2cf0-40b9-be89-15c9bc3ce257 tempest-TestMinimumBasicScenario-417990955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fd68088-9cf9-4bf0-806b-338283722b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10691e0c-c37e-4528-a994-778eae5e9c99', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:09 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-60405212-2cf0-40b9-be89-15c9bc3ce257 tempest-TestMinimumBasicScenario-417990955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd252f8b-a476-4e98-a8cc-756e2d208e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:09 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-60405212-2cf0-40b9-be89-15c9bc3ce257 tempest-TestMinimumBasicScenario-417990955 None] Volume volume-10691e0c-c37e-4528-a994-778eae5e9c99 (10691e0c-c37e-4528-a994-778eae5e9c99): created successfully Jul 30 16:55:09 devstack sudo[95640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-20c4c6a2-7f29-4965-96c6-84607a3c14b5 1073741824 Jul 30 16:55:09 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-60405212-2cf0-40b9-be89-15c9bc3ce257 tempest-TestMinimumBasicScenario-417990955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd252f8b-a476-4e98-a8cc-756e2d208e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:09 devstack sudo[95640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:09 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-60405212-2cf0-40b9-be89-15c9bc3ce257 tempest-TestMinimumBasicScenario-417990955 None] Flow 'volume_create_manager' (d1b1d458-4d66-4525-a6c5-9fa3a132d93e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:55:09 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-60405212-2cf0-40b9-be89-15c9bc3ce257 tempest-TestMinimumBasicScenario-417990955 None] Created volume successfully. Jul 30 16:55:10 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f837ea23-6e09-4b9e-918c-d2c1d620a32d tempest-GroupSnapshotsTest-894339262 None] Acquiring lock "cinder-quobyte-4eb96a7f-45c4-4a54-8019-d6b45454f0cf" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:10 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f837ea23-6e09-4b9e-918c-d2c1d620a32d tempest-GroupSnapshotsTest-894339262 None] Lock "cinder-quobyte-4eb96a7f-45c4-4a54-8019-d6b45454f0cf" acquired by "delete_volume" :: waited 0.032s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:10 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e72d1d-c1dd-42b4-bc02-3c48e84f8d1b]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f837ea23-6e09-4b9e-918c-d2c1d620a32d tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-4eb96a7f-45c4-4a54-8019-d6b45454f0cf {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:10 devstack sudo[95646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-4eb96a7f-45c4-4a54-8019-d6b45454f0cf Jul 30 16:55:10 devstack sudo[95646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:10 devstack sudo[95640]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d718a1c4-597e-4965-a966-3d95c358bcec tempest-GroupsTest-1275132889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-20c4c6a2-7f29-4965-96c6-84607a3c14b5 1073741824" returned: 0 in 0.758s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d718a1c4-597e-4965-a966-3d95c358bcec tempest-GroupsTest-1275132889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-20c4c6a2-7f29-4965-96c6-84607a3c14b5 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:10 devstack sudo[95650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-20c4c6a2-7f29-4965-96c6-84607a3c14b5 Jul 30 16:55:10 devstack sudo[95650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:10 devstack sudo[95646]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f837ea23-6e09-4b9e-918c-d2c1d620a32d tempest-GroupSnapshotsTest-894339262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-4eb96a7f-45c4-4a54-8019-d6b45454f0cf" returned: 0 in 0.692s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f837ea23-6e09-4b9e-918c-d2c1d620a32d tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-4eb96a7f-45c4-4a54-8019-d6b45454f0cf {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:10 devstack sudo[95655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-4eb96a7f-45c4-4a54-8019-d6b45454f0cf Jul 30 16:55:10 devstack sudo[95655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:10 devstack sudo[95650]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d718a1c4-597e-4965-a966-3d95c358bcec tempest-GroupsTest-1275132889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-20c4c6a2-7f29-4965-96c6-84607a3c14b5" returned: 0 in 0.394s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:10 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d718a1c4-597e-4965-a966-3d95c358bcec tempest-GroupsTest-1275132889 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:55:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d718a1c4-597e-4965-a966-3d95c358bcec tempest-GroupsTest-1275132889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.208s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:10 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d718a1c4-597e-4965-a966-3d95c358bcec tempest-GroupsTest-1275132889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17e728c4-1c91-4c68-abd3-2e053b5563a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20c4c6a2-7f29-4965-96c6-84607a3c14b5', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:11 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d718a1c4-597e-4965-a966-3d95c358bcec tempest-GroupsTest-1275132889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7be1435e-6e8c-4e87-bcbd-1a4f7c7f30f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:11 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-d718a1c4-597e-4965-a966-3d95c358bcec tempest-GroupsTest-1275132889 None] Volume volume-20c4c6a2-7f29-4965-96c6-84607a3c14b5 (20c4c6a2-7f29-4965-96c6-84607a3c14b5): created successfully Jul 30 16:55:11 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d718a1c4-597e-4965-a966-3d95c358bcec tempest-GroupsTest-1275132889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7be1435e-6e8c-4e87-bcbd-1a4f7c7f30f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:11 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d718a1c4-597e-4965-a966-3d95c358bcec tempest-GroupsTest-1275132889 None] Flow 'volume_create_manager' (50378e75-86f4-4927-b9a8-d88b846ad9df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:55:11 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-d718a1c4-597e-4965-a966-3d95c358bcec tempest-GroupsTest-1275132889 None] Created volume successfully. Jul 30 16:55:11 devstack sudo[95655]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f837ea23-6e09-4b9e-918c-d2c1d620a32d tempest-GroupSnapshotsTest-894339262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-4eb96a7f-45c4-4a54-8019-d6b45454f0cf" returned: 0 in 0.300s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:11 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f837ea23-6e09-4b9e-918c-d2c1d620a32d tempest-GroupSnapshotsTest-894339262 None] Lock "cinder-quobyte-4eb96a7f-45c4-4a54-8019-d6b45454f0cf" released by "delete_volume" :: held 1.058s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:11 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-f837ea23-6e09-4b9e-918c-d2c1d620a32d tempest-GroupSnapshotsTest-894339262 None] Created reservations ['12d74d5c-d061-4422-ad86-ed92b4659315'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:55:11 devstack cinder-volume[88591]: WARNING cinder.quota [None req-f837ea23-6e09-4b9e-918c-d2c1d620a32d tempest-GroupSnapshotsTest-894339262 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-244820784 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-244820784, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:55:11 devstack cinder-volume[88591]: WARNING cinder.quota [None req-f837ea23-6e09-4b9e-918c-d2c1d620a32d tempest-GroupSnapshotsTest-894339262 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-244820784 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-244820784, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:55:11 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-f837ea23-6e09-4b9e-918c-d2c1d620a32d tempest-GroupSnapshotsTest-894339262 None] Created reservations ['1443e14a-653a-4925-b3a2-d659f510365d', 'bbba6ec2-d680-4f6a-bbd7-3945072755c6', '1a58f3ba-a199-4c11-a70c-8d9e0e8d23f7', '284227a9-1992-4cbc-aab0-e2e9e61ae606'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:55:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f837ea23-6e09-4b9e-918c-d2c1d620a32d tempest-GroupSnapshotsTest-894339262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f837ea23-6e09-4b9e-918c-d2c1d620a32d tempest-GroupSnapshotsTest-894339262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:11 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f837ea23-6e09-4b9e-918c-d2c1d620a32d tempest-GroupSnapshotsTest-894339262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:55:11 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f837ea23-6e09-4b9e-918c-d2c1d620a32d tempest-GroupSnapshotsTest-894339262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:55:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f837ea23-6e09-4b9e-918c-d2c1d620a32d tempest-GroupSnapshotsTest-894339262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f837ea23-6e09-4b9e-918c-d2c1d620a32d tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:11 devstack sudo[95663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:55:11 devstack sudo[95663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:12 devstack sudo[95663]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f837ea23-6e09-4b9e-918c-d2c1d620a32d tempest-GroupSnapshotsTest-894339262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.471s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:12 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-f837ea23-6e09-4b9e-918c-d2c1d620a32d tempest-GroupSnapshotsTest-894339262 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:55:12 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-f837ea23-6e09-4b9e-918c-d2c1d620a32d tempest-GroupSnapshotsTest-894339262 None] Delete group completed successfully. Jul 30 16:55:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-be96017c-89ef-4836-a80f-173a76c38f5d req-357b492e-e1c6-404b-abab-e2de815d25e3 tempest-TestMinimumBasicScenario-417990955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-be96017c-89ef-4836-a80f-173a76c38f5d req-357b492e-e1c6-404b-abab-e2de815d25e3 tempest-TestMinimumBasicScenario-417990955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-be96017c-89ef-4836-a80f-173a76c38f5d req-357b492e-e1c6-404b-abab-e2de815d25e3 tempest-TestMinimumBasicScenario-417990955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:12 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-fdd9ef52-d4d5-4620-b92a-7732c3f7fc22 tempest-GroupsTest-1275132889 None] Update group completed successfully. Jul 30 16:55:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-be96017c-89ef-4836-a80f-173a76c38f5d req-357b492e-e1c6-404b-abab-e2de815d25e3 tempest-TestMinimumBasicScenario-417990955 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202', 'name': 'volume-10691e0c-c37e-4528-a994-778eae5e9c99', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '425c579b-1563-4d72-b29a-ddcea7370561', 'enforce_multipath': True} {{(pid=88591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:55:12 devstack cinder-volume[88591]: INFO cinder.volume.manager [req-be96017c-89ef-4836-a80f-173a76c38f5d req-357b492e-e1c6-404b-abab-e2de815d25e3 tempest-TestMinimumBasicScenario-417990955 None] attachment_update completed successfully. Jul 30 16:55:12 devstack cinder-volume[88591]: DEBUG oslo_service.periodic_task [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:55:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:55:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:55:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:12 devstack sudo[96137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:55:12 devstack sudo[96137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:12 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-0c81673c-e5ae-438e-9a35-e6411f645c6b tempest-GroupSnapshotsTest-894339262 None] group_snapshot 78e75cdd-649d-4844-bb36-a9e1150c9dca: deleting Jul 30 16:55:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0c81673c-e5ae-438e-9a35-e6411f645c6b tempest-GroupSnapshotsTest-894339262 None] group_snapshot 78e75cdd-649d-4844-bb36-a9e1150c9dca: deleting {{(pid=88591) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 30 16:55:12 devstack sudo[96137]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.394s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:12 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:55:12 devstack cinder-volume[88591]: DEBUG oslo_service.periodic_task [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running periodic task VolumeManager._thread_info {{(pid=88591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:55:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] thread count: 8 {{(pid=88591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:55:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] thread info: [<_MainThread(MainThread, started 140677178003584)>, , , , , , , ] {{(pid=88591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:55:12 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-0c81673c-e5ae-438e-9a35-e6411f645c6b tempest-GroupSnapshotsTest-894339262 None] Acquiring lock "cinder-quobyte-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:13 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-0c81673c-e5ae-438e-9a35-e6411f645c6b tempest-GroupSnapshotsTest-894339262 None] Lock "cinder-quobyte-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:13 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-0c81673c-e5ae-438e-9a35-e6411f645c6b tempest-GroupSnapshotsTest-894339262 None] Acquiring lock "cinder-quobyte-f73759c3-5e7c-4e5d-b8c0-bfcbaafdfea8" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:13 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-0c81673c-e5ae-438e-9a35-e6411f645c6b tempest-GroupSnapshotsTest-894339262 None] Lock "cinder-quobyte-f73759c3-5e7c-4e5d-b8c0-bfcbaafdfea8" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:13 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-0c81673c-e5ae-438e-9a35-e6411f645c6b tempest-GroupSnapshotsTest-894339262 None] Deleting offline snapshot f73759c3-5e7c-4e5d-b8c0-bfcbaafdfea8 of volume 78aeb2c4-ffa5-4f82-a6d1-fae1dd934182 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:55:13 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-0c81673c-e5ae-438e-9a35-e6411f645c6b tempest-GroupSnapshotsTest-894339262 None] snapshot_file for this snap is: volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182.f73759c3-5e7c-4e5d-b8c0-bfcbaafdfea8 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:55:13 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[98254e34-bedc-4401-ac55-472508719c44]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0c81673c-e5ae-438e-9a35-e6411f645c6b tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182.f73759c3-5e7c-4e5d-b8c0-bfcbaafdfea8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:13 devstack sudo[96479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182.f73759c3-5e7c-4e5d-b8c0-bfcbaafdfea8 Jul 30 16:55:13 devstack sudo[96479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:13 devstack sudo[96479]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0c81673c-e5ae-438e-9a35-e6411f645c6b tempest-GroupSnapshotsTest-894339262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182.f73759c3-5e7c-4e5d-b8c0-bfcbaafdfea8" returned: 0 in 0.454s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:13 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-0c81673c-e5ae-438e-9a35-e6411f645c6b tempest-GroupSnapshotsTest-894339262 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:55:13 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[9655e946-c1b0-4e08-93e3-c00dee43295a]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0c81673c-e5ae-438e-9a35-e6411f645c6b tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:13 devstack sudo[96484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182 Jul 30 16:55:13 devstack sudo[96484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:13 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-1104f474-0b7c-45a6-8a60-ef2816c4d7d3 tempest-GroupsTest-1275132889 None] Update group completed successfully. Jul 30 16:55:14 devstack sudo[96484]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0c81673c-e5ae-438e-9a35-e6411f645c6b tempest-GroupSnapshotsTest-894339262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182" returned: 0 in 0.574s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0c81673c-e5ae-438e-9a35-e6411f645c6b tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182.f73759c3-5e7c-4e5d-b8c0-bfcbaafdfea8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:14 devstack sudo[96489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182.f73759c3-5e7c-4e5d-b8c0-bfcbaafdfea8 Jul 30 16:55:14 devstack sudo[96489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:14 devstack sudo[96489]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0c81673c-e5ae-438e-9a35-e6411f645c6b tempest-GroupSnapshotsTest-894339262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182.f73759c3-5e7c-4e5d-b8c0-bfcbaafdfea8" returned: 0 in 0.388s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0c81673c-e5ae-438e-9a35-e6411f645c6b tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182.f73759c3-5e7c-4e5d-b8c0-bfcbaafdfea8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:14 devstack sudo[96494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182.f73759c3-5e7c-4e5d-b8c0-bfcbaafdfea8 Jul 30 16:55:14 devstack sudo[96494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:14 devstack sudo[96494]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0c81673c-e5ae-438e-9a35-e6411f645c6b tempest-GroupSnapshotsTest-894339262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182.f73759c3-5e7c-4e5d-b8c0-bfcbaafdfea8" returned: 0 in 0.266s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:14 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-0c81673c-e5ae-438e-9a35-e6411f645c6b tempest-GroupSnapshotsTest-894339262 None] Lock "cinder-quobyte-f73759c3-5e7c-4e5d-b8c0-bfcbaafdfea8" released by "_delete_snapshot" :: held 1.822s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:14 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-0c81673c-e5ae-438e-9a35-e6411f645c6b tempest-GroupSnapshotsTest-894339262 None] Lock "cinder-quobyte-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182" released by "delete_snapshot" :: held 1.856s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:14 devstack cinder-volume[88591]: WARNING cinder.quota [None req-0c81673c-e5ae-438e-9a35-e6411f645c6b tempest-GroupSnapshotsTest-894339262 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-244820784 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-244820784, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:55:15 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-0c81673c-e5ae-438e-9a35-e6411f645c6b tempest-GroupSnapshotsTest-894339262 None] Created reservations ['fb89c8d5-bf3f-4b79-b2b7-5580c5810c26', '4fc18e40-0940-4806-9fba-00b20436df65', 'f6d43778-a805-47a1-9e8d-e4e23f57d710', '0af5a3a9-5764-46c6-bc3e-b19fdfa1c13a'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:55:15 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-0c81673c-e5ae-438e-9a35-e6411f645c6b tempest-GroupSnapshotsTest-894339262 None] group_snapshot 78e75cdd-649d-4844-bb36-a9e1150c9dca: deleted successfully Jul 30 16:55:15 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ee93daec-dd3e-46b7-ac4e-7f6881ce65a6 tempest-GroupSnapshotsTest-894339262 None] Acquiring lock "cinder-quobyte-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:15 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ee93daec-dd3e-46b7-ac4e-7f6881ce65a6 tempest-GroupSnapshotsTest-894339262 None] Lock "cinder-quobyte-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182" acquired by "delete_volume" :: waited 0.032s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:15 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[7902d437-9f01-4132-ad0d-f046547d0c86]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ee93daec-dd3e-46b7-ac4e-7f6881ce65a6 tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:16 devstack sudo[96500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182 Jul 30 16:55:16 devstack sudo[96500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:16 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-219221a0-9c1d-4af3-a2ef-97c38a5f5af9 tempest-GroupsTest-1275132889 None] Acquiring lock "cinder-quobyte-20c4c6a2-7f29-4965-96c6-84607a3c14b5" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:16 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-219221a0-9c1d-4af3-a2ef-97c38a5f5af9 tempest-GroupsTest-1275132889 None] Lock "cinder-quobyte-20c4c6a2-7f29-4965-96c6-84607a3c14b5" acquired by "delete_volume" :: waited 0.042s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:16 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89bf4f0-e1e8-4faa-9775-a500265eef2d]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:16 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-219221a0-9c1d-4af3-a2ef-97c38a5f5af9 tempest-GroupsTest-1275132889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-20c4c6a2-7f29-4965-96c6-84607a3c14b5 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:16 devstack sudo[96500]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:16 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ee93daec-dd3e-46b7-ac4e-7f6881ce65a6 tempest-GroupSnapshotsTest-894339262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182" returned: 0 in 0.663s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:16 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ee93daec-dd3e-46b7-ac4e-7f6881ce65a6 tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:16 devstack sudo[96503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-20c4c6a2-7f29-4965-96c6-84607a3c14b5 Jul 30 16:55:16 devstack sudo[96503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:16 devstack sudo[96512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182 Jul 30 16:55:16 devstack sudo[96512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:16 devstack sudo[96512]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:16 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ee93daec-dd3e-46b7-ac4e-7f6881ce65a6 tempest-GroupSnapshotsTest-894339262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182" returned: 0 in 0.423s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:16 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ee93daec-dd3e-46b7-ac4e-7f6881ce65a6 tempest-GroupSnapshotsTest-894339262 None] Lock "cinder-quobyte-78aeb2c4-ffa5-4f82-a6d1-fae1dd934182" released by "delete_volume" :: held 1.200s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:17 devstack sudo[96503]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-219221a0-9c1d-4af3-a2ef-97c38a5f5af9 tempest-GroupsTest-1275132889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-20c4c6a2-7f29-4965-96c6-84607a3c14b5" returned: 0 in 0.756s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-219221a0-9c1d-4af3-a2ef-97c38a5f5af9 tempest-GroupsTest-1275132889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-20c4c6a2-7f29-4965-96c6-84607a3c14b5 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:17 devstack sudo[96519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-20c4c6a2-7f29-4965-96c6-84607a3c14b5 Jul 30 16:55:17 devstack sudo[96519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:17 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-ee93daec-dd3e-46b7-ac4e-7f6881ce65a6 tempest-GroupSnapshotsTest-894339262 None] Created reservations ['83b14847-5149-4853-bdca-3981f447cf6a'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:55:17 devstack cinder-volume[88591]: WARNING cinder.db.api [None req-ee93daec-dd3e-46b7-ac4e-7f6881ce65a6 tempest-GroupSnapshotsTest-894339262 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-244820784'] Jul 30 16:55:17 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-ee93daec-dd3e-46b7-ac4e-7f6881ce65a6 tempest-GroupSnapshotsTest-894339262 None] Created reservations ['e75aa358-77ea-47a8-966a-946821e268c2', 'bbc1bac2-cc36-4bae-a2c8-0c1d63302900', '0faa706b-0d94-4927-957e-6ee865d14ceb', 'ecab8bbc-07d0-4831-8476-86cf0dc9757c'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:55:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ee93daec-dd3e-46b7-ac4e-7f6881ce65a6 tempest-GroupSnapshotsTest-894339262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ee93daec-dd3e-46b7-ac4e-7f6881ce65a6 tempest-GroupSnapshotsTest-894339262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:17 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ee93daec-dd3e-46b7-ac4e-7f6881ce65a6 tempest-GroupSnapshotsTest-894339262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:55:17 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ee93daec-dd3e-46b7-ac4e-7f6881ce65a6 tempest-GroupSnapshotsTest-894339262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:55:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ee93daec-dd3e-46b7-ac4e-7f6881ce65a6 tempest-GroupSnapshotsTest-894339262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ee93daec-dd3e-46b7-ac4e-7f6881ce65a6 tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:17 devstack sudo[96521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:55:17 devstack sudo[96521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:17 devstack sudo[96519]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-219221a0-9c1d-4af3-a2ef-97c38a5f5af9 tempest-GroupsTest-1275132889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-20c4c6a2-7f29-4965-96c6-84607a3c14b5" returned: 0 in 0.758s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:17 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-219221a0-9c1d-4af3-a2ef-97c38a5f5af9 tempest-GroupsTest-1275132889 None] Lock "cinder-quobyte-20c4c6a2-7f29-4965-96c6-84607a3c14b5" released by "delete_volume" :: held 1.627s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:17 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-219221a0-9c1d-4af3-a2ef-97c38a5f5af9 tempest-GroupsTest-1275132889 None] Acquiring lock "cinder-quobyte-ef128026-6a5c-4eb6-bce5-558af382e4f8" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:17 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-219221a0-9c1d-4af3-a2ef-97c38a5f5af9 tempest-GroupsTest-1275132889 None] Lock "cinder-quobyte-ef128026-6a5c-4eb6-bce5-558af382e4f8" acquired by "delete_volume" :: waited 0.060s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:17 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[52bc8765-e4b6-4a3e-ab71-fdafa901155f]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-219221a0-9c1d-4af3-a2ef-97c38a5f5af9 tempest-GroupsTest-1275132889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ef128026-6a5c-4eb6-bce5-558af382e4f8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:18 devstack sudo[96521]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ee93daec-dd3e-46b7-ac4e-7f6881ce65a6 tempest-GroupSnapshotsTest-894339262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.497s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:18 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-ee93daec-dd3e-46b7-ac4e-7f6881ce65a6 tempest-GroupSnapshotsTest-894339262 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:55:18 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-ee93daec-dd3e-46b7-ac4e-7f6881ce65a6 tempest-GroupSnapshotsTest-894339262 None] Delete group completed successfully. Jul 30 16:55:18 devstack sudo[96525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ef128026-6a5c-4eb6-bce5-558af382e4f8 Jul 30 16:55:18 devstack sudo[96525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:18 devstack sudo[96525]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-219221a0-9c1d-4af3-a2ef-97c38a5f5af9 tempest-GroupsTest-1275132889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ef128026-6a5c-4eb6-bce5-558af382e4f8" returned: 0 in 0.763s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-219221a0-9c1d-4af3-a2ef-97c38a5f5af9 tempest-GroupsTest-1275132889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ef128026-6a5c-4eb6-bce5-558af382e4f8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:18 devstack sudo[96542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ef128026-6a5c-4eb6-bce5-558af382e4f8 Jul 30 16:55:18 devstack sudo[96542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:19 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-a5aaaf47-bc7d-4d44-8b44-5d9558f0bfc8 tempest-GroupSnapshotsTest-894339262 None] Group tempest-GroupSnapshotsTest-Group-1242025995: creating Jul 30 16:55:19 devstack sudo[96542]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-219221a0-9c1d-4af3-a2ef-97c38a5f5af9 tempest-GroupsTest-1275132889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ef128026-6a5c-4eb6-bce5-558af382e4f8" returned: 0 in 0.438s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:19 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-219221a0-9c1d-4af3-a2ef-97c38a5f5af9 tempest-GroupsTest-1275132889 None] Lock "cinder-quobyte-ef128026-6a5c-4eb6-bce5-558af382e4f8" released by "delete_volume" :: held 1.311s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:19 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-a5aaaf47-bc7d-4d44-8b44-5d9558f0bfc8 tempest-GroupSnapshotsTest-894339262 None] Group tempest-GroupSnapshotsTest-Group-1242025995: created successfully Jul 30 16:55:19 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-a5aaaf47-bc7d-4d44-8b44-5d9558f0bfc8 tempest-GroupSnapshotsTest-894339262 None] Create group completed successfully. Jul 30 16:55:19 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-219221a0-9c1d-4af3-a2ef-97c38a5f5af9 tempest-GroupsTest-1275132889 None] Created reservations ['c217ae67-d4da-4772-86b6-fd7f6f80963f'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:55:19 devstack cinder-volume[88591]: WARNING cinder.quota [None req-219221a0-9c1d-4af3-a2ef-97c38a5f5af9 tempest-GroupsTest-1275132889 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1050959795 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1050959795, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:55:19 devstack cinder-volume[88591]: WARNING cinder.quota [None req-219221a0-9c1d-4af3-a2ef-97c38a5f5af9 tempest-GroupsTest-1275132889 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1050959795 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1050959795, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:55:19 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-219221a0-9c1d-4af3-a2ef-97c38a5f5af9 tempest-GroupsTest-1275132889 None] Created reservations ['b12f854d-6b35-4c58-9843-2da17fa5c28e', 'a8299484-ce2b-449c-9b30-303a58641f4a', '24e8e792-fe0b-4c97-a211-29c1fa00b3ee', '8840a151-97a0-41de-a209-4328cf1ce4f4'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:55:19 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-219221a0-9c1d-4af3-a2ef-97c38a5f5af9 tempest-GroupsTest-1275132889 None] Created reservations ['3bad6c02-4389-4df8-a202-3e8ad97450fc', 'f2c6bb65-138a-43a9-93c5-fabbc28c335c', '3275c09d-0bde-466b-ac82-5c6b05469387', '84a35784-4f4f-4867-a07a-f13e424e3569'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:55:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-219221a0-9c1d-4af3-a2ef-97c38a5f5af9 tempest-GroupsTest-1275132889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-219221a0-9c1d-4af3-a2ef-97c38a5f5af9 tempest-GroupsTest-1275132889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:19 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-219221a0-9c1d-4af3-a2ef-97c38a5f5af9 tempest-GroupsTest-1275132889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:55:19 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-219221a0-9c1d-4af3-a2ef-97c38a5f5af9 tempest-GroupsTest-1275132889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:55:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-219221a0-9c1d-4af3-a2ef-97c38a5f5af9 tempest-GroupsTest-1275132889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-219221a0-9c1d-4af3-a2ef-97c38a5f5af9 tempest-GroupsTest-1275132889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:19 devstack sudo[96551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:55:19 devstack sudo[96551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:19 devstack sudo[96551]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-219221a0-9c1d-4af3-a2ef-97c38a5f5af9 tempest-GroupsTest-1275132889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.256s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:19 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-219221a0-9c1d-4af3-a2ef-97c38a5f5af9 tempest-GroupsTest-1275132889 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:55:19 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-219221a0-9c1d-4af3-a2ef-97c38a5f5af9 tempest-GroupsTest-1275132889 None] Delete group completed successfully. Jul 30 16:55:21 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8308d6c-6da4-4703-a241-706c577d85bf tempest-GroupSnapshotsTest-894339262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:55:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-e8308d6c-6da4-4703-a241-706c577d85bf tempest-GroupSnapshotsTest-894339262 None] Flow 'volume_create_manager' (0df2d4cb-7a7d-4d16-a828-0307d0455e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:55:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-e8308d6c-6da4-4703-a241-706c577d85bf tempest-GroupSnapshotsTest-894339262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1d00efd-df3e-4825-8c22-7b8356bdf3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-e8308d6c-6da4-4703-a241-706c577d85bf tempest-GroupSnapshotsTest-894339262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1d00efd-df3e-4825-8c22-7b8356bdf3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:55:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1137634555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=78439fc1-fa0b-41f1-8341-c31d10e740e5,host='devstack@QuobyteHD#QuobyteHD',id=a470cb3d-aeef-4b12-9b0b-192d3bf8a57b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83a0d1d09329442397d9fb171d5d9bf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:55:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:55:21Z,use_quota=True,user_id='b2dffab8703341f598abb31c84441738',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(afb9f952-c7cb-407d-9185-7a0aaf575985),volume_type_id=afb9f952-c7cb-407d-9185-7a0aaf575985)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-e8308d6c-6da4-4703-a241-706c577d85bf tempest-GroupSnapshotsTest-894339262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d01b334f-7233-4e36-b9c6-b4a00f533571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-e8308d6c-6da4-4703-a241-706c577d85bf tempest-GroupSnapshotsTest-894339262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d01b334f-7233-4e36-b9c6-b4a00f533571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-e8308d6c-6da4-4703-a241-706c577d85bf tempest-GroupSnapshotsTest-894339262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86b67cf7-baf8-4cac-881f-0235f6c1a710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-e8308d6c-6da4-4703-a241-706c577d85bf tempest-GroupSnapshotsTest-894339262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86b67cf7-baf8-4cac-881f-0235f6c1a710) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a470cb3d-aeef-4b12-9b0b-192d3bf8a57b', 'volume_name': 'volume-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-e8308d6c-6da4-4703-a241-706c577d85bf tempest-GroupSnapshotsTest-894339262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb73c7d7-0fe3-46fd-ba11-965b5aa8ced5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-e8308d6c-6da4-4703-a241-706c577d85bf tempest-GroupSnapshotsTest-894339262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb73c7d7-0fe3-46fd-ba11-965b5aa8ced5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-e8308d6c-6da4-4703-a241-706c577d85bf tempest-GroupSnapshotsTest-894339262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (468923a2-6b8d-4242-b9ff-3daa77cedd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:21 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-e8308d6c-6da4-4703-a241-706c577d85bf tempest-GroupSnapshotsTest-894339262 None] Volume a470cb3d-aeef-4b12-9b0b-192d3bf8a57b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b', 'volume_size': 1} Jul 30 16:55:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-e8308d6c-6da4-4703-a241-706c577d85bf tempest-GroupSnapshotsTest-894339262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-e8308d6c-6da4-4703-a241-706c577d85bf tempest-GroupSnapshotsTest-894339262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:21 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-e8308d6c-6da4-4703-a241-706c577d85bf tempest-GroupSnapshotsTest-894339262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=78439fc1-fa0b-41f1-8341-c31d10e740e5,created_at=2026-07-30T14:55:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1137634555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=78439fc1-fa0b-41f1-8341-c31d10e740e5,host='devstack@QuobyteHD#QuobyteHD',id=a470cb3d-aeef-4b12-9b0b-192d3bf8a57b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83a0d1d09329442397d9fb171d5d9bf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:55:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:55:21Z,use_quota=True,user_id='b2dffab8703341f598abb31c84441738',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(afb9f952-c7cb-407d-9185-7a0aaf575985),volume_type_id=afb9f952-c7cb-407d-9185-7a0aaf575985)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:55:21 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-e8308d6c-6da4-4703-a241-706c577d85bf tempest-GroupSnapshotsTest-894339262 None] Creating volume a470cb3d-aeef-4b12-9b0b-192d3bf8a57b {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:55:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-e8308d6c-6da4-4703-a241-706c577d85bf tempest-GroupSnapshotsTest-894339262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-e8308d6c-6da4-4703-a241-706c577d85bf tempest-GroupSnapshotsTest-894339262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:21 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-e8308d6c-6da4-4703-a241-706c577d85bf tempest-GroupSnapshotsTest-894339262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:55:21 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-e8308d6c-6da4-4703-a241-706c577d85bf tempest-GroupSnapshotsTest-894339262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:55:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-e8308d6c-6da4-4703-a241-706c577d85bf tempest-GroupSnapshotsTest-894339262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:21 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-e8308d6c-6da4-4703-a241-706c577d85bf tempest-GroupSnapshotsTest-894339262 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:55:21 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-e8308d6c-6da4-4703-a241-706c577d85bf tempest-GroupSnapshotsTest-894339262 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:55:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e8308d6c-6da4-4703-a241-706c577d85bf tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:21 devstack sudo[96554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b 1073741824 Jul 30 16:55:21 devstack sudo[96554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:21 devstack sudo[96554]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e8308d6c-6da4-4703-a241-706c577d85bf tempest-GroupSnapshotsTest-894339262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b 1073741824" returned: 0 in 0.668s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e8308d6c-6da4-4703-a241-706c577d85bf tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:21 devstack sudo[96563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b Jul 30 16:55:21 devstack sudo[96563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:22 devstack sudo[96563]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e8308d6c-6da4-4703-a241-706c577d85bf tempest-GroupSnapshotsTest-894339262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b" returned: 0 in 0.331s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:22 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-e8308d6c-6da4-4703-a241-706c577d85bf tempest-GroupSnapshotsTest-894339262 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:55:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-e8308d6c-6da4-4703-a241-706c577d85bf tempest-GroupSnapshotsTest-894339262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:22 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-e8308d6c-6da4-4703-a241-706c577d85bf tempest-GroupSnapshotsTest-894339262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (468923a2-6b8d-4242-b9ff-3daa77cedd0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:22 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-e8308d6c-6da4-4703-a241-706c577d85bf tempest-GroupSnapshotsTest-894339262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beba7e89-7f27-4895-a667-68a588b92572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:22 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-e8308d6c-6da4-4703-a241-706c577d85bf tempest-GroupSnapshotsTest-894339262 None] Volume volume-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b (a470cb3d-aeef-4b12-9b0b-192d3bf8a57b): created successfully Jul 30 16:55:22 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-e8308d6c-6da4-4703-a241-706c577d85bf tempest-GroupSnapshotsTest-894339262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beba7e89-7f27-4895-a667-68a588b92572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:22 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-e8308d6c-6da4-4703-a241-706c577d85bf tempest-GroupSnapshotsTest-894339262 None] Flow 'volume_create_manager' (0df2d4cb-7a7d-4d16-a828-0307d0455e7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:55:22 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-e8308d6c-6da4-4703-a241-706c577d85bf tempest-GroupSnapshotsTest-894339262 None] Created volume successfully. Jul 30 16:55:24 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0eb3e77-8b3e-423b-89d5-cfb274419a2c tempest-GroupSnapshotsTest-894339262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:55:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d0eb3e77-8b3e-423b-89d5-cfb274419a2c tempest-GroupSnapshotsTest-894339262 None] Flow 'volume_create_manager' (885f4cfe-5e88-47df-8c5b-22c342967270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:55:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d0eb3e77-8b3e-423b-89d5-cfb274419a2c tempest-GroupSnapshotsTest-894339262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1de8e5fa-2bb0-4611-a58b-1cb8df3972e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d0eb3e77-8b3e-423b-89d5-cfb274419a2c tempest-GroupSnapshotsTest-894339262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1de8e5fa-2bb0-4611-a58b-1cb8df3972e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-304862320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=78439fc1-fa0b-41f1-8341-c31d10e740e5,host='devstack@QuobyteHD#QuobyteHD',id=a91059a2-476b-4ab5-93cd-99d5a299d614,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83a0d1d09329442397d9fb171d5d9bf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:55:24Z,use_quota=True,user_id='b2dffab8703341f598abb31c84441738',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(afb9f952-c7cb-407d-9185-7a0aaf575985),volume_type_id=afb9f952-c7cb-407d-9185-7a0aaf575985)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d0eb3e77-8b3e-423b-89d5-cfb274419a2c tempest-GroupSnapshotsTest-894339262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0986aec8-a569-4715-b7a0-a5f091d010ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d0eb3e77-8b3e-423b-89d5-cfb274419a2c tempest-GroupSnapshotsTest-894339262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0986aec8-a569-4715-b7a0-a5f091d010ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d0eb3e77-8b3e-423b-89d5-cfb274419a2c tempest-GroupSnapshotsTest-894339262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73b62c7f-0e99-469d-8c2d-c249e079138e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d0eb3e77-8b3e-423b-89d5-cfb274419a2c tempest-GroupSnapshotsTest-894339262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73b62c7f-0e99-469d-8c2d-c249e079138e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a91059a2-476b-4ab5-93cd-99d5a299d614', 'volume_name': 'volume-a91059a2-476b-4ab5-93cd-99d5a299d614', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d0eb3e77-8b3e-423b-89d5-cfb274419a2c tempest-GroupSnapshotsTest-894339262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (573ef677-0571-4e24-8050-cfce2561e8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d0eb3e77-8b3e-423b-89d5-cfb274419a2c tempest-GroupSnapshotsTest-894339262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (573ef677-0571-4e24-8050-cfce2561e8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d0eb3e77-8b3e-423b-89d5-cfb274419a2c tempest-GroupSnapshotsTest-894339262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edc65806-fb4a-4c5f-966e-4aa747db258a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:24 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-d0eb3e77-8b3e-423b-89d5-cfb274419a2c tempest-GroupSnapshotsTest-894339262 None] Volume a91059a2-476b-4ab5-93cd-99d5a299d614: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a91059a2-476b-4ab5-93cd-99d5a299d614', 'volume_size': 1} Jul 30 16:55:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d0eb3e77-8b3e-423b-89d5-cfb274419a2c tempest-GroupSnapshotsTest-894339262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d0eb3e77-8b3e-423b-89d5-cfb274419a2c tempest-GroupSnapshotsTest-894339262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:24 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d0eb3e77-8b3e-423b-89d5-cfb274419a2c tempest-GroupSnapshotsTest-894339262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=78439fc1-fa0b-41f1-8341-c31d10e740e5,created_at=2026-07-30T14:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-304862320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=78439fc1-fa0b-41f1-8341-c31d10e740e5,host='devstack@QuobyteHD#QuobyteHD',id=a91059a2-476b-4ab5-93cd-99d5a299d614,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83a0d1d09329442397d9fb171d5d9bf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:55:24Z,use_quota=True,user_id='b2dffab8703341f598abb31c84441738',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(afb9f952-c7cb-407d-9185-7a0aaf575985),volume_type_id=afb9f952-c7cb-407d-9185-7a0aaf575985)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:55:24 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-d0eb3e77-8b3e-423b-89d5-cfb274419a2c tempest-GroupSnapshotsTest-894339262 None] Creating volume a91059a2-476b-4ab5-93cd-99d5a299d614 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:55:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d0eb3e77-8b3e-423b-89d5-cfb274419a2c tempest-GroupSnapshotsTest-894339262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d0eb3e77-8b3e-423b-89d5-cfb274419a2c tempest-GroupSnapshotsTest-894339262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:24 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d0eb3e77-8b3e-423b-89d5-cfb274419a2c tempest-GroupSnapshotsTest-894339262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:55:24 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d0eb3e77-8b3e-423b-89d5-cfb274419a2c tempest-GroupSnapshotsTest-894339262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:55:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d0eb3e77-8b3e-423b-89d5-cfb274419a2c tempest-GroupSnapshotsTest-894339262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:24 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d0eb3e77-8b3e-423b-89d5-cfb274419a2c tempest-GroupSnapshotsTest-894339262 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:55:24 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-d0eb3e77-8b3e-423b-89d5-cfb274419a2c tempest-GroupSnapshotsTest-894339262 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:55:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d0eb3e77-8b3e-423b-89d5-cfb274419a2c tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a91059a2-476b-4ab5-93cd-99d5a299d614 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:24 devstack sudo[96644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a91059a2-476b-4ab5-93cd-99d5a299d614 1073741824 Jul 30 16:55:24 devstack sudo[96644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:25 devstack sudo[96644]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d0eb3e77-8b3e-423b-89d5-cfb274419a2c tempest-GroupSnapshotsTest-894339262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a91059a2-476b-4ab5-93cd-99d5a299d614 1073741824" returned: 0 in 0.730s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d0eb3e77-8b3e-423b-89d5-cfb274419a2c tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a91059a2-476b-4ab5-93cd-99d5a299d614 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:25 devstack sudo[96661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a91059a2-476b-4ab5-93cd-99d5a299d614 Jul 30 16:55:25 devstack sudo[96661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:25 devstack sudo[96661]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d0eb3e77-8b3e-423b-89d5-cfb274419a2c tempest-GroupSnapshotsTest-894339262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a91059a2-476b-4ab5-93cd-99d5a299d614" returned: 0 in 0.542s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:25 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d0eb3e77-8b3e-423b-89d5-cfb274419a2c tempest-GroupSnapshotsTest-894339262 None] <== create_volume: return (1378ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:55:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d0eb3e77-8b3e-423b-89d5-cfb274419a2c tempest-GroupSnapshotsTest-894339262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.380s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d0eb3e77-8b3e-423b-89d5-cfb274419a2c tempest-GroupSnapshotsTest-894339262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edc65806-fb4a-4c5f-966e-4aa747db258a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a91059a2-476b-4ab5-93cd-99d5a299d614', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d0eb3e77-8b3e-423b-89d5-cfb274419a2c tempest-GroupSnapshotsTest-894339262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (341dc53b-bd50-47cd-97f3-1d5f08ba3d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:26 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-d0eb3e77-8b3e-423b-89d5-cfb274419a2c tempest-GroupSnapshotsTest-894339262 None] Volume volume-a91059a2-476b-4ab5-93cd-99d5a299d614 (a91059a2-476b-4ab5-93cd-99d5a299d614): created successfully Jul 30 16:55:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d0eb3e77-8b3e-423b-89d5-cfb274419a2c tempest-GroupSnapshotsTest-894339262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (341dc53b-bd50-47cd-97f3-1d5f08ba3d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d0eb3e77-8b3e-423b-89d5-cfb274419a2c tempest-GroupSnapshotsTest-894339262 None] Flow 'volume_create_manager' (885f4cfe-5e88-47df-8c5b-22c342967270) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:55:26 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-d0eb3e77-8b3e-423b-89d5-cfb274419a2c tempest-GroupSnapshotsTest-894339262 None] Created volume successfully. Jul 30 16:55:27 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-f873a7e4-ef15-45a9-820f-48a18db60e0e tempest-GroupSnapshotsTest-894339262 None] Update group completed successfully. Jul 30 16:55:28 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-64fbe42f-1724-4249-8a7a-eefc34cd3369 tempest-GroupSnapshotsTest-894339262 None] Update group completed successfully. Jul 30 16:55:28 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-904484ca-9311-4907-ad25-ae2213e14ba6 tempest-GroupsV314Test-4473627 None] Group tempest-GroupsV314Test-Group-1904089997: creating Jul 30 16:55:28 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-904484ca-9311-4907-ad25-ae2213e14ba6 tempest-GroupsV314Test-4473627 None] Group tempest-GroupsV314Test-Group-1904089997: created successfully Jul 30 16:55:28 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-904484ca-9311-4907-ad25-ae2213e14ba6 tempest-GroupsV314Test-4473627 None] Create group completed successfully. Jul 30 16:55:29 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-1170366e-0ff2-4978-b332-908b8127f370 tempest-GroupSnapshotsTest-894339262 None] Update group completed successfully. Jul 30 16:55:30 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e208110-b589-470e-aa9a-355dccd554cc tempest-GroupsV314Test-4473627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:55:30 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0e208110-b589-470e-aa9a-355dccd554cc tempest-GroupsV314Test-4473627 None] Flow 'volume_create_manager' (afc7c3b0-f34e-4b71-afa1-64a537af3935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:55:30 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0e208110-b589-470e-aa9a-355dccd554cc tempest-GroupsV314Test-4473627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaf9365c-c0f4-4d5f-ad84-2996bddde80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:30 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0e208110-b589-470e-aa9a-355dccd554cc tempest-GroupsV314Test-4473627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaf9365c-c0f4-4d5f-ad84-2996bddde80d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:55:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-940253486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=48f248d9-1df8-48e1-840b-4b7a327fe338,host='devstack@QuobyteHD#QuobyteHD',id=38d7b8ac-d8e8-4a49-84c6-6a5b9da93518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='787eb95ba26f4c3780000621999a29b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:55:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:55:30Z,use_quota=True,user_id='0c91baeef5384c5dab3e5a72160c7c44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a2ec192f-4808-4137-8a7a-c26691184d15),volume_type_id=a2ec192f-4808-4137-8a7a-c26691184d15)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:30 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0e208110-b589-470e-aa9a-355dccd554cc tempest-GroupsV314Test-4473627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (816dd543-3bd1-48a2-b7d4-bb2a32996bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:30 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0e208110-b589-470e-aa9a-355dccd554cc tempest-GroupsV314Test-4473627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (816dd543-3bd1-48a2-b7d4-bb2a32996bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:30 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0e208110-b589-470e-aa9a-355dccd554cc tempest-GroupsV314Test-4473627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d84cdb59-0e26-4b40-bc58-3c752b382f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:30 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0e208110-b589-470e-aa9a-355dccd554cc tempest-GroupsV314Test-4473627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d84cdb59-0e26-4b40-bc58-3c752b382f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38d7b8ac-d8e8-4a49-84c6-6a5b9da93518', 'volume_name': 'volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:30 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0e208110-b589-470e-aa9a-355dccd554cc tempest-GroupsV314Test-4473627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c642a08-7c5d-4a7e-b7aa-d73083aa2d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:30 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0e208110-b589-470e-aa9a-355dccd554cc tempest-GroupsV314Test-4473627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c642a08-7c5d-4a7e-b7aa-d73083aa2d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:30 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0e208110-b589-470e-aa9a-355dccd554cc tempest-GroupsV314Test-4473627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a7493e9-0962-469d-9266-045639520f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:30 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-0e208110-b589-470e-aa9a-355dccd554cc tempest-GroupsV314Test-4473627 None] Volume 38d7b8ac-d8e8-4a49-84c6-6a5b9da93518: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518', 'volume_size': 1} Jul 30 16:55:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0e208110-b589-470e-aa9a-355dccd554cc tempest-GroupsV314Test-4473627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0e208110-b589-470e-aa9a-355dccd554cc tempest-GroupsV314Test-4473627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:30 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-0e208110-b589-470e-aa9a-355dccd554cc tempest-GroupsV314Test-4473627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=48f248d9-1df8-48e1-840b-4b7a327fe338,created_at=2026-07-30T14:55:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-940253486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=48f248d9-1df8-48e1-840b-4b7a327fe338,host='devstack@QuobyteHD#QuobyteHD',id=38d7b8ac-d8e8-4a49-84c6-6a5b9da93518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='787eb95ba26f4c3780000621999a29b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:55:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:55:30Z,use_quota=True,user_id='0c91baeef5384c5dab3e5a72160c7c44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a2ec192f-4808-4137-8a7a-c26691184d15),volume_type_id=a2ec192f-4808-4137-8a7a-c26691184d15)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:55:30 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-0e208110-b589-470e-aa9a-355dccd554cc tempest-GroupsV314Test-4473627 None] Creating volume 38d7b8ac-d8e8-4a49-84c6-6a5b9da93518 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:55:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0e208110-b589-470e-aa9a-355dccd554cc tempest-GroupsV314Test-4473627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0e208110-b589-470e-aa9a-355dccd554cc tempest-GroupsV314Test-4473627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:30 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-0e208110-b589-470e-aa9a-355dccd554cc tempest-GroupsV314Test-4473627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:55:30 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-0e208110-b589-470e-aa9a-355dccd554cc tempest-GroupsV314Test-4473627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:55:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0e208110-b589-470e-aa9a-355dccd554cc tempest-GroupsV314Test-4473627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:30 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-0e208110-b589-470e-aa9a-355dccd554cc tempest-GroupsV314Test-4473627 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:55:30 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-0e208110-b589-470e-aa9a-355dccd554cc tempest-GroupsV314Test-4473627 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:55:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0e208110-b589-470e-aa9a-355dccd554cc tempest-GroupsV314Test-4473627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:30 devstack sudo[96669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518 1073741824 Jul 30 16:55:30 devstack sudo[96669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:30 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-4c13d2fc-83f9-4f5f-9fa7-71dc44eb1b00 tempest-GroupSnapshotsTest-894339262 None] Update group completed successfully. Jul 30 16:55:31 devstack sudo[96669]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0e208110-b589-470e-aa9a-355dccd554cc tempest-GroupsV314Test-4473627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518 1073741824" returned: 0 in 0.486s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0e208110-b589-470e-aa9a-355dccd554cc tempest-GroupsV314Test-4473627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:31 devstack sudo[96675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518 Jul 30 16:55:31 devstack sudo[96675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:31 devstack sudo[96675]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0e208110-b589-470e-aa9a-355dccd554cc tempest-GroupsV314Test-4473627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518" returned: 0 in 0.263s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:31 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-0e208110-b589-470e-aa9a-355dccd554cc tempest-GroupsV314Test-4473627 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:55:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0e208110-b589-470e-aa9a-355dccd554cc tempest-GroupsV314Test-4473627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:31 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0e208110-b589-470e-aa9a-355dccd554cc tempest-GroupsV314Test-4473627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a7493e9-0962-469d-9266-045639520f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:31 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0e208110-b589-470e-aa9a-355dccd554cc tempest-GroupsV314Test-4473627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d30010c7-f650-4cec-93c1-0b9a875c356c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:31 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-0e208110-b589-470e-aa9a-355dccd554cc tempest-GroupsV314Test-4473627 None] Volume volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518 (38d7b8ac-d8e8-4a49-84c6-6a5b9da93518): created successfully Jul 30 16:55:31 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0e208110-b589-470e-aa9a-355dccd554cc tempest-GroupsV314Test-4473627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d30010c7-f650-4cec-93c1-0b9a875c356c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:31 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0e208110-b589-470e-aa9a-355dccd554cc tempest-GroupsV314Test-4473627 None] Flow 'volume_create_manager' (afc7c3b0-f34e-4b71-afa1-64a537af3935) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:55:31 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-0e208110-b589-470e-aa9a-355dccd554cc tempest-GroupsV314Test-4473627 None] Created volume successfully. Jul 30 16:55:32 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:SELECT=120,cinder:UPDATE=141,cinder:INSERT=26,cinder:DELETE=7 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:55:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-27b3a315-bafa-4400-ac7b-907c8ec057bd tempest-GroupsV314Test-4473627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-27b3a315-bafa-4400-ac7b-907c8ec057bd tempest-GroupsV314Test-4473627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:32 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-27b3a315-bafa-4400-ac7b-907c8ec057bd tempest-GroupsV314Test-4473627 None] Cloning volume 38d7b8ac-d8e8-4a49-84c6-6a5b9da93518 to volume 30867dcd-604b-4fc5-891d-b1f06410198f Jul 30 16:55:32 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-27b3a315-bafa-4400-ac7b-907c8ec057bd tempest-GroupsV314Test-4473627 None] Creating offline snapshot 4fbdd3a4-0388-43cd-8803-08bb4f56c1aa of volume 38d7b8ac-d8e8-4a49-84c6-6a5b9da93518 {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:55:32 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c51b03-b7a8-4bde-928e-a7a15744d53b]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-27b3a315-bafa-4400-ac7b-907c8ec057bd tempest-GroupsV314Test-4473627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:32 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-b42cd877-ab1a-473b-8d70-8db799b50581 tempest-GroupSnapshotsTest-894339262 None] GroupSnapshot f5b46309-edab-43c1-9458-0b25b4fca60c: creating. Jul 30 16:55:32 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b42cd877-ab1a-473b-8d70-8db799b50581 tempest-GroupSnapshotsTest-894339262 None] Group snapshot f5b46309-edab-43c1-9458-0b25b4fca60c: creating. {{(pid=88591) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 30 16:55:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b42cd877-ab1a-473b-8d70-8db799b50581 tempest-GroupSnapshotsTest-894339262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:32 devstack sudo[96679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518 Jul 30 16:55:32 devstack sudo[96679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:32 devstack sudo[96679]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-27b3a315-bafa-4400-ac7b-907c8ec057bd tempest-GroupsV314Test-4473627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518" returned: 0 in 0.522s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-27b3a315-bafa-4400-ac7b-907c8ec057bd tempest-GroupsV314Test-4473627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518.4fbdd3a4-0388-43cd-8803-08bb4f56c1aa 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:32 devstack sudo[96708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518.4fbdd3a4-0388-43cd-8803-08bb4f56c1aa 1G Jul 30 16:55:32 devstack sudo[96708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:33 devstack sudo[96708]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-27b3a315-bafa-4400-ac7b-907c8ec057bd tempest-GroupsV314Test-4473627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518.4fbdd3a4-0388-43cd-8803-08bb4f56c1aa 1G" returned: 0 in 0.407s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-27b3a315-bafa-4400-ac7b-907c8ec057bd tempest-GroupsV314Test-4473627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518.4fbdd3a4-0388-43cd-8803-08bb4f56c1aa {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:33 devstack sudo[96713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518.4fbdd3a4-0388-43cd-8803-08bb4f56c1aa Jul 30 16:55:33 devstack sudo[96713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:33 devstack sudo[96713]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-27b3a315-bafa-4400-ac7b-907c8ec057bd tempest-GroupsV314Test-4473627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518.4fbdd3a4-0388-43cd-8803-08bb4f56c1aa" returned: 0 in 0.298s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:33 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-27b3a315-bafa-4400-ac7b-907c8ec057bd tempest-GroupsV314Test-4473627 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518.4fbdd3a4-0388-43cd-8803-08bb4f56c1aa is being set with open permissions: ugo+rw: NotImplementedError Jul 30 16:55:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-27b3a315-bafa-4400-ac7b-907c8ec057bd tempest-GroupsV314Test-4473627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518.4fbdd3a4-0388-43cd-8803-08bb4f56c1aa {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:33 devstack sudo[96718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518.4fbdd3a4-0388-43cd-8803-08bb4f56c1aa Jul 30 16:55:33 devstack sudo[96718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:33 devstack sudo[96718]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-27b3a315-bafa-4400-ac7b-907c8ec057bd tempest-GroupsV314Test-4473627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518.4fbdd3a4-0388-43cd-8803-08bb4f56c1aa" returned: 0 in 0.278s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-27b3a315-bafa-4400-ac7b-907c8ec057bd tempest-GroupsV314Test-4473627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:34 devstack sudo[96725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518.info Jul 30 16:55:34 devstack sudo[96725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:34 devstack sudo[96725]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-27b3a315-bafa-4400-ac7b-907c8ec057bd tempest-GroupsV314Test-4473627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518.info" returned: 0 in 0.277s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:34 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-27b3a315-bafa-4400-ac7b-907c8ec057bd tempest-GroupsV314Test-4473627 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518.info is being set with open permissions: ugo+rw: NotImplementedError Jul 30 16:55:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-27b3a315-bafa-4400-ac7b-907c8ec057bd tempest-GroupsV314Test-4473627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:34 devstack sudo[96736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518.info Jul 30 16:55:34 devstack sudo[96736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:34 devstack sudo[96736]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-27b3a315-bafa-4400-ac7b-907c8ec057bd tempest-GroupsV314Test-4473627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518.info" returned: 0 in 0.259s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:34 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-27b3a315-bafa-4400-ac7b-907c8ec057bd tempest-GroupsV314Test-4473627 None] Acquiring lock "cinder-quobyte-30867dcd-604b-4fc5-891d-b1f06410198f" by "_copy_volume_from_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:34 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-27b3a315-bafa-4400-ac7b-907c8ec057bd tempest-GroupsV314Test-4473627 None] Lock "cinder-quobyte-30867dcd-604b-4fc5-891d-b1f06410198f" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:34 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-27b3a315-bafa-4400-ac7b-907c8ec057bd tempest-GroupsV314Test-4473627 None] snapshot: 4fbdd3a4-0388-43cd-8803-08bb4f56c1aa, volume: 30867dcd-604b-4fc5-891d-b1f06410198f, {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 16:55:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-27b3a315-bafa-4400-ac7b-907c8ec057bd tempest-GroupsV314Test-4473627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-27b3a315-bafa-4400-ac7b-907c8ec057bd tempest-GroupsV314Test-4473627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:34 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-27b3a315-bafa-4400-ac7b-907c8ec057bd tempest-GroupsV314Test-4473627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:55:34 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-27b3a315-bafa-4400-ac7b-907c8ec057bd tempest-GroupsV314Test-4473627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:55:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-27b3a315-bafa-4400-ac7b-907c8ec057bd tempest-GroupsV314Test-4473627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:34 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc9013f-8a3b-403d-b017-1b97cbe66141]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-27b3a315-bafa-4400-ac7b-907c8ec057bd tempest-GroupsV314Test-4473627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518.4fbdd3a4-0388-43cd-8803-08bb4f56c1aa {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:34 devstack sudo[96745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518.4fbdd3a4-0388-43cd-8803-08bb4f56c1aa Jul 30 16:55:34 devstack sudo[96745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:35 devstack sudo[96745]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-27b3a315-bafa-4400-ac7b-907c8ec057bd tempest-GroupsV314Test-4473627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518.4fbdd3a4-0388-43cd-8803-08bb4f56c1aa" returned: 0 in 0.389s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:35 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-27b3a315-bafa-4400-ac7b-907c8ec057bd tempest-GroupsV314Test-4473627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:55:35 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[353a4e71-3718-48bc-8e5b-d0cc8eb90ce0]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-27b3a315-bafa-4400-ac7b-907c8ec057bd tempest-GroupsV314Test-4473627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:35 devstack sudo[96762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518 Jul 30 16:55:35 devstack sudo[96762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:35 devstack sudo[96762]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-27b3a315-bafa-4400-ac7b-907c8ec057bd tempest-GroupsV314Test-4473627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518" returned: 0 in 0.441s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:35 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-27b3a315-bafa-4400-ac7b-907c8ec057bd tempest-GroupsV314Test-4473627 None] will copy from snapshot at /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518 {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 16:55:35 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-27b3a315-bafa-4400-ac7b-907c8ec057bd tempest-GroupsV314Test-4473627 None] Creating direct copy from snapshot {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 16:55:35 devstack cinder-volume[88591]: DEBUG cinder.utils [None req-27b3a315-bafa-4400-ac7b-907c8ec057bd tempest-GroupsV314Test-4473627 None] Path /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-30867dcd-604b-4fc5-891d-b1f06410198f not found in is_blk_device check {{(pid=88591) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 16:55:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-27b3a315-bafa-4400-ac7b-907c8ec057bd tempest-GroupsV314Test-4473627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-30867dcd-604b-4fc5-891d-b1f06410198f {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:35 devstack sudo[96783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-30867dcd-604b-4fc5-891d-b1f06410198f Jul 30 16:55:35 devstack sudo[96783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:41 devstack sudo[96783]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-27b3a315-bafa-4400-ac7b-907c8ec057bd tempest-GroupsV314Test-4473627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-30867dcd-604b-4fc5-891d-b1f06410198f" returned: 0 in 6.464s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:41 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-27b3a315-bafa-4400-ac7b-907c8ec057bd tempest-GroupsV314Test-4473627 None] Image conversion details: src /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518, size 1024.00 MB, duration 6.46 sec, destination /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-30867dcd-604b-4fc5-891d-b1f06410198f {{(pid=88591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:55:41 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-27b3a315-bafa-4400-ac7b-907c8ec057bd tempest-GroupsV314Test-4473627 None] Converted 1024.00 MB image at 158.39 MB/s Jul 30 16:55:41 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-27b3a315-bafa-4400-ac7b-907c8ec057bd tempest-GroupsV314Test-4473627 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-30867dcd-604b-4fc5-891d-b1f06410198f is being set with open permissions: ugo+rw: NotImplementedError Jul 30 16:55:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-27b3a315-bafa-4400-ac7b-907c8ec057bd tempest-GroupsV314Test-4473627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-30867dcd-604b-4fc5-891d-b1f06410198f {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:42 devstack sudo[96870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-30867dcd-604b-4fc5-891d-b1f06410198f Jul 30 16:55:42 devstack sudo[96870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:42 devstack sudo[96870]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-27b3a315-bafa-4400-ac7b-907c8ec057bd tempest-GroupsV314Test-4473627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-30867dcd-604b-4fc5-891d-b1f06410198f" returned: 0 in 0.278s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:42 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-27b3a315-bafa-4400-ac7b-907c8ec057bd tempest-GroupsV314Test-4473627 None] Lock "cinder-quobyte-30867dcd-604b-4fc5-891d-b1f06410198f" released by "_copy_volume_from_snapshot" :: held 7.652s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:42 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-27b3a315-bafa-4400-ac7b-907c8ec057bd tempest-GroupsV314Test-4473627 None] Acquiring lock "cinder-quobyte-4fbdd3a4-0388-43cd-8803-08bb4f56c1aa" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:42 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-27b3a315-bafa-4400-ac7b-907c8ec057bd tempest-GroupsV314Test-4473627 None] Lock "cinder-quobyte-4fbdd3a4-0388-43cd-8803-08bb4f56c1aa" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:42 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-27b3a315-bafa-4400-ac7b-907c8ec057bd tempest-GroupsV314Test-4473627 None] Deleting offline snapshot 4fbdd3a4-0388-43cd-8803-08bb4f56c1aa of volume 38d7b8ac-d8e8-4a49-84c6-6a5b9da93518 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:55:42 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-27b3a315-bafa-4400-ac7b-907c8ec057bd tempest-GroupsV314Test-4473627 None] snapshot_file for this snap is: volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518.4fbdd3a4-0388-43cd-8803-08bb4f56c1aa {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:55:42 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cec8beb-2f86-4c73-94b2-5ab101a72345]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-27b3a315-bafa-4400-ac7b-907c8ec057bd tempest-GroupsV314Test-4473627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518.4fbdd3a4-0388-43cd-8803-08bb4f56c1aa {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:42 devstack sudo[96878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518.4fbdd3a4-0388-43cd-8803-08bb4f56c1aa Jul 30 16:55:42 devstack sudo[96878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:42 devstack sudo[96878]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-27b3a315-bafa-4400-ac7b-907c8ec057bd tempest-GroupsV314Test-4473627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518.4fbdd3a4-0388-43cd-8803-08bb4f56c1aa" returned: 0 in 0.394s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:42 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-27b3a315-bafa-4400-ac7b-907c8ec057bd tempest-GroupsV314Test-4473627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:55:42 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfcde001-dd70-42aa-a819-1f72485edfba]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-27b3a315-bafa-4400-ac7b-907c8ec057bd tempest-GroupsV314Test-4473627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:42 devstack sudo[96883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518 Jul 30 16:55:42 devstack sudo[96883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:43 devstack sudo[96883]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-27b3a315-bafa-4400-ac7b-907c8ec057bd tempest-GroupsV314Test-4473627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518" returned: 0 in 0.515s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-27b3a315-bafa-4400-ac7b-907c8ec057bd tempest-GroupsV314Test-4473627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518.4fbdd3a4-0388-43cd-8803-08bb4f56c1aa {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:43 devstack sudo[96888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518.4fbdd3a4-0388-43cd-8803-08bb4f56c1aa Jul 30 16:55:43 devstack sudo[96888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:43 devstack sudo[96888]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-27b3a315-bafa-4400-ac7b-907c8ec057bd tempest-GroupsV314Test-4473627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518.4fbdd3a4-0388-43cd-8803-08bb4f56c1aa" returned: 0 in 0.325s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-27b3a315-bafa-4400-ac7b-907c8ec057bd tempest-GroupsV314Test-4473627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518.4fbdd3a4-0388-43cd-8803-08bb4f56c1aa {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:43 devstack sudo[96893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518.4fbdd3a4-0388-43cd-8803-08bb4f56c1aa Jul 30 16:55:43 devstack sudo[96893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:43 devstack sudo[96893]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-27b3a315-bafa-4400-ac7b-907c8ec057bd tempest-GroupsV314Test-4473627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518.4fbdd3a4-0388-43cd-8803-08bb4f56c1aa" returned: 0 in 0.254s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:43 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-27b3a315-bafa-4400-ac7b-907c8ec057bd tempest-GroupsV314Test-4473627 None] Lock "cinder-quobyte-4fbdd3a4-0388-43cd-8803-08bb4f56c1aa" released by "_delete_snapshot" :: held 1.592s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-27b3a315-bafa-4400-ac7b-907c8ec057bd tempest-GroupsV314Test-4473627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.561s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b42cd877-ab1a-473b-8d70-8db799b50581 tempest-GroupSnapshotsTest-894339262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.394s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:43 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-b42cd877-ab1a-473b-8d70-8db799b50581 tempest-GroupSnapshotsTest-894339262 None] Creating offline snapshot 1e692df5-e1fe-41d0-b419-c0e6168cb9cb of volume a470cb3d-aeef-4b12-9b0b-192d3bf8a57b {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:55:43 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8be7a6-1b56-4ec7-a611-39adc6c1706a]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b42cd877-ab1a-473b-8d70-8db799b50581 tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:44 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-27b3a315-bafa-4400-ac7b-907c8ec057bd tempest-GroupsV314Test-4473627 None] Create group from source-group-48f248d9-1df8-48e1-840b-4b7a327fe338 completed successfully. Jul 30 16:55:44 devstack sudo[96896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b Jul 30 16:55:44 devstack sudo[96896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:44 devstack sudo[96896]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b42cd877-ab1a-473b-8d70-8db799b50581 tempest-GroupSnapshotsTest-894339262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b" returned: 0 in 0.388s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b42cd877-ab1a-473b-8d70-8db799b50581 tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b.1e692df5-e1fe-41d0-b419-c0e6168cb9cb 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:44 devstack sudo[96901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b.1e692df5-e1fe-41d0-b419-c0e6168cb9cb 1G Jul 30 16:55:44 devstack sudo[96901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:44 devstack sudo[96901]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b42cd877-ab1a-473b-8d70-8db799b50581 tempest-GroupSnapshotsTest-894339262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b.1e692df5-e1fe-41d0-b419-c0e6168cb9cb 1G" returned: 0 in 0.401s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b42cd877-ab1a-473b-8d70-8db799b50581 tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b.1e692df5-e1fe-41d0-b419-c0e6168cb9cb {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:44 devstack sudo[96906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b.1e692df5-e1fe-41d0-b419-c0e6168cb9cb Jul 30 16:55:44 devstack sudo[96906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:45 devstack sudo[96906]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b42cd877-ab1a-473b-8d70-8db799b50581 tempest-GroupSnapshotsTest-894339262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b.1e692df5-e1fe-41d0-b419-c0e6168cb9cb" returned: 0 in 0.314s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:45 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-b42cd877-ab1a-473b-8d70-8db799b50581 tempest-GroupSnapshotsTest-894339262 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b.1e692df5-e1fe-41d0-b419-c0e6168cb9cb is being set with open permissions: ugo+rw: NotImplementedError Jul 30 16:55:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b42cd877-ab1a-473b-8d70-8db799b50581 tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b.1e692df5-e1fe-41d0-b419-c0e6168cb9cb {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:45 devstack sudo[96911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b.1e692df5-e1fe-41d0-b419-c0e6168cb9cb Jul 30 16:55:45 devstack sudo[96911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:45 devstack sudo[96911]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b42cd877-ab1a-473b-8d70-8db799b50581 tempest-GroupSnapshotsTest-894339262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b.1e692df5-e1fe-41d0-b419-c0e6168cb9cb" returned: 0 in 0.311s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:45 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:SELECT=123,cinder:UPDATE=105,cinder:DELETE=3,cinder:INSERT=23 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:55:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b42cd877-ab1a-473b-8d70-8db799b50581 tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:45 devstack sudo[96914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b.info Jul 30 16:55:45 devstack sudo[96914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:45 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-20653856-d8be-432c-989c-cd204a56cb0e tempest-GroupsV314Test-4473627 None] Acquiring lock "cinder-quobyte-30867dcd-604b-4fc5-891d-b1f06410198f" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:45 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-20653856-d8be-432c-989c-cd204a56cb0e tempest-GroupsV314Test-4473627 None] Lock "cinder-quobyte-30867dcd-604b-4fc5-891d-b1f06410198f" acquired by "delete_volume" :: waited 0.025s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:45 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed0df13-4264-486d-844b-6ea599b1cf40]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-20653856-d8be-432c-989c-cd204a56cb0e tempest-GroupsV314Test-4473627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-30867dcd-604b-4fc5-891d-b1f06410198f {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:45 devstack sudo[96914]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b42cd877-ab1a-473b-8d70-8db799b50581 tempest-GroupSnapshotsTest-894339262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b.info" returned: 0 in 0.356s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:45 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-b42cd877-ab1a-473b-8d70-8db799b50581 tempest-GroupSnapshotsTest-894339262 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b.info is being set with open permissions: ugo+rw: NotImplementedError Jul 30 16:55:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b42cd877-ab1a-473b-8d70-8db799b50581 tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:45 devstack sudo[96917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-30867dcd-604b-4fc5-891d-b1f06410198f Jul 30 16:55:45 devstack sudo[96917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:45 devstack sudo[96918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b.info Jul 30 16:55:45 devstack sudo[96918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:46 devstack sudo[96917]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-20653856-d8be-432c-989c-cd204a56cb0e tempest-GroupsV314Test-4473627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-30867dcd-604b-4fc5-891d-b1f06410198f" returned: 0 in 0.431s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-20653856-d8be-432c-989c-cd204a56cb0e tempest-GroupsV314Test-4473627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-30867dcd-604b-4fc5-891d-b1f06410198f {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:46 devstack sudo[96918]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b42cd877-ab1a-473b-8d70-8db799b50581 tempest-GroupSnapshotsTest-894339262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b.info" returned: 0 in 0.377s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:46 devstack sudo[96926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-30867dcd-604b-4fc5-891d-b1f06410198f Jul 30 16:55:46 devstack sudo[96926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b42cd877-ab1a-473b-8d70-8db799b50581 tempest-GroupSnapshotsTest-894339262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.259s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b42cd877-ab1a-473b-8d70-8db799b50581 tempest-GroupSnapshotsTest-894339262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b42cd877-ab1a-473b-8d70-8db799b50581 tempest-GroupSnapshotsTest-894339262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:46 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-b42cd877-ab1a-473b-8d70-8db799b50581 tempest-GroupSnapshotsTest-894339262 None] Creating offline snapshot b6778d13-3d58-4ac8-82d8-362776a73322 of volume a91059a2-476b-4ab5-93cd-99d5a299d614 {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:55:46 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[63143d5b-3d37-4283-89c3-8dc0971b02ec]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b42cd877-ab1a-473b-8d70-8db799b50581 tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a91059a2-476b-4ab5-93cd-99d5a299d614 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:46 devstack sudo[96928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a91059a2-476b-4ab5-93cd-99d5a299d614 Jul 30 16:55:46 devstack sudo[96928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:46 devstack sudo[96926]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-20653856-d8be-432c-989c-cd204a56cb0e tempest-GroupsV314Test-4473627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-30867dcd-604b-4fc5-891d-b1f06410198f" returned: 0 in 0.341s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:46 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-20653856-d8be-432c-989c-cd204a56cb0e tempest-GroupsV314Test-4473627 None] Lock "cinder-quobyte-30867dcd-604b-4fc5-891d-b1f06410198f" released by "delete_volume" :: held 0.835s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:46 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-20653856-d8be-432c-989c-cd204a56cb0e tempest-GroupsV314Test-4473627 None] Created reservations ['7af4cfec-8599-442b-9720-55443a125694'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:55:46 devstack cinder-volume[88591]: WARNING cinder.quota [None req-20653856-d8be-432c-989c-cd204a56cb0e tempest-GroupsV314Test-4473627 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1752834303 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1752834303, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:55:46 devstack cinder-volume[88591]: WARNING cinder.quota [None req-20653856-d8be-432c-989c-cd204a56cb0e tempest-GroupsV314Test-4473627 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1752834303 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1752834303, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:55:46 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-20653856-d8be-432c-989c-cd204a56cb0e tempest-GroupsV314Test-4473627 None] Created reservations ['8dfd8827-d761-4e73-bc61-b5a9b5293601', '538e847c-77b6-4314-a8ed-930afa515b9e', '97beec50-7568-4ccf-8e86-f160922f96ba', 'e517692d-08a1-41f4-8707-516753755cfd'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:55:46 devstack sudo[96928]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b42cd877-ab1a-473b-8d70-8db799b50581 tempest-GroupSnapshotsTest-894339262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a91059a2-476b-4ab5-93cd-99d5a299d614" returned: 0 in 0.482s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b42cd877-ab1a-473b-8d70-8db799b50581 tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a91059a2-476b-4ab5-93cd-99d5a299d614,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a91059a2-476b-4ab5-93cd-99d5a299d614.b6778d13-3d58-4ac8-82d8-362776a73322 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:46 devstack sudo[96934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a91059a2-476b-4ab5-93cd-99d5a299d614,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a91059a2-476b-4ab5-93cd-99d5a299d614.b6778d13-3d58-4ac8-82d8-362776a73322 1G Jul 30 16:55:46 devstack sudo[96934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-20653856-d8be-432c-989c-cd204a56cb0e tempest-GroupsV314Test-4473627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-20653856-d8be-432c-989c-cd204a56cb0e tempest-GroupsV314Test-4473627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:46 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-20653856-d8be-432c-989c-cd204a56cb0e tempest-GroupsV314Test-4473627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:55:47 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-20653856-d8be-432c-989c-cd204a56cb0e tempest-GroupsV314Test-4473627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:55:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-20653856-d8be-432c-989c-cd204a56cb0e tempest-GroupsV314Test-4473627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-20653856-d8be-432c-989c-cd204a56cb0e tempest-GroupsV314Test-4473627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:47 devstack sudo[96938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:55:47 devstack sudo[96938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:47 devstack sudo[96934]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b42cd877-ab1a-473b-8d70-8db799b50581 tempest-GroupSnapshotsTest-894339262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a91059a2-476b-4ab5-93cd-99d5a299d614,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a91059a2-476b-4ab5-93cd-99d5a299d614.b6778d13-3d58-4ac8-82d8-362776a73322 1G" returned: 0 in 0.700s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b42cd877-ab1a-473b-8d70-8db799b50581 tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a91059a2-476b-4ab5-93cd-99d5a299d614 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a91059a2-476b-4ab5-93cd-99d5a299d614.b6778d13-3d58-4ac8-82d8-362776a73322 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:47 devstack sudo[96950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a91059a2-476b-4ab5-93cd-99d5a299d614 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a91059a2-476b-4ab5-93cd-99d5a299d614.b6778d13-3d58-4ac8-82d8-362776a73322 Jul 30 16:55:47 devstack sudo[96950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:47 devstack sudo[96938]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-20653856-d8be-432c-989c-cd204a56cb0e tempest-GroupsV314Test-4473627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.563s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:47 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-20653856-d8be-432c-989c-cd204a56cb0e tempest-GroupsV314Test-4473627 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:55:47 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-20653856-d8be-432c-989c-cd204a56cb0e tempest-GroupsV314Test-4473627 None] Delete group completed successfully. Jul 30 16:55:47 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-dbc7d4af-f47c-4d0b-9e6d-f895631ae31b tempest-GroupsV314Test-4473627 None] Acquiring lock "cinder-quobyte-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:47 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-dbc7d4af-f47c-4d0b-9e6d-f895631ae31b tempest-GroupsV314Test-4473627 None] Lock "cinder-quobyte-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518" acquired by "delete_volume" :: waited 0.041s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:47 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1094cc-00c5-4d86-9b88-3604c79f7517]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dbc7d4af-f47c-4d0b-9e6d-f895631ae31b tempest-GroupsV314Test-4473627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:48 devstack sudo[96957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518 Jul 30 16:55:48 devstack sudo[96957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:48 devstack sudo[96950]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b42cd877-ab1a-473b-8d70-8db799b50581 tempest-GroupSnapshotsTest-894339262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a91059a2-476b-4ab5-93cd-99d5a299d614 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a91059a2-476b-4ab5-93cd-99d5a299d614.b6778d13-3d58-4ac8-82d8-362776a73322" returned: 0 in 0.644s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:48 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-b42cd877-ab1a-473b-8d70-8db799b50581 tempest-GroupSnapshotsTest-894339262 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a91059a2-476b-4ab5-93cd-99d5a299d614.b6778d13-3d58-4ac8-82d8-362776a73322 is being set with open permissions: ugo+rw: NotImplementedError Jul 30 16:55:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b42cd877-ab1a-473b-8d70-8db799b50581 tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a91059a2-476b-4ab5-93cd-99d5a299d614.b6778d13-3d58-4ac8-82d8-362776a73322 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:48 devstack sudo[96966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a91059a2-476b-4ab5-93cd-99d5a299d614.b6778d13-3d58-4ac8-82d8-362776a73322 Jul 30 16:55:48 devstack sudo[96966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:48 devstack sudo[96957]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dbc7d4af-f47c-4d0b-9e6d-f895631ae31b tempest-GroupsV314Test-4473627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518" returned: 0 in 0.640s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dbc7d4af-f47c-4d0b-9e6d-f895631ae31b tempest-GroupsV314Test-4473627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:48 devstack sudo[96966]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b42cd877-ab1a-473b-8d70-8db799b50581 tempest-GroupSnapshotsTest-894339262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a91059a2-476b-4ab5-93cd-99d5a299d614.b6778d13-3d58-4ac8-82d8-362776a73322" returned: 0 in 0.430s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:48 devstack sudo[96972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518 Jul 30 16:55:48 devstack sudo[96972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b42cd877-ab1a-473b-8d70-8db799b50581 tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a91059a2-476b-4ab5-93cd-99d5a299d614.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:48 devstack sudo[96974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a91059a2-476b-4ab5-93cd-99d5a299d614.info Jul 30 16:55:48 devstack sudo[96974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:48 devstack sudo[96972]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dbc7d4af-f47c-4d0b-9e6d-f895631ae31b tempest-GroupsV314Test-4473627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518" returned: 0 in 0.329s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:48 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-dbc7d4af-f47c-4d0b-9e6d-f895631ae31b tempest-GroupsV314Test-4473627 None] Lock "cinder-quobyte-38d7b8ac-d8e8-4a49-84c6-6a5b9da93518" released by "delete_volume" :: held 1.082s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:48 devstack sudo[96974]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b42cd877-ab1a-473b-8d70-8db799b50581 tempest-GroupSnapshotsTest-894339262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a91059a2-476b-4ab5-93cd-99d5a299d614.info" returned: 0 in 0.371s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:48 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-b42cd877-ab1a-473b-8d70-8db799b50581 tempest-GroupSnapshotsTest-894339262 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a91059a2-476b-4ab5-93cd-99d5a299d614.info is being set with open permissions: ugo+rw: NotImplementedError Jul 30 16:55:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b42cd877-ab1a-473b-8d70-8db799b50581 tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a91059a2-476b-4ab5-93cd-99d5a299d614.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:48 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-dbc7d4af-f47c-4d0b-9e6d-f895631ae31b tempest-GroupsV314Test-4473627 None] Created reservations ['5895d288-4c16-4397-bc9b-7abc2e71b08b'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:55:48 devstack sudo[96978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a91059a2-476b-4ab5-93cd-99d5a299d614.info Jul 30 16:55:48 devstack sudo[96978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:48 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-dbc7d4af-f47c-4d0b-9e6d-f895631ae31b tempest-GroupsV314Test-4473627 None] Created reservations ['a7f73ee1-4f14-46c1-8a6c-7571e22ec615', '176c7cd4-90e1-43e2-ae3d-04ad91e9f16d', '3b243876-d031-43b8-b1cd-333d9300fcd6', 'cf711bb3-1ae6-439d-86b3-c9c564931cf7'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:55:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-dbc7d4af-f47c-4d0b-9e6d-f895631ae31b tempest-GroupsV314Test-4473627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-dbc7d4af-f47c-4d0b-9e6d-f895631ae31b tempest-GroupsV314Test-4473627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:49 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-dbc7d4af-f47c-4d0b-9e6d-f895631ae31b tempest-GroupsV314Test-4473627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:55:49 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-dbc7d4af-f47c-4d0b-9e6d-f895631ae31b tempest-GroupsV314Test-4473627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:55:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-dbc7d4af-f47c-4d0b-9e6d-f895631ae31b tempest-GroupsV314Test-4473627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dbc7d4af-f47c-4d0b-9e6d-f895631ae31b tempest-GroupsV314Test-4473627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:49 devstack sudo[96980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:55:49 devstack sudo[96980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:49 devstack sudo[96978]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b42cd877-ab1a-473b-8d70-8db799b50581 tempest-GroupSnapshotsTest-894339262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a91059a2-476b-4ab5-93cd-99d5a299d614.info" returned: 0 in 0.401s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b42cd877-ab1a-473b-8d70-8db799b50581 tempest-GroupSnapshotsTest-894339262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.141s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:49 devstack sudo[96980]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dbc7d4af-f47c-4d0b-9e6d-f895631ae31b tempest-GroupsV314Test-4473627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.275s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:49 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-dbc7d4af-f47c-4d0b-9e6d-f895631ae31b tempest-GroupsV314Test-4473627 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:55:49 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-dbc7d4af-f47c-4d0b-9e6d-f895631ae31b tempest-GroupsV314Test-4473627 None] Delete group completed successfully. Jul 30 16:55:49 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-b42cd877-ab1a-473b-8d70-8db799b50581 tempest-GroupSnapshotsTest-894339262 None] group_snapshot f5b46309-edab-43c1-9458-0b25b4fca60c: created successfully Jul 30 16:55:50 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-b8d9f4c3-819c-4684-8abd-f4642ea95511 tempest-GroupSnapshotsTest-894339262 None] group_snapshot f5b46309-edab-43c1-9458-0b25b4fca60c: deleting Jul 30 16:55:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b8d9f4c3-819c-4684-8abd-f4642ea95511 tempest-GroupSnapshotsTest-894339262 None] group_snapshot f5b46309-edab-43c1-9458-0b25b4fca60c: deleting {{(pid=88591) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 30 16:55:50 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b8d9f4c3-819c-4684-8abd-f4642ea95511 tempest-GroupSnapshotsTest-894339262 None] Acquiring lock "cinder-quobyte-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:50 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b8d9f4c3-819c-4684-8abd-f4642ea95511 tempest-GroupSnapshotsTest-894339262 None] Lock "cinder-quobyte-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:50 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b8d9f4c3-819c-4684-8abd-f4642ea95511 tempest-GroupSnapshotsTest-894339262 None] Acquiring lock "cinder-quobyte-1e692df5-e1fe-41d0-b419-c0e6168cb9cb" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:50 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b8d9f4c3-819c-4684-8abd-f4642ea95511 tempest-GroupSnapshotsTest-894339262 None] Lock "cinder-quobyte-1e692df5-e1fe-41d0-b419-c0e6168cb9cb" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:50 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-b8d9f4c3-819c-4684-8abd-f4642ea95511 tempest-GroupSnapshotsTest-894339262 None] Deleting offline snapshot 1e692df5-e1fe-41d0-b419-c0e6168cb9cb of volume a470cb3d-aeef-4b12-9b0b-192d3bf8a57b {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:55:50 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-b8d9f4c3-819c-4684-8abd-f4642ea95511 tempest-GroupSnapshotsTest-894339262 None] snapshot_file for this snap is: volume-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b.1e692df5-e1fe-41d0-b419-c0e6168cb9cb {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:55:50 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c563f2e-39ce-4c3c-a106-4f59f3821098]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b8d9f4c3-819c-4684-8abd-f4642ea95511 tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b.1e692df5-e1fe-41d0-b419-c0e6168cb9cb {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:50 devstack sudo[96990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b.1e692df5-e1fe-41d0-b419-c0e6168cb9cb Jul 30 16:55:50 devstack sudo[96990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:50 devstack sudo[96990]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b8d9f4c3-819c-4684-8abd-f4642ea95511 tempest-GroupSnapshotsTest-894339262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b.1e692df5-e1fe-41d0-b419-c0e6168cb9cb" returned: 0 in 0.549s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:50 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-b8d9f4c3-819c-4684-8abd-f4642ea95511 tempest-GroupSnapshotsTest-894339262 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:55:50 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[495f506c-7d95-421d-878a-ccd852eea05c]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b8d9f4c3-819c-4684-8abd-f4642ea95511 tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:51 devstack sudo[96998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b Jul 30 16:55:51 devstack sudo[96998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:51 devstack sudo[96998]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b8d9f4c3-819c-4684-8abd-f4642ea95511 tempest-GroupSnapshotsTest-894339262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b" returned: 0 in 0.481s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b8d9f4c3-819c-4684-8abd-f4642ea95511 tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b.1e692df5-e1fe-41d0-b419-c0e6168cb9cb {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:51 devstack sudo[97008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b.1e692df5-e1fe-41d0-b419-c0e6168cb9cb Jul 30 16:55:51 devstack sudo[97008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:51 devstack sudo[97008]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b8d9f4c3-819c-4684-8abd-f4642ea95511 tempest-GroupSnapshotsTest-894339262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b.1e692df5-e1fe-41d0-b419-c0e6168cb9cb" returned: 0 in 0.400s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b8d9f4c3-819c-4684-8abd-f4642ea95511 tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b.1e692df5-e1fe-41d0-b419-c0e6168cb9cb {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:51 devstack sudo[97016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b.1e692df5-e1fe-41d0-b419-c0e6168cb9cb Jul 30 16:55:51 devstack sudo[97016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:52 devstack sudo[97016]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b8d9f4c3-819c-4684-8abd-f4642ea95511 tempest-GroupSnapshotsTest-894339262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b.1e692df5-e1fe-41d0-b419-c0e6168cb9cb" returned: 0 in 0.313s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:52 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b8d9f4c3-819c-4684-8abd-f4642ea95511 tempest-GroupSnapshotsTest-894339262 None] Lock "cinder-quobyte-1e692df5-e1fe-41d0-b419-c0e6168cb9cb" released by "_delete_snapshot" :: held 1.882s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:52 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b8d9f4c3-819c-4684-8abd-f4642ea95511 tempest-GroupSnapshotsTest-894339262 None] Lock "cinder-quobyte-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b" released by "delete_snapshot" :: held 1.914s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:52 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b8d9f4c3-819c-4684-8abd-f4642ea95511 tempest-GroupSnapshotsTest-894339262 None] Acquiring lock "cinder-quobyte-a91059a2-476b-4ab5-93cd-99d5a299d614" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:52 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b8d9f4c3-819c-4684-8abd-f4642ea95511 tempest-GroupSnapshotsTest-894339262 None] Lock "cinder-quobyte-a91059a2-476b-4ab5-93cd-99d5a299d614" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:52 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b8d9f4c3-819c-4684-8abd-f4642ea95511 tempest-GroupSnapshotsTest-894339262 None] Acquiring lock "cinder-quobyte-b6778d13-3d58-4ac8-82d8-362776a73322" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:52 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b8d9f4c3-819c-4684-8abd-f4642ea95511 tempest-GroupSnapshotsTest-894339262 None] Lock "cinder-quobyte-b6778d13-3d58-4ac8-82d8-362776a73322" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:52 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-b8d9f4c3-819c-4684-8abd-f4642ea95511 tempest-GroupSnapshotsTest-894339262 None] Deleting offline snapshot b6778d13-3d58-4ac8-82d8-362776a73322 of volume a91059a2-476b-4ab5-93cd-99d5a299d614 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:55:52 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-b8d9f4c3-819c-4684-8abd-f4642ea95511 tempest-GroupSnapshotsTest-894339262 None] snapshot_file for this snap is: volume-a91059a2-476b-4ab5-93cd-99d5a299d614.b6778d13-3d58-4ac8-82d8-362776a73322 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:55:52 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[de902170-ada0-4f99-bf87-f34a49a16b0f]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b8d9f4c3-819c-4684-8abd-f4642ea95511 tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a91059a2-476b-4ab5-93cd-99d5a299d614.b6778d13-3d58-4ac8-82d8-362776a73322 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:52 devstack sudo[97019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a91059a2-476b-4ab5-93cd-99d5a299d614.b6778d13-3d58-4ac8-82d8-362776a73322 Jul 30 16:55:52 devstack sudo[97019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:52 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9556ec1-57a8-4bf5-9f3e-aba8f6d8da04 tempest-AttachVolumeTestJSON-687994885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:55:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f9556ec1-57a8-4bf5-9f3e-aba8f6d8da04 tempest-AttachVolumeTestJSON-687994885 None] Flow 'volume_create_manager' (4ffa3722-9641-40a4-9cc4-8f4a90afe51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:55:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f9556ec1-57a8-4bf5-9f3e-aba8f6d8da04 tempest-AttachVolumeTestJSON-687994885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46b2d2f0-fd35-40c9-b57a-dee403495f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f9556ec1-57a8-4bf5-9f3e-aba8f6d8da04 tempest-AttachVolumeTestJSON-687994885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46b2d2f0-fd35-40c9-b57a-dee403495f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1534019961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7be431fa-65ec-4c16-beec-12e92b54be73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cde844a21fc42d6ac8b37b8c878e244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:55:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:55:52Z,use_quota=True,user_id='f546c4889e724be9b90ac2eb476d3a6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f9556ec1-57a8-4bf5-9f3e-aba8f6d8da04 tempest-AttachVolumeTestJSON-687994885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f777074-7f13-4b6e-bf1e-a465ee29a767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f9556ec1-57a8-4bf5-9f3e-aba8f6d8da04 tempest-AttachVolumeTestJSON-687994885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f777074-7f13-4b6e-bf1e-a465ee29a767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f9556ec1-57a8-4bf5-9f3e-aba8f6d8da04 tempest-AttachVolumeTestJSON-687994885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6369b7d-2319-4e7d-9845-4d2147ae899b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f9556ec1-57a8-4bf5-9f3e-aba8f6d8da04 tempest-AttachVolumeTestJSON-687994885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6369b7d-2319-4e7d-9845-4d2147ae899b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7be431fa-65ec-4c16-beec-12e92b54be73', 'volume_name': 'volume-7be431fa-65ec-4c16-beec-12e92b54be73', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f9556ec1-57a8-4bf5-9f3e-aba8f6d8da04 tempest-AttachVolumeTestJSON-687994885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70de3c7e-4995-441f-97ca-dd42d7e539cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f9556ec1-57a8-4bf5-9f3e-aba8f6d8da04 tempest-AttachVolumeTestJSON-687994885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70de3c7e-4995-441f-97ca-dd42d7e539cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f9556ec1-57a8-4bf5-9f3e-aba8f6d8da04 tempest-AttachVolumeTestJSON-687994885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75ddd1ab-92ba-4233-b74a-4294274b8a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:52 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-f9556ec1-57a8-4bf5-9f3e-aba8f6d8da04 tempest-AttachVolumeTestJSON-687994885 None] Volume 7be431fa-65ec-4c16-beec-12e92b54be73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7be431fa-65ec-4c16-beec-12e92b54be73', 'volume_size': 1} Jul 30 16:55:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f9556ec1-57a8-4bf5-9f3e-aba8f6d8da04 tempest-AttachVolumeTestJSON-687994885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f9556ec1-57a8-4bf5-9f3e-aba8f6d8da04 tempest-AttachVolumeTestJSON-687994885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:52 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f9556ec1-57a8-4bf5-9f3e-aba8f6d8da04 tempest-AttachVolumeTestJSON-687994885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1534019961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7be431fa-65ec-4c16-beec-12e92b54be73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cde844a21fc42d6ac8b37b8c878e244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:55:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:55:52Z,use_quota=True,user_id='f546c4889e724be9b90ac2eb476d3a6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:55:52 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-f9556ec1-57a8-4bf5-9f3e-aba8f6d8da04 tempest-AttachVolumeTestJSON-687994885 None] Creating volume 7be431fa-65ec-4c16-beec-12e92b54be73 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:55:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f9556ec1-57a8-4bf5-9f3e-aba8f6d8da04 tempest-AttachVolumeTestJSON-687994885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f9556ec1-57a8-4bf5-9f3e-aba8f6d8da04 tempest-AttachVolumeTestJSON-687994885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:52 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f9556ec1-57a8-4bf5-9f3e-aba8f6d8da04 tempest-AttachVolumeTestJSON-687994885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:55:52 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f9556ec1-57a8-4bf5-9f3e-aba8f6d8da04 tempest-AttachVolumeTestJSON-687994885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:55:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f9556ec1-57a8-4bf5-9f3e-aba8f6d8da04 tempest-AttachVolumeTestJSON-687994885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:52 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f9556ec1-57a8-4bf5-9f3e-aba8f6d8da04 tempest-AttachVolumeTestJSON-687994885 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:55:52 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-f9556ec1-57a8-4bf5-9f3e-aba8f6d8da04 tempest-AttachVolumeTestJSON-687994885 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:55:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f9556ec1-57a8-4bf5-9f3e-aba8f6d8da04 tempest-AttachVolumeTestJSON-687994885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-7be431fa-65ec-4c16-beec-12e92b54be73 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:52 devstack sudo[97021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-7be431fa-65ec-4c16-beec-12e92b54be73 1073741824 Jul 30 16:55:52 devstack sudo[97021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:52 devstack sudo[97019]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b8d9f4c3-819c-4684-8abd-f4642ea95511 tempest-GroupSnapshotsTest-894339262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a91059a2-476b-4ab5-93cd-99d5a299d614.b6778d13-3d58-4ac8-82d8-362776a73322" returned: 0 in 0.450s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:52 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-b8d9f4c3-819c-4684-8abd-f4642ea95511 tempest-GroupSnapshotsTest-894339262 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a91059a2-476b-4ab5-93cd-99d5a299d614(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:55:52 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9131eb-987f-4c04-a873-9b242eac8166]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b8d9f4c3-819c-4684-8abd-f4642ea95511 tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a91059a2-476b-4ab5-93cd-99d5a299d614 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:52 devstack sudo[97027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a91059a2-476b-4ab5-93cd-99d5a299d614 Jul 30 16:55:52 devstack sudo[97027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:53 devstack sudo[97021]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f9556ec1-57a8-4bf5-9f3e-aba8f6d8da04 tempest-AttachVolumeTestJSON-687994885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-7be431fa-65ec-4c16-beec-12e92b54be73 1073741824" returned: 0 in 0.531s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f9556ec1-57a8-4bf5-9f3e-aba8f6d8da04 tempest-AttachVolumeTestJSON-687994885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-7be431fa-65ec-4c16-beec-12e92b54be73 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:53 devstack sudo[97035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-7be431fa-65ec-4c16-beec-12e92b54be73 Jul 30 16:55:53 devstack sudo[97035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:53 devstack sudo[97027]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b8d9f4c3-819c-4684-8abd-f4642ea95511 tempest-GroupSnapshotsTest-894339262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a91059a2-476b-4ab5-93cd-99d5a299d614" returned: 0 in 0.442s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b8d9f4c3-819c-4684-8abd-f4642ea95511 tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a91059a2-476b-4ab5-93cd-99d5a299d614.b6778d13-3d58-4ac8-82d8-362776a73322 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:53 devstack sudo[97038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a91059a2-476b-4ab5-93cd-99d5a299d614.b6778d13-3d58-4ac8-82d8-362776a73322 Jul 30 16:55:53 devstack sudo[97038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:53 devstack sudo[97035]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f9556ec1-57a8-4bf5-9f3e-aba8f6d8da04 tempest-AttachVolumeTestJSON-687994885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-7be431fa-65ec-4c16-beec-12e92b54be73" returned: 0 in 0.262s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:53 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f9556ec1-57a8-4bf5-9f3e-aba8f6d8da04 tempest-AttachVolumeTestJSON-687994885 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:55:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f9556ec1-57a8-4bf5-9f3e-aba8f6d8da04 tempest-AttachVolumeTestJSON-687994885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:53 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f9556ec1-57a8-4bf5-9f3e-aba8f6d8da04 tempest-AttachVolumeTestJSON-687994885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75ddd1ab-92ba-4233-b74a-4294274b8a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7be431fa-65ec-4c16-beec-12e92b54be73', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:53 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f9556ec1-57a8-4bf5-9f3e-aba8f6d8da04 tempest-AttachVolumeTestJSON-687994885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a26e8bff-936c-445c-93fb-b79e5abfa78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:53 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-f9556ec1-57a8-4bf5-9f3e-aba8f6d8da04 tempest-AttachVolumeTestJSON-687994885 None] Volume volume-7be431fa-65ec-4c16-beec-12e92b54be73 (7be431fa-65ec-4c16-beec-12e92b54be73): created successfully Jul 30 16:55:53 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f9556ec1-57a8-4bf5-9f3e-aba8f6d8da04 tempest-AttachVolumeTestJSON-687994885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a26e8bff-936c-445c-93fb-b79e5abfa78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:53 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f9556ec1-57a8-4bf5-9f3e-aba8f6d8da04 tempest-AttachVolumeTestJSON-687994885 None] Flow 'volume_create_manager' (4ffa3722-9641-40a4-9cc4-8f4a90afe51b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:55:53 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-f9556ec1-57a8-4bf5-9f3e-aba8f6d8da04 tempest-AttachVolumeTestJSON-687994885 None] Created volume successfully. Jul 30 16:55:53 devstack sudo[97038]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b8d9f4c3-819c-4684-8abd-f4642ea95511 tempest-GroupSnapshotsTest-894339262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a91059a2-476b-4ab5-93cd-99d5a299d614.b6778d13-3d58-4ac8-82d8-362776a73322" returned: 0 in 0.404s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b8d9f4c3-819c-4684-8abd-f4642ea95511 tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a91059a2-476b-4ab5-93cd-99d5a299d614.b6778d13-3d58-4ac8-82d8-362776a73322 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:53 devstack sudo[97044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a91059a2-476b-4ab5-93cd-99d5a299d614.b6778d13-3d58-4ac8-82d8-362776a73322 Jul 30 16:55:53 devstack sudo[97044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:53 devstack sudo[97044]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b8d9f4c3-819c-4684-8abd-f4642ea95511 tempest-GroupSnapshotsTest-894339262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a91059a2-476b-4ab5-93cd-99d5a299d614.b6778d13-3d58-4ac8-82d8-362776a73322" returned: 0 in 0.273s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:53 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b8d9f4c3-819c-4684-8abd-f4642ea95511 tempest-GroupSnapshotsTest-894339262 None] Lock "cinder-quobyte-b6778d13-3d58-4ac8-82d8-362776a73322" released by "_delete_snapshot" :: held 1.707s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:53 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b8d9f4c3-819c-4684-8abd-f4642ea95511 tempest-GroupSnapshotsTest-894339262 None] Lock "cinder-quobyte-a91059a2-476b-4ab5-93cd-99d5a299d614" released by "delete_snapshot" :: held 1.738s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:53 devstack cinder-volume[88591]: WARNING cinder.quota [None req-b8d9f4c3-819c-4684-8abd-f4642ea95511 tempest-GroupSnapshotsTest-894339262 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1164092271 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1164092271, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:55:53 devstack cinder-volume[88591]: WARNING cinder.quota [None req-b8d9f4c3-819c-4684-8abd-f4642ea95511 tempest-GroupSnapshotsTest-894339262 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1164092271 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1164092271, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:55:54 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-b8d9f4c3-819c-4684-8abd-f4642ea95511 tempest-GroupSnapshotsTest-894339262 None] Created reservations ['e543cfa3-9877-4a0e-99cd-7ecd31d27fc1', '8b3c2e0a-f60f-4245-b6c0-aac65287bf6e', 'c023960e-7d26-46d2-bcf6-428b605dc00b', '9236244f-e392-4fd1-9d14-1cce3d1d66c2'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:55:54 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-b8d9f4c3-819c-4684-8abd-f4642ea95511 tempest-GroupSnapshotsTest-894339262 None] Created reservations ['db64353e-4fc2-4b5f-b982-26eff5603f37', 'a7235412-6029-4c19-814e-dc8e707d1ec4', '27c50139-e47d-40c3-98e4-1a852af9a4ca', '27409081-53a2-452b-ba3e-c5db77de3f1c'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:55:54 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-b8d9f4c3-819c-4684-8abd-f4642ea95511 tempest-GroupSnapshotsTest-894339262 None] group_snapshot f5b46309-edab-43c1-9458-0b25b4fca60c: deleted successfully Jul 30 16:55:55 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ee154908-3717-4fa2-9be3-7bd80f456eca tempest-GroupSnapshotsTest-894339262 None] Acquiring lock "cinder-quobyte-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-6140e7ce-c3a8-42fd-aa30-bd8121f72968 req-9957c4c3-4a95-4d0c-9da4-a85b40b8905d tempest-AttachVolumeTestJSON-687994885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-6140e7ce-c3a8-42fd-aa30-bd8121f72968 req-9957c4c3-4a95-4d0c-9da4-a85b40b8905d tempest-AttachVolumeTestJSON-687994885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:55 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ee154908-3717-4fa2-9be3-7bd80f456eca tempest-GroupSnapshotsTest-894339262 None] Lock "cinder-quobyte-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b" acquired by "delete_volume" :: waited 0.029s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-6140e7ce-c3a8-42fd-aa30-bd8121f72968 req-9957c4c3-4a95-4d0c-9da4-a85b40b8905d tempest-AttachVolumeTestJSON-687994885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.055s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:55 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[75917ba0-6cd4-40b6-bc76-121941908a46]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ee154908-3717-4fa2-9be3-7bd80f456eca tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:55 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-6140e7ce-c3a8-42fd-aa30-bd8121f72968 req-9957c4c3-4a95-4d0c-9da4-a85b40b8905d tempest-AttachVolumeTestJSON-687994885 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202', 'name': 'volume-7be431fa-65ec-4c16-beec-12e92b54be73', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3aa00d06-efaa-400e-8a39-ab3bf3ea71d4', 'enforce_multipath': True} {{(pid=88591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:55:55 devstack cinder-volume[88591]: INFO cinder.volume.manager [req-6140e7ce-c3a8-42fd-aa30-bd8121f72968 req-9957c4c3-4a95-4d0c-9da4-a85b40b8905d tempest-AttachVolumeTestJSON-687994885 None] attachment_update completed successfully. Jul 30 16:55:55 devstack sudo[97060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b Jul 30 16:55:55 devstack sudo[97060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:55 devstack sudo[97060]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ee154908-3717-4fa2-9be3-7bd80f456eca tempest-GroupSnapshotsTest-894339262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b" returned: 0 in 0.413s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ee154908-3717-4fa2-9be3-7bd80f456eca tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:55 devstack sudo[97069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b Jul 30 16:55:55 devstack sudo[97069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:56 devstack sudo[97069]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ee154908-3717-4fa2-9be3-7bd80f456eca tempest-GroupSnapshotsTest-894339262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b" returned: 0 in 0.352s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:56 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ee154908-3717-4fa2-9be3-7bd80f456eca tempest-GroupSnapshotsTest-894339262 None] Lock "cinder-quobyte-a470cb3d-aeef-4b12-9b0b-192d3bf8a57b" released by "delete_volume" :: held 0.852s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:56 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ee154908-3717-4fa2-9be3-7bd80f456eca tempest-GroupSnapshotsTest-894339262 None] Acquiring lock "cinder-quobyte-a91059a2-476b-4ab5-93cd-99d5a299d614" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:56 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ee154908-3717-4fa2-9be3-7bd80f456eca tempest-GroupSnapshotsTest-894339262 None] Lock "cinder-quobyte-a91059a2-476b-4ab5-93cd-99d5a299d614" acquired by "delete_volume" :: waited 0.021s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:56 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[59861cfd-bc02-4df3-b74f-49a8277ca913]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ee154908-3717-4fa2-9be3-7bd80f456eca tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a91059a2-476b-4ab5-93cd-99d5a299d614 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:56 devstack sudo[97073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a91059a2-476b-4ab5-93cd-99d5a299d614 Jul 30 16:55:56 devstack sudo[97073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:56 devstack sudo[97073]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ee154908-3717-4fa2-9be3-7bd80f456eca tempest-GroupSnapshotsTest-894339262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a91059a2-476b-4ab5-93cd-99d5a299d614" returned: 0 in 0.485s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ee154908-3717-4fa2-9be3-7bd80f456eca tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a91059a2-476b-4ab5-93cd-99d5a299d614 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:56 devstack sudo[97078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a91059a2-476b-4ab5-93cd-99d5a299d614 Jul 30 16:55:56 devstack sudo[97078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:57 devstack sudo[97078]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ee154908-3717-4fa2-9be3-7bd80f456eca tempest-GroupSnapshotsTest-894339262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a91059a2-476b-4ab5-93cd-99d5a299d614" returned: 0 in 0.329s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:57 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ee154908-3717-4fa2-9be3-7bd80f456eca tempest-GroupSnapshotsTest-894339262 None] Lock "cinder-quobyte-a91059a2-476b-4ab5-93cd-99d5a299d614" released by "delete_volume" :: held 0.893s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:57 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-ee154908-3717-4fa2-9be3-7bd80f456eca tempest-GroupSnapshotsTest-894339262 None] Created reservations ['c2f4bbf6-6ad0-465c-998c-18def68b7954'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:55:57 devstack cinder-volume[88591]: WARNING cinder.quota [None req-ee154908-3717-4fa2-9be3-7bd80f456eca tempest-GroupSnapshotsTest-894339262 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1164092271 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1164092271, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:55:57 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-ee154908-3717-4fa2-9be3-7bd80f456eca tempest-GroupSnapshotsTest-894339262 None] Created reservations ['004c3c33-8f2d-46ef-ba45-3738470053ec', '9092bfa1-1134-4288-973f-577a61a66e1e', 'c99f753d-6b4a-43fa-8fea-c7bb575a53bf', '1bad18eb-f51d-4e41-9679-e850acadd5a3'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:55:57 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-ee154908-3717-4fa2-9be3-7bd80f456eca tempest-GroupSnapshotsTest-894339262 None] Created reservations ['cd35d9fe-bb73-43ff-915d-89f88c18800e', '205f7a56-8d87-4ac8-b832-0fb4e86cf173', '135d2961-7a1c-4672-88f8-4672d61592da', '3ac72e74-214f-4955-ae36-49e1d7a97e95'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:55:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ee154908-3717-4fa2-9be3-7bd80f456eca tempest-GroupSnapshotsTest-894339262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ee154908-3717-4fa2-9be3-7bd80f456eca tempest-GroupSnapshotsTest-894339262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:57 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ee154908-3717-4fa2-9be3-7bd80f456eca tempest-GroupSnapshotsTest-894339262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:55:57 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ee154908-3717-4fa2-9be3-7bd80f456eca tempest-GroupSnapshotsTest-894339262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:55:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ee154908-3717-4fa2-9be3-7bd80f456eca tempest-GroupSnapshotsTest-894339262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ee154908-3717-4fa2-9be3-7bd80f456eca tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:57 devstack sudo[97082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:55:57 devstack sudo[97082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:58 devstack sudo[97082]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ee154908-3717-4fa2-9be3-7bd80f456eca tempest-GroupSnapshotsTest-894339262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.492s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:58 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-ee154908-3717-4fa2-9be3-7bd80f456eca tempest-GroupSnapshotsTest-894339262 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:55:58 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-ee154908-3717-4fa2-9be3-7bd80f456eca tempest-GroupSnapshotsTest-894339262 None] Delete group completed successfully. Jul 30 16:55:58 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-8a19d7c7-5baa-4d0d-9ed2-4975902ca500 tempest-GroupSnapshotsTest-894339262 None] Group tempest-GroupSnapshotsTest-Group-138464946: creating Jul 30 16:55:58 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-8a19d7c7-5baa-4d0d-9ed2-4975902ca500 tempest-GroupSnapshotsTest-894339262 None] Group tempest-GroupSnapshotsTest-Group-138464946: created successfully Jul 30 16:55:58 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-8a19d7c7-5baa-4d0d-9ed2-4975902ca500 tempest-GroupSnapshotsTest-894339262 None] Create group completed successfully. Jul 30 16:56:00 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac5516e9-cece-414c-8627-43d883ac5573 tempest-GroupSnapshotsTest-894339262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:56:00 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ac5516e9-cece-414c-8627-43d883ac5573 tempest-GroupSnapshotsTest-894339262 None] Flow 'volume_create_manager' (e175711e-8818-4b66-9dde-ddad696e065d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:56:00 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ac5516e9-cece-414c-8627-43d883ac5573 tempest-GroupSnapshotsTest-894339262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a3c97e4-3032-4f16-b59b-bee52a27a98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:00 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ac5516e9-cece-414c-8627-43d883ac5573 tempest-GroupSnapshotsTest-894339262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a3c97e4-3032-4f16-b59b-bee52a27a98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:56:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1422599456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5e0be672-bfa8-490f-88ad-ab5f549ab90d,host='devstack@QuobyteHD#QuobyteHD',id=a3ff6690-73c3-4572-a33d-25d19ca5e85e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83a0d1d09329442397d9fb171d5d9bf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:56:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:56:00Z,use_quota=True,user_id='b2dffab8703341f598abb31c84441738',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c18dbcb-4ca1-41bc-8cf0-1a16a0caad79),volume_type_id=0c18dbcb-4ca1-41bc-8cf0-1a16a0caad79)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:00 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ac5516e9-cece-414c-8627-43d883ac5573 tempest-GroupSnapshotsTest-894339262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98628f3f-0360-4ecc-b86a-e8e189f14418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:00 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ac5516e9-cece-414c-8627-43d883ac5573 tempest-GroupSnapshotsTest-894339262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98628f3f-0360-4ecc-b86a-e8e189f14418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:00 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ac5516e9-cece-414c-8627-43d883ac5573 tempest-GroupSnapshotsTest-894339262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5f9998b-77b4-413c-9cca-987bf5ee68f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:00 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ac5516e9-cece-414c-8627-43d883ac5573 tempest-GroupSnapshotsTest-894339262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5f9998b-77b4-413c-9cca-987bf5ee68f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3ff6690-73c3-4572-a33d-25d19ca5e85e', 'volume_name': 'volume-a3ff6690-73c3-4572-a33d-25d19ca5e85e', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:00 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ac5516e9-cece-414c-8627-43d883ac5573 tempest-GroupSnapshotsTest-894339262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (029856d7-4201-43cc-a102-45044a9dd10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:00 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ac5516e9-cece-414c-8627-43d883ac5573 tempest-GroupSnapshotsTest-894339262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (029856d7-4201-43cc-a102-45044a9dd10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:00 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ac5516e9-cece-414c-8627-43d883ac5573 tempest-GroupSnapshotsTest-894339262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce923232-e9f2-4753-8e52-c0160db58ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:00 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-ac5516e9-cece-414c-8627-43d883ac5573 tempest-GroupSnapshotsTest-894339262 None] Volume a3ff6690-73c3-4572-a33d-25d19ca5e85e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3ff6690-73c3-4572-a33d-25d19ca5e85e', 'volume_size': 1} Jul 30 16:56:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ac5516e9-cece-414c-8627-43d883ac5573 tempest-GroupSnapshotsTest-894339262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ac5516e9-cece-414c-8627-43d883ac5573 tempest-GroupSnapshotsTest-894339262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:00 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ac5516e9-cece-414c-8627-43d883ac5573 tempest-GroupSnapshotsTest-894339262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5e0be672-bfa8-490f-88ad-ab5f549ab90d,created_at=2026-07-30T14:56:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1422599456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5e0be672-bfa8-490f-88ad-ab5f549ab90d,host='devstack@QuobyteHD#QuobyteHD',id=a3ff6690-73c3-4572-a33d-25d19ca5e85e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83a0d1d09329442397d9fb171d5d9bf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:56:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:56:00Z,use_quota=True,user_id='b2dffab8703341f598abb31c84441738',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c18dbcb-4ca1-41bc-8cf0-1a16a0caad79),volume_type_id=0c18dbcb-4ca1-41bc-8cf0-1a16a0caad79)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:56:00 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-ac5516e9-cece-414c-8627-43d883ac5573 tempest-GroupSnapshotsTest-894339262 None] Creating volume a3ff6690-73c3-4572-a33d-25d19ca5e85e {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:56:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ac5516e9-cece-414c-8627-43d883ac5573 tempest-GroupSnapshotsTest-894339262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ac5516e9-cece-414c-8627-43d883ac5573 tempest-GroupSnapshotsTest-894339262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:00 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ac5516e9-cece-414c-8627-43d883ac5573 tempest-GroupSnapshotsTest-894339262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:56:00 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ac5516e9-cece-414c-8627-43d883ac5573 tempest-GroupSnapshotsTest-894339262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:56:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ac5516e9-cece-414c-8627-43d883ac5573 tempest-GroupSnapshotsTest-894339262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:00 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ac5516e9-cece-414c-8627-43d883ac5573 tempest-GroupSnapshotsTest-894339262 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:56:00 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-ac5516e9-cece-414c-8627-43d883ac5573 tempest-GroupSnapshotsTest-894339262 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:56:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ac5516e9-cece-414c-8627-43d883ac5573 tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a3ff6690-73c3-4572-a33d-25d19ca5e85e 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:00 devstack sudo[97099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a3ff6690-73c3-4572-a33d-25d19ca5e85e 1073741824 Jul 30 16:56:00 devstack sudo[97099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:01 devstack sudo[97099]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ac5516e9-cece-414c-8627-43d883ac5573 tempest-GroupSnapshotsTest-894339262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a3ff6690-73c3-4572-a33d-25d19ca5e85e 1073741824" returned: 0 in 0.637s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ac5516e9-cece-414c-8627-43d883ac5573 tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a3ff6690-73c3-4572-a33d-25d19ca5e85e {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:01 devstack sudo[97106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a3ff6690-73c3-4572-a33d-25d19ca5e85e Jul 30 16:56:01 devstack sudo[97106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:01 devstack sudo[97106]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ac5516e9-cece-414c-8627-43d883ac5573 tempest-GroupSnapshotsTest-894339262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a3ff6690-73c3-4572-a33d-25d19ca5e85e" returned: 0 in 0.330s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:01 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ac5516e9-cece-414c-8627-43d883ac5573 tempest-GroupSnapshotsTest-894339262 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:56:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ac5516e9-cece-414c-8627-43d883ac5573 tempest-GroupSnapshotsTest-894339262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ac5516e9-cece-414c-8627-43d883ac5573 tempest-GroupSnapshotsTest-894339262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce923232-e9f2-4753-8e52-c0160db58ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3ff6690-73c3-4572-a33d-25d19ca5e85e', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ac5516e9-cece-414c-8627-43d883ac5573 tempest-GroupSnapshotsTest-894339262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdf63d36-0fc3-4e60-9b43-832ee52c1724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:01 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-ac5516e9-cece-414c-8627-43d883ac5573 tempest-GroupSnapshotsTest-894339262 None] Volume volume-a3ff6690-73c3-4572-a33d-25d19ca5e85e (a3ff6690-73c3-4572-a33d-25d19ca5e85e): created successfully Jul 30 16:56:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ac5516e9-cece-414c-8627-43d883ac5573 tempest-GroupSnapshotsTest-894339262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdf63d36-0fc3-4e60-9b43-832ee52c1724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ac5516e9-cece-414c-8627-43d883ac5573 tempest-GroupSnapshotsTest-894339262 None] Flow 'volume_create_manager' (e175711e-8818-4b66-9dde-ddad696e065d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:56:01 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-ac5516e9-cece-414c-8627-43d883ac5573 tempest-GroupSnapshotsTest-894339262 None] Created volume successfully. Jul 30 16:56:02 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-08bf6f36-7bad-4255-8940-7904694b2ecb tempest-GroupSnapshotsTest-894339262 None] GroupSnapshot 67dbe97e-1bc6-4b71-a636-8b4471f828b9: creating. Jul 30 16:56:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-08bf6f36-7bad-4255-8940-7904694b2ecb tempest-GroupSnapshotsTest-894339262 None] Group snapshot 67dbe97e-1bc6-4b71-a636-8b4471f828b9: creating. {{(pid=88591) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 30 16:56:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-08bf6f36-7bad-4255-8940-7904694b2ecb tempest-GroupSnapshotsTest-894339262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-08bf6f36-7bad-4255-8940-7904694b2ecb tempest-GroupSnapshotsTest-894339262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:02 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-08bf6f36-7bad-4255-8940-7904694b2ecb tempest-GroupSnapshotsTest-894339262 None] Creating offline snapshot 1d090606-1111-4fdb-867f-4af7b15ccf76 of volume a3ff6690-73c3-4572-a33d-25d19ca5e85e {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:56:02 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[da82face-cb93-45eb-8c68-7356e77a5ecb]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:56:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-08bf6f36-7bad-4255-8940-7904694b2ecb tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a3ff6690-73c3-4572-a33d-25d19ca5e85e {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:02 devstack sudo[97111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a3ff6690-73c3-4572-a33d-25d19ca5e85e Jul 30 16:56:02 devstack sudo[97111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:02 devstack sudo[97111]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-08bf6f36-7bad-4255-8940-7904694b2ecb tempest-GroupSnapshotsTest-894339262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a3ff6690-73c3-4572-a33d-25d19ca5e85e" returned: 0 in 0.652s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-08bf6f36-7bad-4255-8940-7904694b2ecb tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a3ff6690-73c3-4572-a33d-25d19ca5e85e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a3ff6690-73c3-4572-a33d-25d19ca5e85e.1d090606-1111-4fdb-867f-4af7b15ccf76 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:02 devstack sudo[97134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a3ff6690-73c3-4572-a33d-25d19ca5e85e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a3ff6690-73c3-4572-a33d-25d19ca5e85e.1d090606-1111-4fdb-867f-4af7b15ccf76 1G Jul 30 16:56:02 devstack sudo[97134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:03 devstack sudo[97134]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-08bf6f36-7bad-4255-8940-7904694b2ecb tempest-GroupSnapshotsTest-894339262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a3ff6690-73c3-4572-a33d-25d19ca5e85e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a3ff6690-73c3-4572-a33d-25d19ca5e85e.1d090606-1111-4fdb-867f-4af7b15ccf76 1G" returned: 0 in 0.723s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-08bf6f36-7bad-4255-8940-7904694b2ecb tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3ff6690-73c3-4572-a33d-25d19ca5e85e -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a3ff6690-73c3-4572-a33d-25d19ca5e85e.1d090606-1111-4fdb-867f-4af7b15ccf76 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:03 devstack sudo[97157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3ff6690-73c3-4572-a33d-25d19ca5e85e -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a3ff6690-73c3-4572-a33d-25d19ca5e85e.1d090606-1111-4fdb-867f-4af7b15ccf76 Jul 30 16:56:03 devstack sudo[97157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:04 devstack sudo[97157]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-08bf6f36-7bad-4255-8940-7904694b2ecb tempest-GroupSnapshotsTest-894339262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3ff6690-73c3-4572-a33d-25d19ca5e85e -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a3ff6690-73c3-4572-a33d-25d19ca5e85e.1d090606-1111-4fdb-867f-4af7b15ccf76" returned: 0 in 0.608s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:04 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-08bf6f36-7bad-4255-8940-7904694b2ecb tempest-GroupSnapshotsTest-894339262 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a3ff6690-73c3-4572-a33d-25d19ca5e85e.1d090606-1111-4fdb-867f-4af7b15ccf76 is being set with open permissions: ugo+rw: NotImplementedError Jul 30 16:56:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-08bf6f36-7bad-4255-8940-7904694b2ecb tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a3ff6690-73c3-4572-a33d-25d19ca5e85e.1d090606-1111-4fdb-867f-4af7b15ccf76 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:04 devstack sudo[97202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a3ff6690-73c3-4572-a33d-25d19ca5e85e.1d090606-1111-4fdb-867f-4af7b15ccf76 Jul 30 16:56:04 devstack sudo[97202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:04 devstack sudo[97202]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-08bf6f36-7bad-4255-8940-7904694b2ecb tempest-GroupSnapshotsTest-894339262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a3ff6690-73c3-4572-a33d-25d19ca5e85e.1d090606-1111-4fdb-867f-4af7b15ccf76" returned: 0 in 0.487s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-08bf6f36-7bad-4255-8940-7904694b2ecb tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a3ff6690-73c3-4572-a33d-25d19ca5e85e.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:04 devstack sudo[97219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a3ff6690-73c3-4572-a33d-25d19ca5e85e.info Jul 30 16:56:04 devstack sudo[97219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:05 devstack sudo[97219]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-08bf6f36-7bad-4255-8940-7904694b2ecb tempest-GroupSnapshotsTest-894339262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a3ff6690-73c3-4572-a33d-25d19ca5e85e.info" returned: 0 in 0.340s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:05 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-08bf6f36-7bad-4255-8940-7904694b2ecb tempest-GroupSnapshotsTest-894339262 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a3ff6690-73c3-4572-a33d-25d19ca5e85e.info is being set with open permissions: ugo+rw: NotImplementedError Jul 30 16:56:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-08bf6f36-7bad-4255-8940-7904694b2ecb tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a3ff6690-73c3-4572-a33d-25d19ca5e85e.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:05 devstack sudo[97236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a3ff6690-73c3-4572-a33d-25d19ca5e85e.info Jul 30 16:56:05 devstack sudo[97236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:05 devstack cinder-volume[88591]: INFO cinder.volume.manager [req-eb4354a0-2beb-470f-a116-48b6ec0605fd req-cb4da46d-bf91-4ba6-93e7-06c4753850b9 tempest-TestMinimumBasicScenario-417990955 None] Terminate volume connection completed successfully. Jul 30 16:56:05 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-eb4354a0-2beb-470f-a116-48b6ec0605fd req-cb4da46d-bf91-4ba6-93e7-06c4753850b9 tempest-TestMinimumBasicScenario-417990955 None] Deleting attachment 425c579b-1563-4d72-b29a-ddcea7370561. {{(pid=88591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:56:05 devstack sudo[97236]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-08bf6f36-7bad-4255-8940-7904694b2ecb tempest-GroupSnapshotsTest-894339262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a3ff6690-73c3-4572-a33d-25d19ca5e85e.info" returned: 0 in 0.318s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-08bf6f36-7bad-4255-8940-7904694b2ecb tempest-GroupSnapshotsTest-894339262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.296s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:05 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-08bf6f36-7bad-4255-8940-7904694b2ecb tempest-GroupSnapshotsTest-894339262 None] group_snapshot 67dbe97e-1bc6-4b71-a636-8b4471f828b9: created successfully Jul 30 16:56:05 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-08bcde75-6704-41e5-932c-5d30206f1fd0 tempest-TestMinimumBasicScenario-417990955 None] Acquiring lock "cinder-10691e0c-c37e-4528-a994-778eae5e9c99-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:56:05 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-08bcde75-6704-41e5-932c-5d30206f1fd0 tempest-TestMinimumBasicScenario-417990955 None] Lock "cinder-10691e0c-c37e-4528-a994-778eae5e9c99-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:56:05 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-08bcde75-6704-41e5-932c-5d30206f1fd0 tempest-TestMinimumBasicScenario-417990955 None] Acquiring lock "cinder-quobyte-10691e0c-c37e-4528-a994-778eae5e9c99" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:56:05 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-08bcde75-6704-41e5-932c-5d30206f1fd0 tempest-TestMinimumBasicScenario-417990955 None] Lock "cinder-quobyte-10691e0c-c37e-4528-a994-778eae5e9c99" acquired by "delete_volume" :: waited 0.022s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:56:06 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a884159-d059-4bf1-9e29-9526240e3d53]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:56:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-08bcde75-6704-41e5-932c-5d30206f1fd0 tempest-TestMinimumBasicScenario-417990955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-10691e0c-c37e-4528-a994-778eae5e9c99 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:06 devstack sudo[97259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-10691e0c-c37e-4528-a994-778eae5e9c99 Jul 30 16:56:06 devstack sudo[97259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:06 devstack sudo[97259]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-08bcde75-6704-41e5-932c-5d30206f1fd0 tempest-TestMinimumBasicScenario-417990955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-10691e0c-c37e-4528-a994-778eae5e9c99" returned: 0 in 0.545s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-08bcde75-6704-41e5-932c-5d30206f1fd0 tempest-TestMinimumBasicScenario-417990955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-10691e0c-c37e-4528-a994-778eae5e9c99 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:06 devstack sudo[97265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-10691e0c-c37e-4528-a994-778eae5e9c99 Jul 30 16:56:06 devstack sudo[97265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:06 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-56246540-f999-4540-a27a-22f036a6ed70 tempest-GroupSnapshotsTest-894339262 None] group_snapshot 67dbe97e-1bc6-4b71-a636-8b4471f828b9: deleting Jul 30 16:56:06 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-56246540-f999-4540-a27a-22f036a6ed70 tempest-GroupSnapshotsTest-894339262 None] group_snapshot 67dbe97e-1bc6-4b71-a636-8b4471f828b9: deleting {{(pid=88591) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 30 16:56:06 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-56246540-f999-4540-a27a-22f036a6ed70 tempest-GroupSnapshotsTest-894339262 None] Acquiring lock "cinder-quobyte-a3ff6690-73c3-4572-a33d-25d19ca5e85e" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:56:06 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-56246540-f999-4540-a27a-22f036a6ed70 tempest-GroupSnapshotsTest-894339262 None] Lock "cinder-quobyte-a3ff6690-73c3-4572-a33d-25d19ca5e85e" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:56:06 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-56246540-f999-4540-a27a-22f036a6ed70 tempest-GroupSnapshotsTest-894339262 None] Acquiring lock "cinder-quobyte-1d090606-1111-4fdb-867f-4af7b15ccf76" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:56:06 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-56246540-f999-4540-a27a-22f036a6ed70 tempest-GroupSnapshotsTest-894339262 None] Lock "cinder-quobyte-1d090606-1111-4fdb-867f-4af7b15ccf76" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:56:06 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-56246540-f999-4540-a27a-22f036a6ed70 tempest-GroupSnapshotsTest-894339262 None] Deleting offline snapshot 1d090606-1111-4fdb-867f-4af7b15ccf76 of volume a3ff6690-73c3-4572-a33d-25d19ca5e85e {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:56:06 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-56246540-f999-4540-a27a-22f036a6ed70 tempest-GroupSnapshotsTest-894339262 None] snapshot_file for this snap is: volume-a3ff6690-73c3-4572-a33d-25d19ca5e85e.1d090606-1111-4fdb-867f-4af7b15ccf76 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:56:06 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f67d1a-6f5e-470c-91ca-74e82bc65102]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:56:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-56246540-f999-4540-a27a-22f036a6ed70 tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a3ff6690-73c3-4572-a33d-25d19ca5e85e.1d090606-1111-4fdb-867f-4af7b15ccf76 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:06 devstack sudo[97265]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-08bcde75-6704-41e5-932c-5d30206f1fd0 tempest-TestMinimumBasicScenario-417990955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-10691e0c-c37e-4528-a994-778eae5e9c99" returned: 0 in 0.410s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:07 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-08bcde75-6704-41e5-932c-5d30206f1fd0 tempest-TestMinimumBasicScenario-417990955 None] Lock "cinder-quobyte-10691e0c-c37e-4528-a994-778eae5e9c99" released by "delete_volume" :: held 1.051s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:56:07 devstack sudo[97268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a3ff6690-73c3-4572-a33d-25d19ca5e85e.1d090606-1111-4fdb-867f-4af7b15ccf76 Jul 30 16:56:07 devstack sudo[97268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:07 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-08bcde75-6704-41e5-932c-5d30206f1fd0 tempest-TestMinimumBasicScenario-417990955 None] Created reservations ['91accb99-7e40-43ae-9de1-cb381d7edbf3', '49ca8df4-53f7-4c7a-95a1-ebf9185de807', '3d9181eb-ce4f-4b71-949d-7f3df8be8a3d', 'f4ba8b4b-2c27-4918-bb52-fdcedc3a1147'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:56:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-08bcde75-6704-41e5-932c-5d30206f1fd0 tempest-TestMinimumBasicScenario-417990955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-08bcde75-6704-41e5-932c-5d30206f1fd0 tempest-TestMinimumBasicScenario-417990955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:07 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-08bcde75-6704-41e5-932c-5d30206f1fd0 tempest-TestMinimumBasicScenario-417990955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:56:07 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-08bcde75-6704-41e5-932c-5d30206f1fd0 tempest-TestMinimumBasicScenario-417990955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:56:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-08bcde75-6704-41e5-932c-5d30206f1fd0 tempest-TestMinimumBasicScenario-417990955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-08bcde75-6704-41e5-932c-5d30206f1fd0 tempest-TestMinimumBasicScenario-417990955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:07 devstack sudo[97275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:56:07 devstack sudo[97275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:07 devstack sudo[97268]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-56246540-f999-4540-a27a-22f036a6ed70 tempest-GroupSnapshotsTest-894339262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a3ff6690-73c3-4572-a33d-25d19ca5e85e.1d090606-1111-4fdb-867f-4af7b15ccf76" returned: 0 in 0.661s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:07 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-56246540-f999-4540-a27a-22f036a6ed70 tempest-GroupSnapshotsTest-894339262 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3ff6690-73c3-4572-a33d-25d19ca5e85e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:56:07 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3cbc1e2-73ac-48c1-b5ee-ad63ffb0e16a]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:56:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-56246540-f999-4540-a27a-22f036a6ed70 tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a3ff6690-73c3-4572-a33d-25d19ca5e85e {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:07 devstack sudo[97278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a3ff6690-73c3-4572-a33d-25d19ca5e85e Jul 30 16:56:07 devstack sudo[97278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:08 devstack sudo[97275]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-08bcde75-6704-41e5-932c-5d30206f1fd0 tempest-TestMinimumBasicScenario-417990955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.676s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:08 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-08bcde75-6704-41e5-932c-5d30206f1fd0 tempest-TestMinimumBasicScenario-417990955 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:56:08 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-08bcde75-6704-41e5-932c-5d30206f1fd0 tempest-TestMinimumBasicScenario-417990955 None] Deleted volume successfully. Jul 30 16:56:08 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-08bcde75-6704-41e5-932c-5d30206f1fd0 tempest-TestMinimumBasicScenario-417990955 None] Lock "cinder-10691e0c-c37e-4528-a994-778eae5e9c99-delete_volume" released by "delete_volume" :: held 2.176s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:56:08 devstack sudo[97278]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-56246540-f999-4540-a27a-22f036a6ed70 tempest-GroupSnapshotsTest-894339262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a3ff6690-73c3-4572-a33d-25d19ca5e85e" returned: 0 in 0.489s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-56246540-f999-4540-a27a-22f036a6ed70 tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a3ff6690-73c3-4572-a33d-25d19ca5e85e.1d090606-1111-4fdb-867f-4af7b15ccf76 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:08 devstack sudo[97284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a3ff6690-73c3-4572-a33d-25d19ca5e85e.1d090606-1111-4fdb-867f-4af7b15ccf76 Jul 30 16:56:08 devstack sudo[97284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:08 devstack sudo[97284]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-56246540-f999-4540-a27a-22f036a6ed70 tempest-GroupSnapshotsTest-894339262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a3ff6690-73c3-4572-a33d-25d19ca5e85e.1d090606-1111-4fdb-867f-4af7b15ccf76" returned: 0 in 0.571s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-56246540-f999-4540-a27a-22f036a6ed70 tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a3ff6690-73c3-4572-a33d-25d19ca5e85e.1d090606-1111-4fdb-867f-4af7b15ccf76 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:08 devstack sudo[97293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a3ff6690-73c3-4572-a33d-25d19ca5e85e.1d090606-1111-4fdb-867f-4af7b15ccf76 Jul 30 16:56:08 devstack sudo[97293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:09 devstack sudo[97293]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-56246540-f999-4540-a27a-22f036a6ed70 tempest-GroupSnapshotsTest-894339262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a3ff6690-73c3-4572-a33d-25d19ca5e85e.1d090606-1111-4fdb-867f-4af7b15ccf76" returned: 0 in 0.635s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:09 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-56246540-f999-4540-a27a-22f036a6ed70 tempest-GroupSnapshotsTest-894339262 None] Lock "cinder-quobyte-1d090606-1111-4fdb-867f-4af7b15ccf76" released by "_delete_snapshot" :: held 2.565s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:56:09 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-56246540-f999-4540-a27a-22f036a6ed70 tempest-GroupSnapshotsTest-894339262 None] Lock "cinder-quobyte-a3ff6690-73c3-4572-a33d-25d19ca5e85e" released by "delete_snapshot" :: held 2.630s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:56:09 devstack cinder-volume[88591]: WARNING cinder.quota [None req-56246540-f999-4540-a27a-22f036a6ed70 tempest-GroupSnapshotsTest-894339262 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-402732617 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-402732617, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:56:09 devstack cinder-volume[88591]: WARNING cinder.quota [None req-56246540-f999-4540-a27a-22f036a6ed70 tempest-GroupSnapshotsTest-894339262 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-402732617 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-402732617, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:56:09 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-56246540-f999-4540-a27a-22f036a6ed70 tempest-GroupSnapshotsTest-894339262 None] Created reservations ['62175f26-3264-4dfa-bf6a-cc70d755b489', 'b56934b0-a00c-4019-aec5-aa1cf76ef788', 'd0857a79-af17-46c5-9ada-be47e8ec4097', 'df89bd04-dafb-4099-b18b-3a2c2d36eca8'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:56:09 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-56246540-f999-4540-a27a-22f036a6ed70 tempest-GroupSnapshotsTest-894339262 None] group_snapshot 67dbe97e-1bc6-4b71-a636-8b4471f828b9: deleted successfully Jul 30 16:56:10 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-08c34a72-a92d-4843-8cf1-f15508df41ac tempest-GroupSnapshotsTest-894339262 None] Acquiring lock "cinder-quobyte-a3ff6690-73c3-4572-a33d-25d19ca5e85e" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:56:10 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-08c34a72-a92d-4843-8cf1-f15508df41ac tempest-GroupSnapshotsTest-894339262 None] Lock "cinder-quobyte-a3ff6690-73c3-4572-a33d-25d19ca5e85e" acquired by "delete_volume" :: waited 0.019s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:56:10 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7eb05fd-0d6f-407b-a912-a088e2296f89]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:56:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-08c34a72-a92d-4843-8cf1-f15508df41ac tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a3ff6690-73c3-4572-a33d-25d19ca5e85e {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:10 devstack sudo[97318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a3ff6690-73c3-4572-a33d-25d19ca5e85e Jul 30 16:56:10 devstack sudo[97318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:11 devstack sudo[97318]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-08c34a72-a92d-4843-8cf1-f15508df41ac tempest-GroupSnapshotsTest-894339262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a3ff6690-73c3-4572-a33d-25d19ca5e85e" returned: 0 in 0.474s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-08c34a72-a92d-4843-8cf1-f15508df41ac tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a3ff6690-73c3-4572-a33d-25d19ca5e85e {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:11 devstack sudo[97323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a3ff6690-73c3-4572-a33d-25d19ca5e85e Jul 30 16:56:11 devstack sudo[97323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:11 devstack sudo[97323]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-08c34a72-a92d-4843-8cf1-f15508df41ac tempest-GroupSnapshotsTest-894339262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a3ff6690-73c3-4572-a33d-25d19ca5e85e" returned: 0 in 0.315s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:11 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-08c34a72-a92d-4843-8cf1-f15508df41ac tempest-GroupSnapshotsTest-894339262 None] Lock "cinder-quobyte-a3ff6690-73c3-4572-a33d-25d19ca5e85e" released by "delete_volume" :: held 0.873s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:56:11 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-08c34a72-a92d-4843-8cf1-f15508df41ac tempest-GroupSnapshotsTest-894339262 None] Created reservations ['c1a06686-bb84-43a5-8fae-47ff578d4d29'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:56:11 devstack cinder-volume[88591]: WARNING cinder.quota [None req-08c34a72-a92d-4843-8cf1-f15508df41ac tempest-GroupSnapshotsTest-894339262 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-402732617 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-402732617, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:56:11 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-08c34a72-a92d-4843-8cf1-f15508df41ac tempest-GroupSnapshotsTest-894339262 None] Created reservations ['e3baf497-430e-4ca8-b8da-3506a4aca382', '141f3ca8-e135-4164-bfac-34aaadbdcd65', '320a44a1-4705-400b-b836-b9260ceb82cb', '83db68fe-6691-4be4-8216-0e67319f5ac5'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:56:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-08c34a72-a92d-4843-8cf1-f15508df41ac tempest-GroupSnapshotsTest-894339262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-08c34a72-a92d-4843-8cf1-f15508df41ac tempest-GroupSnapshotsTest-894339262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-08c34a72-a92d-4843-8cf1-f15508df41ac tempest-GroupSnapshotsTest-894339262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:56:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-08c34a72-a92d-4843-8cf1-f15508df41ac tempest-GroupSnapshotsTest-894339262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:56:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-08c34a72-a92d-4843-8cf1-f15508df41ac tempest-GroupSnapshotsTest-894339262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-08c34a72-a92d-4843-8cf1-f15508df41ac tempest-GroupSnapshotsTest-894339262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:12 devstack sudo[97327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:56:12 devstack sudo[97327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:12 devstack sudo[97327]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-08c34a72-a92d-4843-8cf1-f15508df41ac tempest-GroupSnapshotsTest-894339262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.409s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:12 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-08c34a72-a92d-4843-8cf1-f15508df41ac tempest-GroupSnapshotsTest-894339262 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:56:12 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-08c34a72-a92d-4843-8cf1-f15508df41ac tempest-GroupSnapshotsTest-894339262 None] Delete group completed successfully. Jul 30 16:56:12 devstack cinder-volume[88591]: DEBUG oslo_service.periodic_task [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:56:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:56:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:56:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:12 devstack sudo[97330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:56:12 devstack sudo[97330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:13 devstack sudo[97330]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.533s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:13 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:56:13 devstack cinder-volume[88591]: DEBUG oslo_service.periodic_task [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running periodic task VolumeManager._thread_info {{(pid=88591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:56:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] thread count: 8 {{(pid=88591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:56:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] thread info: [<_MainThread(MainThread, started 140677178003584)>, , , , , , , ] {{(pid=88591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:56:21 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-e9be44e1-6857-4c56-a15e-29ec09f158db tempest-GroupSnapshotsV319Test-1017587908 None] Group tempest-GroupSnapshotsV319Test-Group-520348585: creating Jul 30 16:56:21 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-e9be44e1-6857-4c56-a15e-29ec09f158db tempest-GroupSnapshotsV319Test-1017587908 None] Group tempest-GroupSnapshotsV319Test-Group-520348585: created successfully Jul 30 16:56:21 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-e9be44e1-6857-4c56-a15e-29ec09f158db tempest-GroupSnapshotsV319Test-1017587908 None] Create group completed successfully. Jul 30 16:56:23 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8e56dd1-d19c-4194-8915-2dfec76a3975 tempest-GroupSnapshotsV319Test-1017587908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:56:23 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a8e56dd1-d19c-4194-8915-2dfec76a3975 tempest-GroupSnapshotsV319Test-1017587908 None] Flow 'volume_create_manager' (232f8d12-5268-4585-9849-55daa6654e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:56:23 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a8e56dd1-d19c-4194-8915-2dfec76a3975 tempest-GroupSnapshotsV319Test-1017587908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8db8ebc9-d4a1-4807-9de9-6069083e4adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:23 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a8e56dd1-d19c-4194-8915-2dfec76a3975 tempest-GroupSnapshotsV319Test-1017587908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8db8ebc9-d4a1-4807-9de9-6069083e4adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-667546450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0abd03b2-dae8-457d-a9b8-1d793e8b82da,host='devstack@QuobyteHD#QuobyteHD',id=1ab75039-698a-4920-a39d-bb01a1dc853e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a61f7dc967d43fca3b098288a33374b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:56:23Z,use_quota=True,user_id='02af6a8371bd49ca92747ba5a1bb4d93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba189934-84e3-4c33-8caa-0f7a173cd739),volume_type_id=ba189934-84e3-4c33-8caa-0f7a173cd739)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:23 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a8e56dd1-d19c-4194-8915-2dfec76a3975 tempest-GroupSnapshotsV319Test-1017587908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (defa0e7c-9bd5-4e4c-935b-bfd37007262d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:23 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a8e56dd1-d19c-4194-8915-2dfec76a3975 tempest-GroupSnapshotsV319Test-1017587908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (defa0e7c-9bd5-4e4c-935b-bfd37007262d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:23 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a8e56dd1-d19c-4194-8915-2dfec76a3975 tempest-GroupSnapshotsV319Test-1017587908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (740fec8d-26e8-4495-95c6-8883c1838c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:23 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a8e56dd1-d19c-4194-8915-2dfec76a3975 tempest-GroupSnapshotsV319Test-1017587908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (740fec8d-26e8-4495-95c6-8883c1838c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ab75039-698a-4920-a39d-bb01a1dc853e', 'volume_name': 'volume-1ab75039-698a-4920-a39d-bb01a1dc853e', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:23 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a8e56dd1-d19c-4194-8915-2dfec76a3975 tempest-GroupSnapshotsV319Test-1017587908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0486fa21-d690-4dd4-b8a8-05683e4c6610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:23 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a8e56dd1-d19c-4194-8915-2dfec76a3975 tempest-GroupSnapshotsV319Test-1017587908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0486fa21-d690-4dd4-b8a8-05683e4c6610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:23 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a8e56dd1-d19c-4194-8915-2dfec76a3975 tempest-GroupSnapshotsV319Test-1017587908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e734439d-9c3c-4f41-883c-569454e58562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:23 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-a8e56dd1-d19c-4194-8915-2dfec76a3975 tempest-GroupSnapshotsV319Test-1017587908 None] Volume 1ab75039-698a-4920-a39d-bb01a1dc853e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ab75039-698a-4920-a39d-bb01a1dc853e', 'volume_size': 1} Jul 30 16:56:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a8e56dd1-d19c-4194-8915-2dfec76a3975 tempest-GroupSnapshotsV319Test-1017587908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a8e56dd1-d19c-4194-8915-2dfec76a3975 tempest-GroupSnapshotsV319Test-1017587908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:23 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a8e56dd1-d19c-4194-8915-2dfec76a3975 tempest-GroupSnapshotsV319Test-1017587908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0abd03b2-dae8-457d-a9b8-1d793e8b82da,created_at=2026-07-30T14:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-667546450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0abd03b2-dae8-457d-a9b8-1d793e8b82da,host='devstack@QuobyteHD#QuobyteHD',id=1ab75039-698a-4920-a39d-bb01a1dc853e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a61f7dc967d43fca3b098288a33374b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:56:23Z,use_quota=True,user_id='02af6a8371bd49ca92747ba5a1bb4d93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba189934-84e3-4c33-8caa-0f7a173cd739),volume_type_id=ba189934-84e3-4c33-8caa-0f7a173cd739)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:56:23 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-a8e56dd1-d19c-4194-8915-2dfec76a3975 tempest-GroupSnapshotsV319Test-1017587908 None] Creating volume 1ab75039-698a-4920-a39d-bb01a1dc853e {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:56:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a8e56dd1-d19c-4194-8915-2dfec76a3975 tempest-GroupSnapshotsV319Test-1017587908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a8e56dd1-d19c-4194-8915-2dfec76a3975 tempest-GroupSnapshotsV319Test-1017587908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:23 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a8e56dd1-d19c-4194-8915-2dfec76a3975 tempest-GroupSnapshotsV319Test-1017587908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:56:23 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a8e56dd1-d19c-4194-8915-2dfec76a3975 tempest-GroupSnapshotsV319Test-1017587908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:56:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a8e56dd1-d19c-4194-8915-2dfec76a3975 tempest-GroupSnapshotsV319Test-1017587908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:23 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a8e56dd1-d19c-4194-8915-2dfec76a3975 tempest-GroupSnapshotsV319Test-1017587908 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:56:23 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-a8e56dd1-d19c-4194-8915-2dfec76a3975 tempest-GroupSnapshotsV319Test-1017587908 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:56:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a8e56dd1-d19c-4194-8915-2dfec76a3975 tempest-GroupSnapshotsV319Test-1017587908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1ab75039-698a-4920-a39d-bb01a1dc853e 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:23 devstack sudo[97342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1ab75039-698a-4920-a39d-bb01a1dc853e 1073741824 Jul 30 16:56:23 devstack sudo[97342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:23 devstack sudo[97342]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a8e56dd1-d19c-4194-8915-2dfec76a3975 tempest-GroupSnapshotsV319Test-1017587908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1ab75039-698a-4920-a39d-bb01a1dc853e 1073741824" returned: 0 in 0.518s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a8e56dd1-d19c-4194-8915-2dfec76a3975 tempest-GroupSnapshotsV319Test-1017587908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1ab75039-698a-4920-a39d-bb01a1dc853e {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:23 devstack sudo[97348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1ab75039-698a-4920-a39d-bb01a1dc853e Jul 30 16:56:23 devstack sudo[97348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:24 devstack sudo[97348]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a8e56dd1-d19c-4194-8915-2dfec76a3975 tempest-GroupSnapshotsV319Test-1017587908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1ab75039-698a-4920-a39d-bb01a1dc853e" returned: 0 in 0.368s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:24 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a8e56dd1-d19c-4194-8915-2dfec76a3975 tempest-GroupSnapshotsV319Test-1017587908 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:56:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a8e56dd1-d19c-4194-8915-2dfec76a3975 tempest-GroupSnapshotsV319Test-1017587908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a8e56dd1-d19c-4194-8915-2dfec76a3975 tempest-GroupSnapshotsV319Test-1017587908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e734439d-9c3c-4f41-883c-569454e58562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ab75039-698a-4920-a39d-bb01a1dc853e', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a8e56dd1-d19c-4194-8915-2dfec76a3975 tempest-GroupSnapshotsV319Test-1017587908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba185f93-3282-4848-9a93-08df60106bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:24 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-a8e56dd1-d19c-4194-8915-2dfec76a3975 tempest-GroupSnapshotsV319Test-1017587908 None] Volume volume-1ab75039-698a-4920-a39d-bb01a1dc853e (1ab75039-698a-4920-a39d-bb01a1dc853e): created successfully Jul 30 16:56:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a8e56dd1-d19c-4194-8915-2dfec76a3975 tempest-GroupSnapshotsV319Test-1017587908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba185f93-3282-4848-9a93-08df60106bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a8e56dd1-d19c-4194-8915-2dfec76a3975 tempest-GroupSnapshotsV319Test-1017587908 None] Flow 'volume_create_manager' (232f8d12-5268-4585-9849-55daa6654e9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:56:24 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3f6e9b1-205e-4522-a532-ae970cd5e6cd tempest-VolumeQuotasAdminTestJSON-1906027176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:56:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d3f6e9b1-205e-4522-a532-ae970cd5e6cd tempest-VolumeQuotasAdminTestJSON-1906027176 None] Flow 'volume_create_manager' (e7b1d67c-c551-48f4-844e-71364cd35ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:56:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d3f6e9b1-205e-4522-a532-ae970cd5e6cd tempest-VolumeQuotasAdminTestJSON-1906027176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5d661da-eed4-406a-82d5-8e145adb16be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:24 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-a8e56dd1-d19c-4194-8915-2dfec76a3975 tempest-GroupSnapshotsV319Test-1017587908 None] Created volume successfully. Jul 30 16:56:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d3f6e9b1-205e-4522-a532-ae970cd5e6cd tempest-VolumeQuotasAdminTestJSON-1906027176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5d661da-eed4-406a-82d5-8e145adb16be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1054834760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05717d3b-e12e-49b8-96f5-72d549ff2d8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='772d79f6af5a4f7d88978188820f0fda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:56:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:56:24Z,use_quota=True,user_id='299ac61b33d34bcba424d9c79431d124',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d3f6e9b1-205e-4522-a532-ae970cd5e6cd tempest-VolumeQuotasAdminTestJSON-1906027176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0d53aea-c881-4829-9836-b2cb9403b6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d3f6e9b1-205e-4522-a532-ae970cd5e6cd tempest-VolumeQuotasAdminTestJSON-1906027176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0d53aea-c881-4829-9836-b2cb9403b6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d3f6e9b1-205e-4522-a532-ae970cd5e6cd tempest-VolumeQuotasAdminTestJSON-1906027176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ad1b379-17e5-4660-83a8-30cde5973f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d3f6e9b1-205e-4522-a532-ae970cd5e6cd tempest-VolumeQuotasAdminTestJSON-1906027176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ad1b379-17e5-4660-83a8-30cde5973f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05717d3b-e12e-49b8-96f5-72d549ff2d8f', 'volume_name': 'volume-05717d3b-e12e-49b8-96f5-72d549ff2d8f', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d3f6e9b1-205e-4522-a532-ae970cd5e6cd tempest-VolumeQuotasAdminTestJSON-1906027176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfe8b352-a502-4c22-95bf-75a01d0a79d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d3f6e9b1-205e-4522-a532-ae970cd5e6cd tempest-VolumeQuotasAdminTestJSON-1906027176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfe8b352-a502-4c22-95bf-75a01d0a79d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d3f6e9b1-205e-4522-a532-ae970cd5e6cd tempest-VolumeQuotasAdminTestJSON-1906027176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39efe35b-0449-460a-b1fa-c08224cfccdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:24 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-d3f6e9b1-205e-4522-a532-ae970cd5e6cd tempest-VolumeQuotasAdminTestJSON-1906027176 None] Volume 05717d3b-e12e-49b8-96f5-72d549ff2d8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05717d3b-e12e-49b8-96f5-72d549ff2d8f', 'volume_size': 1} Jul 30 16:56:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d3f6e9b1-205e-4522-a532-ae970cd5e6cd tempest-VolumeQuotasAdminTestJSON-1906027176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d3f6e9b1-205e-4522-a532-ae970cd5e6cd tempest-VolumeQuotasAdminTestJSON-1906027176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:24 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d3f6e9b1-205e-4522-a532-ae970cd5e6cd tempest-VolumeQuotasAdminTestJSON-1906027176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1054834760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05717d3b-e12e-49b8-96f5-72d549ff2d8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='772d79f6af5a4f7d88978188820f0fda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:56:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:56:24Z,use_quota=True,user_id='299ac61b33d34bcba424d9c79431d124',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:56:24 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-d3f6e9b1-205e-4522-a532-ae970cd5e6cd tempest-VolumeQuotasAdminTestJSON-1906027176 None] Creating volume 05717d3b-e12e-49b8-96f5-72d549ff2d8f {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:56:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d3f6e9b1-205e-4522-a532-ae970cd5e6cd tempest-VolumeQuotasAdminTestJSON-1906027176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d3f6e9b1-205e-4522-a532-ae970cd5e6cd tempest-VolumeQuotasAdminTestJSON-1906027176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:24 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d3f6e9b1-205e-4522-a532-ae970cd5e6cd tempest-VolumeQuotasAdminTestJSON-1906027176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:56:24 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d3f6e9b1-205e-4522-a532-ae970cd5e6cd tempest-VolumeQuotasAdminTestJSON-1906027176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:56:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d3f6e9b1-205e-4522-a532-ae970cd5e6cd tempest-VolumeQuotasAdminTestJSON-1906027176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:24 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d3f6e9b1-205e-4522-a532-ae970cd5e6cd tempest-VolumeQuotasAdminTestJSON-1906027176 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:56:24 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-d3f6e9b1-205e-4522-a532-ae970cd5e6cd tempest-VolumeQuotasAdminTestJSON-1906027176 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:56:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d3f6e9b1-205e-4522-a532-ae970cd5e6cd tempest-VolumeQuotasAdminTestJSON-1906027176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-05717d3b-e12e-49b8-96f5-72d549ff2d8f 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:24 devstack sudo[97353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-05717d3b-e12e-49b8-96f5-72d549ff2d8f 1073741824 Jul 30 16:56:24 devstack sudo[97353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:24 devstack sudo[97353]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d3f6e9b1-205e-4522-a532-ae970cd5e6cd tempest-VolumeQuotasAdminTestJSON-1906027176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-05717d3b-e12e-49b8-96f5-72d549ff2d8f 1073741824" returned: 0 in 0.429s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d3f6e9b1-205e-4522-a532-ae970cd5e6cd tempest-VolumeQuotasAdminTestJSON-1906027176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-05717d3b-e12e-49b8-96f5-72d549ff2d8f {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:24 devstack sudo[97359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-05717d3b-e12e-49b8-96f5-72d549ff2d8f Jul 30 16:56:24 devstack sudo[97359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:25 devstack sudo[97359]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d3f6e9b1-205e-4522-a532-ae970cd5e6cd tempest-VolumeQuotasAdminTestJSON-1906027176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-05717d3b-e12e-49b8-96f5-72d549ff2d8f" returned: 0 in 0.245s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:25 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d3f6e9b1-205e-4522-a532-ae970cd5e6cd tempest-VolumeQuotasAdminTestJSON-1906027176 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:56:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d3f6e9b1-205e-4522-a532-ae970cd5e6cd tempest-VolumeQuotasAdminTestJSON-1906027176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d3f6e9b1-205e-4522-a532-ae970cd5e6cd tempest-VolumeQuotasAdminTestJSON-1906027176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39efe35b-0449-460a-b1fa-c08224cfccdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05717d3b-e12e-49b8-96f5-72d549ff2d8f', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d3f6e9b1-205e-4522-a532-ae970cd5e6cd tempest-VolumeQuotasAdminTestJSON-1906027176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93737290-3901-443c-ba08-521ee70d92ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:25 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-d3f6e9b1-205e-4522-a532-ae970cd5e6cd tempest-VolumeQuotasAdminTestJSON-1906027176 None] Volume volume-05717d3b-e12e-49b8-96f5-72d549ff2d8f (05717d3b-e12e-49b8-96f5-72d549ff2d8f): created successfully Jul 30 16:56:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d3f6e9b1-205e-4522-a532-ae970cd5e6cd tempest-VolumeQuotasAdminTestJSON-1906027176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93737290-3901-443c-ba08-521ee70d92ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d3f6e9b1-205e-4522-a532-ae970cd5e6cd tempest-VolumeQuotasAdminTestJSON-1906027176 None] Flow 'volume_create_manager' (e7b1d67c-c551-48f4-844e-71364cd35ef7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:56:25 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-d3f6e9b1-205e-4522-a532-ae970cd5e6cd tempest-VolumeQuotasAdminTestJSON-1906027176 None] Created volume successfully. Jul 30 16:56:25 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-3f13683e-946e-4cba-ae10-6df7a16b62dc tempest-GroupSnapshotsV319Test-1017587908 None] GroupSnapshot 58d4f9bc-e4ae-433b-894c-ba9cbeb11052: creating. Jul 30 16:56:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3f13683e-946e-4cba-ae10-6df7a16b62dc tempest-GroupSnapshotsV319Test-1017587908 None] Group snapshot 58d4f9bc-e4ae-433b-894c-ba9cbeb11052: creating. {{(pid=88591) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 30 16:56:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3f13683e-946e-4cba-ae10-6df7a16b62dc tempest-GroupSnapshotsV319Test-1017587908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3f13683e-946e-4cba-ae10-6df7a16b62dc tempest-GroupSnapshotsV319Test-1017587908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:25 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-3f13683e-946e-4cba-ae10-6df7a16b62dc tempest-GroupSnapshotsV319Test-1017587908 None] Creating offline snapshot be4230f0-ecb6-482a-aded-babe1633afd4 of volume 1ab75039-698a-4920-a39d-bb01a1dc853e {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:56:25 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f418723d-8a59-4dc5-9e7f-fb32198e6b3c]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:56:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3f13683e-946e-4cba-ae10-6df7a16b62dc tempest-GroupSnapshotsV319Test-1017587908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1ab75039-698a-4920-a39d-bb01a1dc853e {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:25 devstack sudo[97362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1ab75039-698a-4920-a39d-bb01a1dc853e Jul 30 16:56:25 devstack sudo[97362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:26 devstack sudo[97362]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3f13683e-946e-4cba-ae10-6df7a16b62dc tempest-GroupSnapshotsV319Test-1017587908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1ab75039-698a-4920-a39d-bb01a1dc853e" returned: 0 in 0.387s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3f13683e-946e-4cba-ae10-6df7a16b62dc tempest-GroupSnapshotsV319Test-1017587908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1ab75039-698a-4920-a39d-bb01a1dc853e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1ab75039-698a-4920-a39d-bb01a1dc853e.be4230f0-ecb6-482a-aded-babe1633afd4 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:26 devstack sudo[97367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1ab75039-698a-4920-a39d-bb01a1dc853e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1ab75039-698a-4920-a39d-bb01a1dc853e.be4230f0-ecb6-482a-aded-babe1633afd4 1G Jul 30 16:56:26 devstack sudo[97367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:26 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c11df36f-6a85-43c3-a6c7-dc76b6bd9683 tempest-VolumeQuotasAdminTestJSON-1906027176 None] Acquiring lock "cinder-05717d3b-e12e-49b8-96f5-72d549ff2d8f-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:56:26 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c11df36f-6a85-43c3-a6c7-dc76b6bd9683 tempest-VolumeQuotasAdminTestJSON-1906027176 None] Lock "cinder-05717d3b-e12e-49b8-96f5-72d549ff2d8f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:56:26 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c11df36f-6a85-43c3-a6c7-dc76b6bd9683 tempest-VolumeQuotasAdminTestJSON-1906027176 None] Acquiring lock "cinder-quobyte-05717d3b-e12e-49b8-96f5-72d549ff2d8f" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:56:26 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c11df36f-6a85-43c3-a6c7-dc76b6bd9683 tempest-VolumeQuotasAdminTestJSON-1906027176 None] Lock "cinder-quobyte-05717d3b-e12e-49b8-96f5-72d549ff2d8f" acquired by "delete_volume" :: waited 0.016s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:56:26 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[730d1cac-8932-4216-af6f-a67fce5089d8]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:56:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c11df36f-6a85-43c3-a6c7-dc76b6bd9683 tempest-VolumeQuotasAdminTestJSON-1906027176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-05717d3b-e12e-49b8-96f5-72d549ff2d8f {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:26 devstack sudo[97371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-05717d3b-e12e-49b8-96f5-72d549ff2d8f Jul 30 16:56:26 devstack sudo[97371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:26 devstack sudo[97367]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3f13683e-946e-4cba-ae10-6df7a16b62dc tempest-GroupSnapshotsV319Test-1017587908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1ab75039-698a-4920-a39d-bb01a1dc853e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1ab75039-698a-4920-a39d-bb01a1dc853e.be4230f0-ecb6-482a-aded-babe1633afd4 1G" returned: 0 in 0.571s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3f13683e-946e-4cba-ae10-6df7a16b62dc tempest-GroupSnapshotsV319Test-1017587908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ab75039-698a-4920-a39d-bb01a1dc853e -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1ab75039-698a-4920-a39d-bb01a1dc853e.be4230f0-ecb6-482a-aded-babe1633afd4 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:26 devstack sudo[97375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ab75039-698a-4920-a39d-bb01a1dc853e -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1ab75039-698a-4920-a39d-bb01a1dc853e.be4230f0-ecb6-482a-aded-babe1633afd4 Jul 30 16:56:26 devstack sudo[97375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:27 devstack sudo[97371]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c11df36f-6a85-43c3-a6c7-dc76b6bd9683 tempest-VolumeQuotasAdminTestJSON-1906027176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-05717d3b-e12e-49b8-96f5-72d549ff2d8f" returned: 0 in 0.492s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c11df36f-6a85-43c3-a6c7-dc76b6bd9683 tempest-VolumeQuotasAdminTestJSON-1906027176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-05717d3b-e12e-49b8-96f5-72d549ff2d8f {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:27 devstack sudo[97380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-05717d3b-e12e-49b8-96f5-72d549ff2d8f Jul 30 16:56:27 devstack sudo[97380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:27 devstack sudo[97375]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3f13683e-946e-4cba-ae10-6df7a16b62dc tempest-GroupSnapshotsV319Test-1017587908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ab75039-698a-4920-a39d-bb01a1dc853e -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1ab75039-698a-4920-a39d-bb01a1dc853e.be4230f0-ecb6-482a-aded-babe1633afd4" returned: 0 in 0.457s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:27 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-3f13683e-946e-4cba-ae10-6df7a16b62dc tempest-GroupSnapshotsV319Test-1017587908 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1ab75039-698a-4920-a39d-bb01a1dc853e.be4230f0-ecb6-482a-aded-babe1633afd4 is being set with open permissions: ugo+rw: NotImplementedError Jul 30 16:56:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3f13683e-946e-4cba-ae10-6df7a16b62dc tempest-GroupSnapshotsV319Test-1017587908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1ab75039-698a-4920-a39d-bb01a1dc853e.be4230f0-ecb6-482a-aded-babe1633afd4 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:27 devstack sudo[97386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1ab75039-698a-4920-a39d-bb01a1dc853e.be4230f0-ecb6-482a-aded-babe1633afd4 Jul 30 16:56:27 devstack sudo[97386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:27 devstack sudo[97380]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c11df36f-6a85-43c3-a6c7-dc76b6bd9683 tempest-VolumeQuotasAdminTestJSON-1906027176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-05717d3b-e12e-49b8-96f5-72d549ff2d8f" returned: 0 in 0.304s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:27 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c11df36f-6a85-43c3-a6c7-dc76b6bd9683 tempest-VolumeQuotasAdminTestJSON-1906027176 None] Lock "cinder-quobyte-05717d3b-e12e-49b8-96f5-72d549ff2d8f" released by "delete_volume" :: held 0.862s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:56:27 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-c11df36f-6a85-43c3-a6c7-dc76b6bd9683 tempest-VolumeQuotasAdminTestJSON-1906027176 None] Created reservations ['d90e83de-883f-480e-a680-4c0c65236970', 'beb245e2-f919-47a0-ad5b-7bd27fe6b71d', '4a116732-6eac-4514-a526-c3d93fb046e0', '83aed889-3c43-46a6-92ce-62bff2c3c007'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:56:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c11df36f-6a85-43c3-a6c7-dc76b6bd9683 tempest-VolumeQuotasAdminTestJSON-1906027176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c11df36f-6a85-43c3-a6c7-dc76b6bd9683 tempest-VolumeQuotasAdminTestJSON-1906027176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:27 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-c11df36f-6a85-43c3-a6c7-dc76b6bd9683 tempest-VolumeQuotasAdminTestJSON-1906027176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:56:27 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-c11df36f-6a85-43c3-a6c7-dc76b6bd9683 tempest-VolumeQuotasAdminTestJSON-1906027176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:56:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c11df36f-6a85-43c3-a6c7-dc76b6bd9683 tempest-VolumeQuotasAdminTestJSON-1906027176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c11df36f-6a85-43c3-a6c7-dc76b6bd9683 tempest-VolumeQuotasAdminTestJSON-1906027176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:27 devstack sudo[97388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:56:27 devstack sudo[97388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:27 devstack sudo[97386]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3f13683e-946e-4cba-ae10-6df7a16b62dc tempest-GroupSnapshotsV319Test-1017587908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1ab75039-698a-4920-a39d-bb01a1dc853e.be4230f0-ecb6-482a-aded-babe1633afd4" returned: 0 in 0.382s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3f13683e-946e-4cba-ae10-6df7a16b62dc tempest-GroupSnapshotsV319Test-1017587908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1ab75039-698a-4920-a39d-bb01a1dc853e.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:27 devstack sudo[97391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1ab75039-698a-4920-a39d-bb01a1dc853e.info Jul 30 16:56:27 devstack sudo[97391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:27 devstack sudo[97388]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c11df36f-6a85-43c3-a6c7-dc76b6bd9683 tempest-VolumeQuotasAdminTestJSON-1906027176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.378s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:27 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-c11df36f-6a85-43c3-a6c7-dc76b6bd9683 tempest-VolumeQuotasAdminTestJSON-1906027176 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:56:27 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-c11df36f-6a85-43c3-a6c7-dc76b6bd9683 tempest-VolumeQuotasAdminTestJSON-1906027176 None] Deleted volume successfully. Jul 30 16:56:27 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c11df36f-6a85-43c3-a6c7-dc76b6bd9683 tempest-VolumeQuotasAdminTestJSON-1906027176 None] Lock "cinder-05717d3b-e12e-49b8-96f5-72d549ff2d8f-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:56:28 devstack sudo[97391]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3f13683e-946e-4cba-ae10-6df7a16b62dc tempest-GroupSnapshotsV319Test-1017587908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1ab75039-698a-4920-a39d-bb01a1dc853e.info" returned: 0 in 0.492s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:28 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-3f13683e-946e-4cba-ae10-6df7a16b62dc tempest-GroupSnapshotsV319Test-1017587908 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1ab75039-698a-4920-a39d-bb01a1dc853e.info is being set with open permissions: ugo+rw: NotImplementedError Jul 30 16:56:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3f13683e-946e-4cba-ae10-6df7a16b62dc tempest-GroupSnapshotsV319Test-1017587908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1ab75039-698a-4920-a39d-bb01a1dc853e.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:28 devstack sudo[97395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1ab75039-698a-4920-a39d-bb01a1dc853e.info Jul 30 16:56:28 devstack sudo[97395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:28 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-3aca4577-e4cc-4884-9d8d-bddfff7a266a tempest-VolumeQuotasAdminTestJSON-1906027176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:56:28 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3aca4577-e4cc-4884-9d8d-bddfff7a266a tempest-VolumeQuotasAdminTestJSON-1906027176 None] Flow 'volume_create_manager' (69601fec-777a-465f-8538-31840ca1d034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:56:28 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3aca4577-e4cc-4884-9d8d-bddfff7a266a tempest-VolumeQuotasAdminTestJSON-1906027176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b7832ac-58d4-4142-8b8c-da75e120084b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:28 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3aca4577-e4cc-4884-9d8d-bddfff7a266a tempest-VolumeQuotasAdminTestJSON-1906027176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b7832ac-58d4-4142-8b8c-da75e120084b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:56:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1520340777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c7dff3f-2ebd-4246-946f-216b9363a14d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='772d79f6af5a4f7d88978188820f0fda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:56:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:56:28Z,use_quota=True,user_id='299ac61b33d34bcba424d9c79431d124',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:28 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3aca4577-e4cc-4884-9d8d-bddfff7a266a tempest-VolumeQuotasAdminTestJSON-1906027176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffa4cbd1-5368-4a15-9278-1923a540f3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:28 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3aca4577-e4cc-4884-9d8d-bddfff7a266a tempest-VolumeQuotasAdminTestJSON-1906027176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffa4cbd1-5368-4a15-9278-1923a540f3f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:28 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3aca4577-e4cc-4884-9d8d-bddfff7a266a tempest-VolumeQuotasAdminTestJSON-1906027176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de49ec22-0718-4367-9399-437865d3041d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:28 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3aca4577-e4cc-4884-9d8d-bddfff7a266a tempest-VolumeQuotasAdminTestJSON-1906027176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de49ec22-0718-4367-9399-437865d3041d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c7dff3f-2ebd-4246-946f-216b9363a14d', 'volume_name': 'volume-8c7dff3f-2ebd-4246-946f-216b9363a14d', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:28 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3aca4577-e4cc-4884-9d8d-bddfff7a266a tempest-VolumeQuotasAdminTestJSON-1906027176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ca730b8-5fc4-490f-9ab0-dc00caeb2699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:28 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3aca4577-e4cc-4884-9d8d-bddfff7a266a tempest-VolumeQuotasAdminTestJSON-1906027176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ca730b8-5fc4-490f-9ab0-dc00caeb2699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:28 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3aca4577-e4cc-4884-9d8d-bddfff7a266a tempest-VolumeQuotasAdminTestJSON-1906027176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1fea121-e6f5-4df4-bdfa-c51c4310299c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:28 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-3aca4577-e4cc-4884-9d8d-bddfff7a266a tempest-VolumeQuotasAdminTestJSON-1906027176 None] Volume 8c7dff3f-2ebd-4246-946f-216b9363a14d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c7dff3f-2ebd-4246-946f-216b9363a14d', 'volume_size': 1} Jul 30 16:56:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3aca4577-e4cc-4884-9d8d-bddfff7a266a tempest-VolumeQuotasAdminTestJSON-1906027176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:28 devstack sudo[97395]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3f13683e-946e-4cba-ae10-6df7a16b62dc tempest-GroupSnapshotsV319Test-1017587908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1ab75039-698a-4920-a39d-bb01a1dc853e.info" returned: 0 in 0.356s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3f13683e-946e-4cba-ae10-6df7a16b62dc tempest-GroupSnapshotsV319Test-1017587908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.757s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3aca4577-e4cc-4884-9d8d-bddfff7a266a tempest-VolumeQuotasAdminTestJSON-1906027176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.148s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:28 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-3aca4577-e4cc-4884-9d8d-bddfff7a266a tempest-VolumeQuotasAdminTestJSON-1906027176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:56:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1520340777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c7dff3f-2ebd-4246-946f-216b9363a14d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='772d79f6af5a4f7d88978188820f0fda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:56:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:56:28Z,use_quota=True,user_id='299ac61b33d34bcba424d9c79431d124',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:56:28 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-3aca4577-e4cc-4884-9d8d-bddfff7a266a tempest-VolumeQuotasAdminTestJSON-1906027176 None] Creating volume 8c7dff3f-2ebd-4246-946f-216b9363a14d {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:56:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3aca4577-e4cc-4884-9d8d-bddfff7a266a tempest-VolumeQuotasAdminTestJSON-1906027176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3aca4577-e4cc-4884-9d8d-bddfff7a266a tempest-VolumeQuotasAdminTestJSON-1906027176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:28 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-3aca4577-e4cc-4884-9d8d-bddfff7a266a tempest-VolumeQuotasAdminTestJSON-1906027176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:56:28 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-3aca4577-e4cc-4884-9d8d-bddfff7a266a tempest-VolumeQuotasAdminTestJSON-1906027176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:56:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3aca4577-e4cc-4884-9d8d-bddfff7a266a tempest-VolumeQuotasAdminTestJSON-1906027176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:28 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-3aca4577-e4cc-4884-9d8d-bddfff7a266a tempest-VolumeQuotasAdminTestJSON-1906027176 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:56:28 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-3aca4577-e4cc-4884-9d8d-bddfff7a266a tempest-VolumeQuotasAdminTestJSON-1906027176 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:56:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3aca4577-e4cc-4884-9d8d-bddfff7a266a tempest-VolumeQuotasAdminTestJSON-1906027176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c7dff3f-2ebd-4246-946f-216b9363a14d 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:28 devstack sudo[97398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c7dff3f-2ebd-4246-946f-216b9363a14d 1073741824 Jul 30 16:56:28 devstack sudo[97398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:28 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-3f13683e-946e-4cba-ae10-6df7a16b62dc tempest-GroupSnapshotsV319Test-1017587908 None] group_snapshot 58d4f9bc-e4ae-433b-894c-ba9cbeb11052: created successfully Jul 30 16:56:29 devstack sudo[97398]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3aca4577-e4cc-4884-9d8d-bddfff7a266a tempest-VolumeQuotasAdminTestJSON-1906027176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c7dff3f-2ebd-4246-946f-216b9363a14d 1073741824" returned: 0 in 0.500s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3aca4577-e4cc-4884-9d8d-bddfff7a266a tempest-VolumeQuotasAdminTestJSON-1906027176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c7dff3f-2ebd-4246-946f-216b9363a14d {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:29 devstack sudo[97404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c7dff3f-2ebd-4246-946f-216b9363a14d Jul 30 16:56:29 devstack sudo[97404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:29 devstack sudo[97404]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3aca4577-e4cc-4884-9d8d-bddfff7a266a tempest-VolumeQuotasAdminTestJSON-1906027176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c7dff3f-2ebd-4246-946f-216b9363a14d" returned: 0 in 0.298s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:29 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-3aca4577-e4cc-4884-9d8d-bddfff7a266a tempest-VolumeQuotasAdminTestJSON-1906027176 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:56:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3aca4577-e4cc-4884-9d8d-bddfff7a266a tempest-VolumeQuotasAdminTestJSON-1906027176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:29 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3aca4577-e4cc-4884-9d8d-bddfff7a266a tempest-VolumeQuotasAdminTestJSON-1906027176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1fea121-e6f5-4df4-bdfa-c51c4310299c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c7dff3f-2ebd-4246-946f-216b9363a14d', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:29 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3aca4577-e4cc-4884-9d8d-bddfff7a266a tempest-VolumeQuotasAdminTestJSON-1906027176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (392a56fc-ecb5-49f1-8898-d011ac6695b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:29 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-3aca4577-e4cc-4884-9d8d-bddfff7a266a tempest-VolumeQuotasAdminTestJSON-1906027176 None] Volume volume-8c7dff3f-2ebd-4246-946f-216b9363a14d (8c7dff3f-2ebd-4246-946f-216b9363a14d): created successfully Jul 30 16:56:29 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3aca4577-e4cc-4884-9d8d-bddfff7a266a tempest-VolumeQuotasAdminTestJSON-1906027176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (392a56fc-ecb5-49f1-8898-d011ac6695b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:29 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3aca4577-e4cc-4884-9d8d-bddfff7a266a tempest-VolumeQuotasAdminTestJSON-1906027176 None] Flow 'volume_create_manager' (69601fec-777a-465f-8538-31840ca1d034) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:56:29 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-8f06ca4f-1ecb-44fa-ac25-b2733c8d3bfe tempest-GroupSnapshotsV319Test-1017587908 None] group_snapshot 58d4f9bc-e4ae-433b-894c-ba9cbeb11052: deleting Jul 30 16:56:29 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-3aca4577-e4cc-4884-9d8d-bddfff7a266a tempest-VolumeQuotasAdminTestJSON-1906027176 None] Created volume successfully. Jul 30 16:56:29 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8f06ca4f-1ecb-44fa-ac25-b2733c8d3bfe tempest-GroupSnapshotsV319Test-1017587908 None] group_snapshot 58d4f9bc-e4ae-433b-894c-ba9cbeb11052: deleting {{(pid=88591) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 30 16:56:29 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-8f06ca4f-1ecb-44fa-ac25-b2733c8d3bfe tempest-GroupSnapshotsV319Test-1017587908 None] Acquiring lock "cinder-quobyte-1ab75039-698a-4920-a39d-bb01a1dc853e" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:56:29 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-8f06ca4f-1ecb-44fa-ac25-b2733c8d3bfe tempest-GroupSnapshotsV319Test-1017587908 None] Lock "cinder-quobyte-1ab75039-698a-4920-a39d-bb01a1dc853e" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:56:29 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-8f06ca4f-1ecb-44fa-ac25-b2733c8d3bfe tempest-GroupSnapshotsV319Test-1017587908 None] Acquiring lock "cinder-quobyte-be4230f0-ecb6-482a-aded-babe1633afd4" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:56:29 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-8f06ca4f-1ecb-44fa-ac25-b2733c8d3bfe tempest-GroupSnapshotsV319Test-1017587908 None] Lock "cinder-quobyte-be4230f0-ecb6-482a-aded-babe1633afd4" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:56:29 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-8f06ca4f-1ecb-44fa-ac25-b2733c8d3bfe tempest-GroupSnapshotsV319Test-1017587908 None] Deleting offline snapshot be4230f0-ecb6-482a-aded-babe1633afd4 of volume 1ab75039-698a-4920-a39d-bb01a1dc853e {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:56:29 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-8f06ca4f-1ecb-44fa-ac25-b2733c8d3bfe tempest-GroupSnapshotsV319Test-1017587908 None] snapshot_file for this snap is: volume-1ab75039-698a-4920-a39d-bb01a1dc853e.be4230f0-ecb6-482a-aded-babe1633afd4 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:56:29 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06a9289-da20-413c-adbe-d770dd7d3a6b]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:56:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8f06ca4f-1ecb-44fa-ac25-b2733c8d3bfe tempest-GroupSnapshotsV319Test-1017587908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1ab75039-698a-4920-a39d-bb01a1dc853e.be4230f0-ecb6-482a-aded-babe1633afd4 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:29 devstack sudo[97409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1ab75039-698a-4920-a39d-bb01a1dc853e.be4230f0-ecb6-482a-aded-babe1633afd4 Jul 30 16:56:29 devstack sudo[97409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:30 devstack sudo[97409]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8f06ca4f-1ecb-44fa-ac25-b2733c8d3bfe tempest-GroupSnapshotsV319Test-1017587908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1ab75039-698a-4920-a39d-bb01a1dc853e.be4230f0-ecb6-482a-aded-babe1633afd4" returned: 0 in 0.442s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:30 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-8f06ca4f-1ecb-44fa-ac25-b2733c8d3bfe tempest-GroupSnapshotsV319Test-1017587908 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ab75039-698a-4920-a39d-bb01a1dc853e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:56:30 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46bab8e-38e9-4fd7-b425-48056915eb8a]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:56:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8f06ca4f-1ecb-44fa-ac25-b2733c8d3bfe tempest-GroupSnapshotsV319Test-1017587908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1ab75039-698a-4920-a39d-bb01a1dc853e {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:30 devstack sudo[97414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1ab75039-698a-4920-a39d-bb01a1dc853e Jul 30 16:56:30 devstack sudo[97414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:30 devstack sudo[97414]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8f06ca4f-1ecb-44fa-ac25-b2733c8d3bfe tempest-GroupSnapshotsV319Test-1017587908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1ab75039-698a-4920-a39d-bb01a1dc853e" returned: 0 in 0.491s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8f06ca4f-1ecb-44fa-ac25-b2733c8d3bfe tempest-GroupSnapshotsV319Test-1017587908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1ab75039-698a-4920-a39d-bb01a1dc853e.be4230f0-ecb6-482a-aded-babe1633afd4 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:30 devstack sudo[97425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1ab75039-698a-4920-a39d-bb01a1dc853e.be4230f0-ecb6-482a-aded-babe1633afd4 Jul 30 16:56:30 devstack sudo[97425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:30 devstack cinder-volume[88591]: INFO cinder.volume.manager [req-6331b8ff-3190-40eb-9e9e-88de6a88db3d req-e4d51411-22ce-4829-8a1b-1b9d338f66ad tempest-AttachVolumeTestJSON-687994885 None] Terminate volume connection completed successfully. Jul 30 16:56:30 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-6331b8ff-3190-40eb-9e9e-88de6a88db3d req-e4d51411-22ce-4829-8a1b-1b9d338f66ad tempest-AttachVolumeTestJSON-687994885 None] Deleting attachment 3aa00d06-efaa-400e-8a39-ab3bf3ea71d4. {{(pid=88591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:56:31 devstack sudo[97425]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8f06ca4f-1ecb-44fa-ac25-b2733c8d3bfe tempest-GroupSnapshotsV319Test-1017587908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1ab75039-698a-4920-a39d-bb01a1dc853e.be4230f0-ecb6-482a-aded-babe1633afd4" returned: 0 in 0.559s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8f06ca4f-1ecb-44fa-ac25-b2733c8d3bfe tempest-GroupSnapshotsV319Test-1017587908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1ab75039-698a-4920-a39d-bb01a1dc853e.be4230f0-ecb6-482a-aded-babe1633afd4 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:31 devstack sudo[97431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1ab75039-698a-4920-a39d-bb01a1dc853e.be4230f0-ecb6-482a-aded-babe1633afd4 Jul 30 16:56:31 devstack sudo[97431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:31 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-27040163-b8ea-4887-ae5e-ca5ebbd12f2e tempest-VolumeQuotasAdminTestJSON-1234596863 None] Transfer volume completed successfully. Jul 30 16:56:31 devstack sudo[97431]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8f06ca4f-1ecb-44fa-ac25-b2733c8d3bfe tempest-GroupSnapshotsV319Test-1017587908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1ab75039-698a-4920-a39d-bb01a1dc853e.be4230f0-ecb6-482a-aded-babe1633afd4" returned: 0 in 0.486s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:31 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-8f06ca4f-1ecb-44fa-ac25-b2733c8d3bfe tempest-GroupSnapshotsV319Test-1017587908 None] Lock "cinder-quobyte-be4230f0-ecb6-482a-aded-babe1633afd4" released by "_delete_snapshot" :: held 2.123s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:56:31 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-8f06ca4f-1ecb-44fa-ac25-b2733c8d3bfe tempest-GroupSnapshotsV319Test-1017587908 None] Lock "cinder-quobyte-1ab75039-698a-4920-a39d-bb01a1dc853e" released by "delete_snapshot" :: held 2.152s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:56:31 devstack cinder-volume[88591]: WARNING cinder.quota [None req-8f06ca4f-1ecb-44fa-ac25-b2733c8d3bfe tempest-GroupSnapshotsV319Test-1017587908 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-738952048 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-738952048, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:56:31 devstack cinder-volume[88591]: WARNING cinder.quota [None req-8f06ca4f-1ecb-44fa-ac25-b2733c8d3bfe tempest-GroupSnapshotsV319Test-1017587908 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-738952048 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-738952048, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:56:31 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-8f06ca4f-1ecb-44fa-ac25-b2733c8d3bfe tempest-GroupSnapshotsV319Test-1017587908 None] Created reservations ['306d46c6-74b8-42eb-a17c-457408a0d128', 'b443a46a-cd10-4e41-9517-694309cf36c3', '5ece076c-f901-4d3d-b3b2-f261925c2760', '85675615-49b1-4ba3-bbc8-57bfed8a284e'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:56:32 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-8f06ca4f-1ecb-44fa-ac25-b2733c8d3bfe tempest-GroupSnapshotsV319Test-1017587908 None] group_snapshot 58d4f9bc-e4ae-433b-894c-ba9cbeb11052: deleted successfully Jul 30 16:56:32 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-62cc26d8-74eb-4251-a6f4-918ae7114c0d tempest-VolumeQuotasAdminTestJSON-1677533943 None] Acquiring lock "cinder-8c7dff3f-2ebd-4246-946f-216b9363a14d-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:56:32 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-62cc26d8-74eb-4251-a6f4-918ae7114c0d tempest-VolumeQuotasAdminTestJSON-1677533943 None] Lock "cinder-8c7dff3f-2ebd-4246-946f-216b9363a14d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:56:32 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:SELECT=128,cinder:UPDATE=103,cinder:INSERT=37,cinder:DELETE=5 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:56:32 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-62cc26d8-74eb-4251-a6f4-918ae7114c0d tempest-VolumeQuotasAdminTestJSON-1677533943 None] Acquiring lock "cinder-quobyte-8c7dff3f-2ebd-4246-946f-216b9363a14d" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:56:32 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-62cc26d8-74eb-4251-a6f4-918ae7114c0d tempest-VolumeQuotasAdminTestJSON-1677533943 None] Lock "cinder-quobyte-8c7dff3f-2ebd-4246-946f-216b9363a14d" acquired by "delete_volume" :: waited 0.027s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:56:32 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4bc3050-0e1c-4ecf-b882-e187b2129018]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:56:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-62cc26d8-74eb-4251-a6f4-918ae7114c0d tempest-VolumeQuotasAdminTestJSON-1677533943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c7dff3f-2ebd-4246-946f-216b9363a14d {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:32 devstack sudo[97442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c7dff3f-2ebd-4246-946f-216b9363a14d Jul 30 16:56:32 devstack sudo[97442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:33 devstack sudo[97442]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-62cc26d8-74eb-4251-a6f4-918ae7114c0d tempest-VolumeQuotasAdminTestJSON-1677533943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c7dff3f-2ebd-4246-946f-216b9363a14d" returned: 0 in 0.416s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-62cc26d8-74eb-4251-a6f4-918ae7114c0d tempest-VolumeQuotasAdminTestJSON-1677533943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c7dff3f-2ebd-4246-946f-216b9363a14d {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:33 devstack sudo[97447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c7dff3f-2ebd-4246-946f-216b9363a14d Jul 30 16:56:33 devstack sudo[97447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:33 devstack sudo[97447]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-62cc26d8-74eb-4251-a6f4-918ae7114c0d tempest-VolumeQuotasAdminTestJSON-1677533943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c7dff3f-2ebd-4246-946f-216b9363a14d" returned: 0 in 0.375s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:33 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-62cc26d8-74eb-4251-a6f4-918ae7114c0d tempest-VolumeQuotasAdminTestJSON-1677533943 None] Lock "cinder-quobyte-8c7dff3f-2ebd-4246-946f-216b9363a14d" released by "delete_volume" :: held 0.875s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:56:33 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ef7092dc-66b0-4b02-8d98-1a1390d60dd5 tempest-GroupSnapshotsV319Test-1017587908 None] Acquiring lock "cinder-quobyte-1ab75039-698a-4920-a39d-bb01a1dc853e" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:56:33 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ef7092dc-66b0-4b02-8d98-1a1390d60dd5 tempest-GroupSnapshotsV319Test-1017587908 None] Lock "cinder-quobyte-1ab75039-698a-4920-a39d-bb01a1dc853e" acquired by "delete_volume" :: waited 0.025s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:56:33 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf6babd-b937-44ca-9d72-27cf788566d6]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:56:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ef7092dc-66b0-4b02-8d98-1a1390d60dd5 tempest-GroupSnapshotsV319Test-1017587908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1ab75039-698a-4920-a39d-bb01a1dc853e {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:33 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-62cc26d8-74eb-4251-a6f4-918ae7114c0d tempest-VolumeQuotasAdminTestJSON-1677533943 None] Created reservations ['f299854d-d9aa-47c3-8df1-25fa02e3ad3a', 'd0b5a785-a02c-4502-ac2c-4ca27a153315', 'd2d9ad7d-1e5d-4fdc-85ff-fa4ba355db25', 'd5fca761-ae3c-4872-ad6a-ab447f89ad23'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:56:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-62cc26d8-74eb-4251-a6f4-918ae7114c0d tempest-VolumeQuotasAdminTestJSON-1677533943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-62cc26d8-74eb-4251-a6f4-918ae7114c0d tempest-VolumeQuotasAdminTestJSON-1677533943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:33 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-62cc26d8-74eb-4251-a6f4-918ae7114c0d tempest-VolumeQuotasAdminTestJSON-1677533943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:56:33 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-62cc26d8-74eb-4251-a6f4-918ae7114c0d tempest-VolumeQuotasAdminTestJSON-1677533943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:56:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-62cc26d8-74eb-4251-a6f4-918ae7114c0d tempest-VolumeQuotasAdminTestJSON-1677533943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-62cc26d8-74eb-4251-a6f4-918ae7114c0d tempest-VolumeQuotasAdminTestJSON-1677533943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:33 devstack sudo[97450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1ab75039-698a-4920-a39d-bb01a1dc853e Jul 30 16:56:33 devstack sudo[97450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:33 devstack sudo[97451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:56:33 devstack sudo[97451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:34 devstack sudo[97451]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-62cc26d8-74eb-4251-a6f4-918ae7114c0d tempest-VolumeQuotasAdminTestJSON-1677533943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.377s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:34 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-62cc26d8-74eb-4251-a6f4-918ae7114c0d tempest-VolumeQuotasAdminTestJSON-1677533943 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:56:34 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-62cc26d8-74eb-4251-a6f4-918ae7114c0d tempest-VolumeQuotasAdminTestJSON-1677533943 None] Deleted volume successfully. Jul 30 16:56:34 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-62cc26d8-74eb-4251-a6f4-918ae7114c0d tempest-VolumeQuotasAdminTestJSON-1677533943 None] Lock "cinder-8c7dff3f-2ebd-4246-946f-216b9363a14d-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:56:34 devstack sudo[97450]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ef7092dc-66b0-4b02-8d98-1a1390d60dd5 tempest-GroupSnapshotsV319Test-1017587908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1ab75039-698a-4920-a39d-bb01a1dc853e" returned: 0 in 0.605s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ef7092dc-66b0-4b02-8d98-1a1390d60dd5 tempest-GroupSnapshotsV319Test-1017587908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1ab75039-698a-4920-a39d-bb01a1dc853e {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:34 devstack sudo[97458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1ab75039-698a-4920-a39d-bb01a1dc853e Jul 30 16:56:34 devstack sudo[97458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:34 devstack sudo[97458]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ef7092dc-66b0-4b02-8d98-1a1390d60dd5 tempest-GroupSnapshotsV319Test-1017587908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1ab75039-698a-4920-a39d-bb01a1dc853e" returned: 0 in 0.288s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:34 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ef7092dc-66b0-4b02-8d98-1a1390d60dd5 tempest-GroupSnapshotsV319Test-1017587908 None] Lock "cinder-quobyte-1ab75039-698a-4920-a39d-bb01a1dc853e" released by "delete_volume" :: held 0.982s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:56:34 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-ef7092dc-66b0-4b02-8d98-1a1390d60dd5 tempest-GroupSnapshotsV319Test-1017587908 None] Created reservations ['aa5cc7d1-d0dd-4a86-bb71-c20fe5412492'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:56:34 devstack cinder-volume[88591]: WARNING cinder.quota [None req-ef7092dc-66b0-4b02-8d98-1a1390d60dd5 tempest-GroupSnapshotsV319Test-1017587908 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-738952048 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-738952048, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:56:34 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-ef7092dc-66b0-4b02-8d98-1a1390d60dd5 tempest-GroupSnapshotsV319Test-1017587908 None] Created reservations ['82774578-9eec-479f-bd22-82b1655f76dd', '04ef6caa-4d50-47b6-a958-e906881b3118', '158e65a1-188c-4b42-94b7-14174f428cef', 'e3ce7e75-860f-4e33-9e12-5c63a0a34f28'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:56:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ef7092dc-66b0-4b02-8d98-1a1390d60dd5 tempest-GroupSnapshotsV319Test-1017587908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ef7092dc-66b0-4b02-8d98-1a1390d60dd5 tempest-GroupSnapshotsV319Test-1017587908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:34 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ef7092dc-66b0-4b02-8d98-1a1390d60dd5 tempest-GroupSnapshotsV319Test-1017587908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:56:34 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ef7092dc-66b0-4b02-8d98-1a1390d60dd5 tempest-GroupSnapshotsV319Test-1017587908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:56:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ef7092dc-66b0-4b02-8d98-1a1390d60dd5 tempest-GroupSnapshotsV319Test-1017587908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ef7092dc-66b0-4b02-8d98-1a1390d60dd5 tempest-GroupSnapshotsV319Test-1017587908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:34 devstack sudo[97461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:56:34 devstack sudo[97461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:35 devstack sudo[97461]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ef7092dc-66b0-4b02-8d98-1a1390d60dd5 tempest-GroupSnapshotsV319Test-1017587908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.448s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:35 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-ef7092dc-66b0-4b02-8d98-1a1390d60dd5 tempest-GroupSnapshotsV319Test-1017587908 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:56:35 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-ef7092dc-66b0-4b02-8d98-1a1390d60dd5 tempest-GroupSnapshotsV319Test-1017587908 None] Delete group completed successfully. Jul 30 16:56:44 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:SELECT=13,cinder:INSERT=6,cinder:UPDATE=17,cinder:DELETE=1 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:56:44 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:SELECT=121,cinder:UPDATE=154,cinder:INSERT=23,cinder:DELETE=2 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:56:46 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-385d86e0-ac05-4af4-8ac8-2d84d6f88cd4 tempest-SnapshotsActionsTest-480286487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:56:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-385d86e0-ac05-4af4-8ac8-2d84d6f88cd4 tempest-SnapshotsActionsTest-480286487 None] Flow 'volume_create_manager' (fd672ddf-dc17-4319-8214-bcee9ab738db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:56:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-385d86e0-ac05-4af4-8ac8-2d84d6f88cd4 tempest-SnapshotsActionsTest-480286487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1029de3-8b7f-45c1-9da5-3f3e80f518dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-385d86e0-ac05-4af4-8ac8-2d84d6f88cd4 tempest-SnapshotsActionsTest-480286487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1029de3-8b7f-45c1-9da5-3f3e80f518dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:56:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2118480635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21948154-1938-4f10-8d97-a5c2f2f6ad1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f817d87146794e3a97545518b6c93d8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:56:47Z,use_quota=True,user_id='e395de7d62614937b50ebd13510a39a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-385d86e0-ac05-4af4-8ac8-2d84d6f88cd4 tempest-SnapshotsActionsTest-480286487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2df1262a-91fe-4aee-9261-cf8a28473965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-385d86e0-ac05-4af4-8ac8-2d84d6f88cd4 tempest-SnapshotsActionsTest-480286487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2df1262a-91fe-4aee-9261-cf8a28473965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-385d86e0-ac05-4af4-8ac8-2d84d6f88cd4 tempest-SnapshotsActionsTest-480286487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d42fc7c6-d985-4340-ace1-16b98d61e0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-385d86e0-ac05-4af4-8ac8-2d84d6f88cd4 tempest-SnapshotsActionsTest-480286487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d42fc7c6-d985-4340-ace1-16b98d61e0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21948154-1938-4f10-8d97-a5c2f2f6ad1a', 'volume_name': 'volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-385d86e0-ac05-4af4-8ac8-2d84d6f88cd4 tempest-SnapshotsActionsTest-480286487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ab36623-4ae1-45fc-a75e-e992674ff4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-385d86e0-ac05-4af4-8ac8-2d84d6f88cd4 tempest-SnapshotsActionsTest-480286487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ab36623-4ae1-45fc-a75e-e992674ff4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-385d86e0-ac05-4af4-8ac8-2d84d6f88cd4 tempest-SnapshotsActionsTest-480286487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96d47f08-d7df-40a2-9415-d723621ca555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:47 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-385d86e0-ac05-4af4-8ac8-2d84d6f88cd4 tempest-SnapshotsActionsTest-480286487 None] Volume 21948154-1938-4f10-8d97-a5c2f2f6ad1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a', 'volume_size': 1} Jul 30 16:56:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-385d86e0-ac05-4af4-8ac8-2d84d6f88cd4 tempest-SnapshotsActionsTest-480286487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-385d86e0-ac05-4af4-8ac8-2d84d6f88cd4 tempest-SnapshotsActionsTest-480286487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:47 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-385d86e0-ac05-4af4-8ac8-2d84d6f88cd4 tempest-SnapshotsActionsTest-480286487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:56:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2118480635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21948154-1938-4f10-8d97-a5c2f2f6ad1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f817d87146794e3a97545518b6c93d8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:56:47Z,use_quota=True,user_id='e395de7d62614937b50ebd13510a39a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:56:47 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-385d86e0-ac05-4af4-8ac8-2d84d6f88cd4 tempest-SnapshotsActionsTest-480286487 None] Creating volume 21948154-1938-4f10-8d97-a5c2f2f6ad1a {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:56:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-385d86e0-ac05-4af4-8ac8-2d84d6f88cd4 tempest-SnapshotsActionsTest-480286487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-385d86e0-ac05-4af4-8ac8-2d84d6f88cd4 tempest-SnapshotsActionsTest-480286487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:47 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-385d86e0-ac05-4af4-8ac8-2d84d6f88cd4 tempest-SnapshotsActionsTest-480286487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:56:47 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-385d86e0-ac05-4af4-8ac8-2d84d6f88cd4 tempest-SnapshotsActionsTest-480286487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:56:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-385d86e0-ac05-4af4-8ac8-2d84d6f88cd4 tempest-SnapshotsActionsTest-480286487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:47 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-385d86e0-ac05-4af4-8ac8-2d84d6f88cd4 tempest-SnapshotsActionsTest-480286487 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:56:47 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-385d86e0-ac05-4af4-8ac8-2d84d6f88cd4 tempest-SnapshotsActionsTest-480286487 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:56:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-385d86e0-ac05-4af4-8ac8-2d84d6f88cd4 tempest-SnapshotsActionsTest-480286487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:47 devstack sudo[97617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a 1073741824 Jul 30 16:56:47 devstack sudo[97617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:47 devstack sudo[97617]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-385d86e0-ac05-4af4-8ac8-2d84d6f88cd4 tempest-SnapshotsActionsTest-480286487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a 1073741824" returned: 0 in 0.747s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-385d86e0-ac05-4af4-8ac8-2d84d6f88cd4 tempest-SnapshotsActionsTest-480286487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:48 devstack sudo[97633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a Jul 30 16:56:48 devstack sudo[97633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:48 devstack sudo[97633]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-385d86e0-ac05-4af4-8ac8-2d84d6f88cd4 tempest-SnapshotsActionsTest-480286487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a" returned: 0 in 0.430s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:48 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-385d86e0-ac05-4af4-8ac8-2d84d6f88cd4 tempest-SnapshotsActionsTest-480286487 None] <== create_volume: return (1410ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:56:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-385d86e0-ac05-4af4-8ac8-2d84d6f88cd4 tempest-SnapshotsActionsTest-480286487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.416s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:48 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-385d86e0-ac05-4af4-8ac8-2d84d6f88cd4 tempest-SnapshotsActionsTest-480286487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96d47f08-d7df-40a2-9415-d723621ca555) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:48 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-385d86e0-ac05-4af4-8ac8-2d84d6f88cd4 tempest-SnapshotsActionsTest-480286487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf448728-37ce-4418-aa73-162c99800e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:48 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-385d86e0-ac05-4af4-8ac8-2d84d6f88cd4 tempest-SnapshotsActionsTest-480286487 None] Volume volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a (21948154-1938-4f10-8d97-a5c2f2f6ad1a): created successfully Jul 30 16:56:48 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-385d86e0-ac05-4af4-8ac8-2d84d6f88cd4 tempest-SnapshotsActionsTest-480286487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf448728-37ce-4418-aa73-162c99800e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:48 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-385d86e0-ac05-4af4-8ac8-2d84d6f88cd4 tempest-SnapshotsActionsTest-480286487 None] Flow 'volume_create_manager' (fd672ddf-dc17-4319-8214-bcee9ab738db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:56:48 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-385d86e0-ac05-4af4-8ac8-2d84d6f88cd4 tempest-SnapshotsActionsTest-480286487 None] Created volume successfully. Jul 30 16:56:49 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-9daaa10f-95cf-4a88-8de4-a90230447927 tempest-VolumeQuotasNegativeTestJSON-1823244323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:56:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-9daaa10f-95cf-4a88-8de4-a90230447927 tempest-VolumeQuotasNegativeTestJSON-1823244323 None] Flow 'volume_create_manager' (336de723-e560-4517-becc-8f52cffe332d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:56:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-9daaa10f-95cf-4a88-8de4-a90230447927 tempest-VolumeQuotasNegativeTestJSON-1823244323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (857ab9a1-c214-4389-837c-f99ade582ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-9daaa10f-95cf-4a88-8de4-a90230447927 tempest-VolumeQuotasNegativeTestJSON-1823244323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (857ab9a1-c214-4389-837c-f99ade582ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2071645202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65087bfe-d38e-4c82-9317-760c68f2f194,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d91e0310313443dd8c289a3aadf7b733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:56:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:56:49Z,use_quota=True,user_id='e7ad3dfb00734ffbb8dd1d8e16bb0d64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-9daaa10f-95cf-4a88-8de4-a90230447927 tempest-VolumeQuotasNegativeTestJSON-1823244323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55a7efb4-6013-415d-a43d-34a988d1c7a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-9daaa10f-95cf-4a88-8de4-a90230447927 tempest-VolumeQuotasNegativeTestJSON-1823244323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55a7efb4-6013-415d-a43d-34a988d1c7a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-9daaa10f-95cf-4a88-8de4-a90230447927 tempest-VolumeQuotasNegativeTestJSON-1823244323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c54ec74d-b207-453e-8027-413299d8ef83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-9daaa10f-95cf-4a88-8de4-a90230447927 tempest-VolumeQuotasNegativeTestJSON-1823244323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c54ec74d-b207-453e-8027-413299d8ef83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65087bfe-d38e-4c82-9317-760c68f2f194', 'volume_name': 'volume-65087bfe-d38e-4c82-9317-760c68f2f194', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-9daaa10f-95cf-4a88-8de4-a90230447927 tempest-VolumeQuotasNegativeTestJSON-1823244323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd1c7621-aaf3-41e8-82ee-1f01f2491afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-9daaa10f-95cf-4a88-8de4-a90230447927 tempest-VolumeQuotasNegativeTestJSON-1823244323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd1c7621-aaf3-41e8-82ee-1f01f2491afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-9daaa10f-95cf-4a88-8de4-a90230447927 tempest-VolumeQuotasNegativeTestJSON-1823244323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4048388f-07a7-4091-aa35-0a2b7553dd5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:49 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-9daaa10f-95cf-4a88-8de4-a90230447927 tempest-VolumeQuotasNegativeTestJSON-1823244323 None] Volume 65087bfe-d38e-4c82-9317-760c68f2f194: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65087bfe-d38e-4c82-9317-760c68f2f194', 'volume_size': 1} Jul 30 16:56:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-9daaa10f-95cf-4a88-8de4-a90230447927 tempest-VolumeQuotasNegativeTestJSON-1823244323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-9daaa10f-95cf-4a88-8de4-a90230447927 tempest-VolumeQuotasNegativeTestJSON-1823244323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:49 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-9daaa10f-95cf-4a88-8de4-a90230447927 tempest-VolumeQuotasNegativeTestJSON-1823244323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2071645202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65087bfe-d38e-4c82-9317-760c68f2f194,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d91e0310313443dd8c289a3aadf7b733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:56:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:56:49Z,use_quota=True,user_id='e7ad3dfb00734ffbb8dd1d8e16bb0d64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:56:49 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-9daaa10f-95cf-4a88-8de4-a90230447927 tempest-VolumeQuotasNegativeTestJSON-1823244323 None] Creating volume 65087bfe-d38e-4c82-9317-760c68f2f194 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:56:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-9daaa10f-95cf-4a88-8de4-a90230447927 tempest-VolumeQuotasNegativeTestJSON-1823244323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-9daaa10f-95cf-4a88-8de4-a90230447927 tempest-VolumeQuotasNegativeTestJSON-1823244323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:49 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-9daaa10f-95cf-4a88-8de4-a90230447927 tempest-VolumeQuotasNegativeTestJSON-1823244323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:56:49 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-9daaa10f-95cf-4a88-8de4-a90230447927 tempest-VolumeQuotasNegativeTestJSON-1823244323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:56:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-9daaa10f-95cf-4a88-8de4-a90230447927 tempest-VolumeQuotasNegativeTestJSON-1823244323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:49 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-9daaa10f-95cf-4a88-8de4-a90230447927 tempest-VolumeQuotasNegativeTestJSON-1823244323 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:56:49 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-9daaa10f-95cf-4a88-8de4-a90230447927 tempest-VolumeQuotasNegativeTestJSON-1823244323 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:56:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9daaa10f-95cf-4a88-8de4-a90230447927 tempest-VolumeQuotasNegativeTestJSON-1823244323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-65087bfe-d38e-4c82-9317-760c68f2f194 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:49 devstack sudo[97636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-65087bfe-d38e-4c82-9317-760c68f2f194 1073741824 Jul 30 16:56:49 devstack sudo[97636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-dddae65c-2c24-41f7-9e2f-9f98a93276be tempest-SnapshotsActionsTest-480286487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:49 devstack sudo[97636]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9daaa10f-95cf-4a88-8de4-a90230447927 tempest-VolumeQuotasNegativeTestJSON-1823244323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-65087bfe-d38e-4c82-9317-760c68f2f194 1073741824" returned: 0 in 0.732s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9daaa10f-95cf-4a88-8de4-a90230447927 tempest-VolumeQuotasNegativeTestJSON-1823244323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-65087bfe-d38e-4c82-9317-760c68f2f194 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:50 devstack sudo[97648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-65087bfe-d38e-4c82-9317-760c68f2f194 Jul 30 16:56:50 devstack sudo[97648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:50 devstack sudo[97648]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9daaa10f-95cf-4a88-8de4-a90230447927 tempest-VolumeQuotasNegativeTestJSON-1823244323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-65087bfe-d38e-4c82-9317-760c68f2f194" returned: 0 in 0.350s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:50 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-9daaa10f-95cf-4a88-8de4-a90230447927 tempest-VolumeQuotasNegativeTestJSON-1823244323 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:56:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-9daaa10f-95cf-4a88-8de4-a90230447927 tempest-VolumeQuotasNegativeTestJSON-1823244323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-dddae65c-2c24-41f7-9e2f-9f98a93276be tempest-SnapshotsActionsTest-480286487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.694s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:50 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-dddae65c-2c24-41f7-9e2f-9f98a93276be tempest-SnapshotsActionsTest-480286487 None] Creating offline snapshot 3d1a3634-f80a-410c-98c5-ceda6722caa9 of volume 21948154-1938-4f10-8d97-a5c2f2f6ad1a {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:56:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-9daaa10f-95cf-4a88-8de4-a90230447927 tempest-VolumeQuotasNegativeTestJSON-1823244323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4048388f-07a7-4091-aa35-0a2b7553dd5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65087bfe-d38e-4c82-9317-760c68f2f194', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-9daaa10f-95cf-4a88-8de4-a90230447927 tempest-VolumeQuotasNegativeTestJSON-1823244323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d274fe8-a5b4-48e8-ae58-714d9a647505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:56:50 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6dd234-3588-40b7-a867-fa38c2c610e5]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:56:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dddae65c-2c24-41f7-9e2f-9f98a93276be tempest-SnapshotsActionsTest-480286487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:50 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-9daaa10f-95cf-4a88-8de4-a90230447927 tempest-VolumeQuotasNegativeTestJSON-1823244323 None] Volume volume-65087bfe-d38e-4c82-9317-760c68f2f194 (65087bfe-d38e-4c82-9317-760c68f2f194): created successfully Jul 30 16:56:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-9daaa10f-95cf-4a88-8de4-a90230447927 tempest-VolumeQuotasNegativeTestJSON-1823244323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d274fe8-a5b4-48e8-ae58-714d9a647505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:56:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-9daaa10f-95cf-4a88-8de4-a90230447927 tempest-VolumeQuotasNegativeTestJSON-1823244323 None] Flow 'volume_create_manager' (336de723-e560-4517-becc-8f52cffe332d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:56:50 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-9daaa10f-95cf-4a88-8de4-a90230447927 tempest-VolumeQuotasNegativeTestJSON-1823244323 None] Created volume successfully. Jul 30 16:56:50 devstack sudo[97651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a Jul 30 16:56:50 devstack sudo[97651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:50 devstack sudo[97651]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dddae65c-2c24-41f7-9e2f-9f98a93276be tempest-SnapshotsActionsTest-480286487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a" returned: 0 in 0.473s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dddae65c-2c24-41f7-9e2f-9f98a93276be tempest-SnapshotsActionsTest-480286487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:50 devstack sudo[97656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9 1G Jul 30 16:56:50 devstack sudo[97656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:51 devstack sudo[97656]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dddae65c-2c24-41f7-9e2f-9f98a93276be tempest-SnapshotsActionsTest-480286487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9 1G" returned: 0 in 0.699s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dddae65c-2c24-41f7-9e2f-9f98a93276be tempest-SnapshotsActionsTest-480286487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:51 devstack sudo[97662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9 Jul 30 16:56:51 devstack sudo[97662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:52 devstack sudo[97662]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dddae65c-2c24-41f7-9e2f-9f98a93276be tempest-SnapshotsActionsTest-480286487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9" returned: 0 in 0.520s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:52 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-dddae65c-2c24-41f7-9e2f-9f98a93276be tempest-SnapshotsActionsTest-480286487 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9 is being set with open permissions: ugo+rw Jul 30 16:56:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dddae65c-2c24-41f7-9e2f-9f98a93276be tempest-SnapshotsActionsTest-480286487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:52 devstack sudo[97668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9 Jul 30 16:56:52 devstack sudo[97668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:52 devstack sudo[97668]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dddae65c-2c24-41f7-9e2f-9f98a93276be tempest-SnapshotsActionsTest-480286487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9" returned: 0 in 0.354s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dddae65c-2c24-41f7-9e2f-9f98a93276be tempest-SnapshotsActionsTest-480286487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:52 devstack sudo[97671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.info Jul 30 16:56:52 devstack sudo[97671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:52 devstack sudo[97671]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:52 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7c6f871c-e85d-4fde-a2b0-445daaa4454d tempest-VolumeQuotasNegativeTestJSON-1823244323 None] Acquiring lock "cinder-65087bfe-d38e-4c82-9317-760c68f2f194-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:56:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dddae65c-2c24-41f7-9e2f-9f98a93276be tempest-SnapshotsActionsTest-480286487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.info" returned: 0 in 0.445s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:52 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-dddae65c-2c24-41f7-9e2f-9f98a93276be tempest-SnapshotsActionsTest-480286487 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.info is being set with open permissions: ugo+rw Jul 30 16:56:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dddae65c-2c24-41f7-9e2f-9f98a93276be tempest-SnapshotsActionsTest-480286487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:53 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7c6f871c-e85d-4fde-a2b0-445daaa4454d tempest-VolumeQuotasNegativeTestJSON-1823244323 None] Lock "cinder-65087bfe-d38e-4c82-9317-760c68f2f194-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:56:53 devstack sudo[97675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.info Jul 30 16:56:53 devstack sudo[97675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:53 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7c6f871c-e85d-4fde-a2b0-445daaa4454d tempest-VolumeQuotasNegativeTestJSON-1823244323 None] Acquiring lock "cinder-quobyte-65087bfe-d38e-4c82-9317-760c68f2f194" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:56:53 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7c6f871c-e85d-4fde-a2b0-445daaa4454d tempest-VolumeQuotasNegativeTestJSON-1823244323 None] Lock "cinder-quobyte-65087bfe-d38e-4c82-9317-760c68f2f194" acquired by "delete_volume" :: waited 0.028s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:56:53 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ce4bdc-efb2-4f92-b254-959585e4b4bd]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:56:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7c6f871c-e85d-4fde-a2b0-445daaa4454d tempest-VolumeQuotasNegativeTestJSON-1823244323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-65087bfe-d38e-4c82-9317-760c68f2f194 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:53 devstack sudo[97678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-65087bfe-d38e-4c82-9317-760c68f2f194 Jul 30 16:56:53 devstack sudo[97678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:53 devstack sudo[97675]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dddae65c-2c24-41f7-9e2f-9f98a93276be tempest-SnapshotsActionsTest-480286487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.info" returned: 0 in 0.334s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-dddae65c-2c24-41f7-9e2f-9f98a93276be tempest-SnapshotsActionsTest-480286487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.948s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:53 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-dddae65c-2c24-41f7-9e2f-9f98a93276be tempest-SnapshotsActionsTest-480286487 None] Create snapshot completed successfully Jul 30 16:56:53 devstack sudo[97678]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7c6f871c-e85d-4fde-a2b0-445daaa4454d tempest-VolumeQuotasNegativeTestJSON-1823244323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-65087bfe-d38e-4c82-9317-760c68f2f194" returned: 0 in 0.420s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7c6f871c-e85d-4fde-a2b0-445daaa4454d tempest-VolumeQuotasNegativeTestJSON-1823244323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-65087bfe-d38e-4c82-9317-760c68f2f194 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:53 devstack sudo[97684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-65087bfe-d38e-4c82-9317-760c68f2f194 Jul 30 16:56:53 devstack sudo[97684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:53 devstack sudo[97684]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7c6f871c-e85d-4fde-a2b0-445daaa4454d tempest-VolumeQuotasNegativeTestJSON-1823244323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-65087bfe-d38e-4c82-9317-760c68f2f194" returned: 0 in 0.287s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:53 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7c6f871c-e85d-4fde-a2b0-445daaa4454d tempest-VolumeQuotasNegativeTestJSON-1823244323 None] Lock "cinder-quobyte-65087bfe-d38e-4c82-9317-760c68f2f194" released by "delete_volume" :: held 0.773s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:56:53 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-7c6f871c-e85d-4fde-a2b0-445daaa4454d tempest-VolumeQuotasNegativeTestJSON-1823244323 None] Created reservations ['4f22a1fb-f024-480c-80bb-f6100e00677c', '7e610e74-fad4-47d5-9490-9fcd53cc451d', '337d4e8e-b184-4f03-a5d0-29d2cd9dac5d', '27ca2a02-4550-4ef8-8050-00575fa9fb9a'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:56:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7c6f871c-e85d-4fde-a2b0-445daaa4454d tempest-VolumeQuotasNegativeTestJSON-1823244323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7c6f871c-e85d-4fde-a2b0-445daaa4454d tempest-VolumeQuotasNegativeTestJSON-1823244323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:54 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7c6f871c-e85d-4fde-a2b0-445daaa4454d tempest-VolumeQuotasNegativeTestJSON-1823244323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:56:54 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7c6f871c-e85d-4fde-a2b0-445daaa4454d tempest-VolumeQuotasNegativeTestJSON-1823244323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:56:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7c6f871c-e85d-4fde-a2b0-445daaa4454d tempest-VolumeQuotasNegativeTestJSON-1823244323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7c6f871c-e85d-4fde-a2b0-445daaa4454d tempest-VolumeQuotasNegativeTestJSON-1823244323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:54 devstack sudo[97687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:56:54 devstack sudo[97687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:54 devstack sudo[97687]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7c6f871c-e85d-4fde-a2b0-445daaa4454d tempest-VolumeQuotasNegativeTestJSON-1823244323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.341s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:54 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-7c6f871c-e85d-4fde-a2b0-445daaa4454d tempest-VolumeQuotasNegativeTestJSON-1823244323 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:56:54 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-7c6f871c-e85d-4fde-a2b0-445daaa4454d tempest-VolumeQuotasNegativeTestJSON-1823244323 None] Deleted volume successfully. Jul 30 16:56:54 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7c6f871c-e85d-4fde-a2b0-445daaa4454d tempest-VolumeQuotasNegativeTestJSON-1823244323 None] Lock "cinder-65087bfe-d38e-4c82-9317-760c68f2f194-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:56:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-20b90e69-ba8d-4967-923d-f55a752f69ac tempest-SnapshotsActionsTest-480286487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-20b90e69-ba8d-4967-923d-f55a752f69ac tempest-SnapshotsActionsTest-480286487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:54 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-20b90e69-ba8d-4967-923d-f55a752f69ac tempest-SnapshotsActionsTest-480286487 None] Creating offline snapshot 0d4fb906-f535-4c10-ba2a-b3b1f331d3bf of volume 21948154-1938-4f10-8d97-a5c2f2f6ad1a {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:56:54 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6cbdf5-e0da-4de4-af86-aec98484d9b6]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:56:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-20b90e69-ba8d-4967-923d-f55a752f69ac tempest-SnapshotsActionsTest-480286487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:54 devstack sudo[97690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9 Jul 30 16:56:54 devstack sudo[97690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:55 devstack sudo[97690]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-20b90e69-ba8d-4967-923d-f55a752f69ac tempest-SnapshotsActionsTest-480286487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9" returned: 0 in 0.449s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:55 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-20b90e69-ba8d-4967-923d-f55a752f69ac tempest-SnapshotsActionsTest-480286487 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:56:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-20b90e69-ba8d-4967-923d-f55a752f69ac tempest-SnapshotsActionsTest-480286487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.0d4fb906-f535-4c10-ba2a-b3b1f331d3bf 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:55 devstack sudo[97695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.0d4fb906-f535-4c10-ba2a-b3b1f331d3bf 1G Jul 30 16:56:55 devstack sudo[97695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:55 devstack sudo[97695]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-20b90e69-ba8d-4967-923d-f55a752f69ac tempest-SnapshotsActionsTest-480286487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.0d4fb906-f535-4c10-ba2a-b3b1f331d3bf 1G" returned: 0 in 0.678s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-20b90e69-ba8d-4967-923d-f55a752f69ac tempest-SnapshotsActionsTest-480286487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.0d4fb906-f535-4c10-ba2a-b3b1f331d3bf {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:55 devstack sudo[97701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.0d4fb906-f535-4c10-ba2a-b3b1f331d3bf Jul 30 16:56:55 devstack sudo[97701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:56 devstack sudo[97701]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-20b90e69-ba8d-4967-923d-f55a752f69ac tempest-SnapshotsActionsTest-480286487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.0d4fb906-f535-4c10-ba2a-b3b1f331d3bf" returned: 0 in 0.392s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:56 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-20b90e69-ba8d-4967-923d-f55a752f69ac tempest-SnapshotsActionsTest-480286487 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.0d4fb906-f535-4c10-ba2a-b3b1f331d3bf is being set with open permissions: ugo+rw Jul 30 16:56:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-20b90e69-ba8d-4967-923d-f55a752f69ac tempest-SnapshotsActionsTest-480286487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.0d4fb906-f535-4c10-ba2a-b3b1f331d3bf {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:56 devstack sudo[97706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.0d4fb906-f535-4c10-ba2a-b3b1f331d3bf Jul 30 16:56:56 devstack sudo[97706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:56 devstack sudo[97706]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-20b90e69-ba8d-4967-923d-f55a752f69ac tempest-SnapshotsActionsTest-480286487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.0d4fb906-f535-4c10-ba2a-b3b1f331d3bf" returned: 0 in 0.299s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-20b90e69-ba8d-4967-923d-f55a752f69ac tempest-SnapshotsActionsTest-480286487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.974s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:56 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-20b90e69-ba8d-4967-923d-f55a752f69ac tempest-SnapshotsActionsTest-480286487 None] Create snapshot completed successfully Jul 30 16:56:56 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-db39340a-9cad-4ce2-baa4-6c938e2fdfd3 tempest-SnapshotsActionsTest-464999979 None] Acquiring lock "cinder-0d4fb906-f535-4c10-ba2a-b3b1f331d3bf-delete_snapshot" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:56:56 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-db39340a-9cad-4ce2-baa4-6c938e2fdfd3 tempest-SnapshotsActionsTest-464999979 None] Lock "cinder-0d4fb906-f535-4c10-ba2a-b3b1f331d3bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:56:56 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-db39340a-9cad-4ce2-baa4-6c938e2fdfd3 tempest-SnapshotsActionsTest-464999979 None] Acquiring lock "cinder-quobyte-21948154-1938-4f10-8d97-a5c2f2f6ad1a" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:56:56 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-db39340a-9cad-4ce2-baa4-6c938e2fdfd3 tempest-SnapshotsActionsTest-464999979 None] Lock "cinder-quobyte-21948154-1938-4f10-8d97-a5c2f2f6ad1a" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:56:56 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-db39340a-9cad-4ce2-baa4-6c938e2fdfd3 tempest-SnapshotsActionsTest-464999979 None] Acquiring lock "cinder-quobyte-0d4fb906-f535-4c10-ba2a-b3b1f331d3bf" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:56:57 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-db39340a-9cad-4ce2-baa4-6c938e2fdfd3 tempest-SnapshotsActionsTest-464999979 None] Lock "cinder-quobyte-0d4fb906-f535-4c10-ba2a-b3b1f331d3bf" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:56:57 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-db39340a-9cad-4ce2-baa4-6c938e2fdfd3 tempest-SnapshotsActionsTest-464999979 None] Deleting offline snapshot 0d4fb906-f535-4c10-ba2a-b3b1f331d3bf of volume 21948154-1938-4f10-8d97-a5c2f2f6ad1a {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:56:57 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-db39340a-9cad-4ce2-baa4-6c938e2fdfd3 tempest-SnapshotsActionsTest-464999979 None] snapshot_file for this snap is: volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.0d4fb906-f535-4c10-ba2a-b3b1f331d3bf {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:56:57 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd995b4-9fcf-4ceb-abad-17acda73c08b]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:56:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-db39340a-9cad-4ce2-baa4-6c938e2fdfd3 tempest-SnapshotsActionsTest-464999979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.0d4fb906-f535-4c10-ba2a-b3b1f331d3bf {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:57 devstack sudo[97709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.0d4fb906-f535-4c10-ba2a-b3b1f331d3bf Jul 30 16:56:57 devstack sudo[97709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:57 devstack sudo[97709]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-db39340a-9cad-4ce2-baa4-6c938e2fdfd3 tempest-SnapshotsActionsTest-464999979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.0d4fb906-f535-4c10-ba2a-b3b1f331d3bf" returned: 0 in 0.441s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:57 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-db39340a-9cad-4ce2-baa4-6c938e2fdfd3 tempest-SnapshotsActionsTest-464999979 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:56:57 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53021e0-bcfc-4956-8036-a6f14c6bb0d9]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:56:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-db39340a-9cad-4ce2-baa4-6c938e2fdfd3 tempest-SnapshotsActionsTest-464999979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:57 devstack sudo[97714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9 Jul 30 16:56:57 devstack sudo[97714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:57 devstack sudo[97714]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-db39340a-9cad-4ce2-baa4-6c938e2fdfd3 tempest-SnapshotsActionsTest-464999979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9" returned: 0 in 0.464s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:58 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-db39340a-9cad-4ce2-baa4-6c938e2fdfd3 tempest-SnapshotsActionsTest-464999979 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:56:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-db39340a-9cad-4ce2-baa4-6c938e2fdfd3 tempest-SnapshotsActionsTest-464999979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.0d4fb906-f535-4c10-ba2a-b3b1f331d3bf {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:58 devstack sudo[97719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.0d4fb906-f535-4c10-ba2a-b3b1f331d3bf Jul 30 16:56:58 devstack sudo[97719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:58 devstack sudo[97719]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-db39340a-9cad-4ce2-baa4-6c938e2fdfd3 tempest-SnapshotsActionsTest-464999979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.0d4fb906-f535-4c10-ba2a-b3b1f331d3bf" returned: 0 in 0.459s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-db39340a-9cad-4ce2-baa4-6c938e2fdfd3 tempest-SnapshotsActionsTest-464999979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.0d4fb906-f535-4c10-ba2a-b3b1f331d3bf {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:58 devstack sudo[97725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.0d4fb906-f535-4c10-ba2a-b3b1f331d3bf Jul 30 16:56:58 devstack sudo[97725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:58 devstack sudo[97725]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-db39340a-9cad-4ce2-baa4-6c938e2fdfd3 tempest-SnapshotsActionsTest-464999979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.0d4fb906-f535-4c10-ba2a-b3b1f331d3bf" returned: 0 in 0.350s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:58 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-db39340a-9cad-4ce2-baa4-6c938e2fdfd3 tempest-SnapshotsActionsTest-464999979 None] Lock "cinder-quobyte-0d4fb906-f535-4c10-ba2a-b3b1f331d3bf" released by "_delete_snapshot" :: held 1.856s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:56:58 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-db39340a-9cad-4ce2-baa4-6c938e2fdfd3 tempest-SnapshotsActionsTest-464999979 None] Lock "cinder-quobyte-21948154-1938-4f10-8d97-a5c2f2f6ad1a" released by "delete_snapshot" :: held 1.888s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:56:58 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-db39340a-9cad-4ce2-baa4-6c938e2fdfd3 tempest-SnapshotsActionsTest-464999979 None] Created reservations ['0b80ea21-417c-4d9f-af04-ced1033861b7', '49d882d5-10c0-42bc-99ab-cd988b38be9b', '2f37e8b2-a3df-49dc-a9c9-b2e1418275a0', '248c4927-c8ab-4553-8c7a-f32d7bf1bf8f'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:56:59 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-db39340a-9cad-4ce2-baa4-6c938e2fdfd3 tempest-SnapshotsActionsTest-464999979 None] Delete snapshot completed successfully. Jul 30 16:56:59 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-db39340a-9cad-4ce2-baa4-6c938e2fdfd3 tempest-SnapshotsActionsTest-464999979 None] Lock "cinder-0d4fb906-f535-4c10-ba2a-b3b1f331d3bf-delete_snapshot" released by "delete_snapshot" :: held 2.071s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:56:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5e8e01bd-36dd-400c-a020-8b97218dc698 tempest-SnapshotsActionsTest-480286487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5e8e01bd-36dd-400c-a020-8b97218dc698 tempest-SnapshotsActionsTest-480286487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:59 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-5e8e01bd-36dd-400c-a020-8b97218dc698 tempest-SnapshotsActionsTest-480286487 None] Creating offline snapshot 69804c42-f179-402c-a980-34bc53db27d7 of volume 21948154-1938-4f10-8d97-a5c2f2f6ad1a {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:56:59 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8536fd-ddb8-49a7-b4fe-92a97431958d]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:56:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5e8e01bd-36dd-400c-a020-8b97218dc698 tempest-SnapshotsActionsTest-480286487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:59 devstack sudo[97728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9 Jul 30 16:56:59 devstack sudo[97728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:00 devstack sudo[97728]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5e8e01bd-36dd-400c-a020-8b97218dc698 tempest-SnapshotsActionsTest-480286487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9" returned: 0 in 0.556s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:00 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-5e8e01bd-36dd-400c-a020-8b97218dc698 tempest-SnapshotsActionsTest-480286487 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:57:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5e8e01bd-36dd-400c-a020-8b97218dc698 tempest-SnapshotsActionsTest-480286487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.69804c42-f179-402c-a980-34bc53db27d7 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:00 devstack sudo[97733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.69804c42-f179-402c-a980-34bc53db27d7 1G Jul 30 16:57:00 devstack sudo[97733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:00 devstack sudo[97733]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5e8e01bd-36dd-400c-a020-8b97218dc698 tempest-SnapshotsActionsTest-480286487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.69804c42-f179-402c-a980-34bc53db27d7 1G" returned: 0 in 0.663s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5e8e01bd-36dd-400c-a020-8b97218dc698 tempest-SnapshotsActionsTest-480286487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.69804c42-f179-402c-a980-34bc53db27d7 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:00 devstack sudo[97739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.69804c42-f179-402c-a980-34bc53db27d7 Jul 30 16:57:00 devstack sudo[97739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:01 devstack sudo[97739]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5e8e01bd-36dd-400c-a020-8b97218dc698 tempest-SnapshotsActionsTest-480286487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.69804c42-f179-402c-a980-34bc53db27d7" returned: 0 in 0.324s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:01 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-5e8e01bd-36dd-400c-a020-8b97218dc698 tempest-SnapshotsActionsTest-480286487 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.69804c42-f179-402c-a980-34bc53db27d7 is being set with open permissions: ugo+rw Jul 30 16:57:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5e8e01bd-36dd-400c-a020-8b97218dc698 tempest-SnapshotsActionsTest-480286487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.69804c42-f179-402c-a980-34bc53db27d7 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:01 devstack sudo[97745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.69804c42-f179-402c-a980-34bc53db27d7 Jul 30 16:57:01 devstack sudo[97745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:01 devstack sudo[97745]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5e8e01bd-36dd-400c-a020-8b97218dc698 tempest-SnapshotsActionsTest-480286487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.69804c42-f179-402c-a980-34bc53db27d7" returned: 0 in 0.276s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5e8e01bd-36dd-400c-a020-8b97218dc698 tempest-SnapshotsActionsTest-480286487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.982s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:01 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-5e8e01bd-36dd-400c-a020-8b97218dc698 tempest-SnapshotsActionsTest-480286487 None] Create snapshot completed successfully Jul 30 16:57:01 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-52b6b283-d387-4472-9585-8268d3ac767f tempest-VolumesServicesTestJSON-176193917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:57:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-52b6b283-d387-4472-9585-8268d3ac767f tempest-VolumesServicesTestJSON-176193917 None] Flow 'volume_create_manager' (7f95eac1-f79f-4300-93b5-137beb8b48aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:57:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-52b6b283-d387-4472-9585-8268d3ac767f tempest-VolumesServicesTestJSON-176193917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (500cdf3b-907d-4e9e-b490-b1c1e777a60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-52b6b283-d387-4472-9585-8268d3ac767f tempest-VolumesServicesTestJSON-176193917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (500cdf3b-907d-4e9e-b490-b1c1e777a60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2111574857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=794e9fc3-ff24-4619-b5ad-f94e4e025438,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15f3fbbfd30940cf90fc0d9cd0c7c0ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:57:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:57:02Z,use_quota=True,user_id='ddc3fb57e67049be8faf3572aeadca86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-52b6b283-d387-4472-9585-8268d3ac767f tempest-VolumesServicesTestJSON-176193917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b3e3b85-dd9a-4620-9729-b7d0090658a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-52b6b283-d387-4472-9585-8268d3ac767f tempest-VolumesServicesTestJSON-176193917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b3e3b85-dd9a-4620-9729-b7d0090658a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-52b6b283-d387-4472-9585-8268d3ac767f tempest-VolumesServicesTestJSON-176193917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a36fffd-0a98-4366-bef8-f08e7ce7cc85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-52b6b283-d387-4472-9585-8268d3ac767f tempest-VolumesServicesTestJSON-176193917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a36fffd-0a98-4366-bef8-f08e7ce7cc85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '794e9fc3-ff24-4619-b5ad-f94e4e025438', 'volume_name': 'volume-794e9fc3-ff24-4619-b5ad-f94e4e025438', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-52b6b283-d387-4472-9585-8268d3ac767f tempest-VolumesServicesTestJSON-176193917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42723b2e-4e4c-4129-850f-a649caad8558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-52b6b283-d387-4472-9585-8268d3ac767f tempest-VolumesServicesTestJSON-176193917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42723b2e-4e4c-4129-850f-a649caad8558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-52b6b283-d387-4472-9585-8268d3ac767f tempest-VolumesServicesTestJSON-176193917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d94132a-af1a-4a6a-9060-34265bb6c9d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:01 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-52b6b283-d387-4472-9585-8268d3ac767f tempest-VolumesServicesTestJSON-176193917 None] Volume 794e9fc3-ff24-4619-b5ad-f94e4e025438: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-794e9fc3-ff24-4619-b5ad-f94e4e025438', 'volume_size': 1} Jul 30 16:57:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-52b6b283-d387-4472-9585-8268d3ac767f tempest-VolumesServicesTestJSON-176193917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-52b6b283-d387-4472-9585-8268d3ac767f tempest-VolumesServicesTestJSON-176193917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:01 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-52b6b283-d387-4472-9585-8268d3ac767f tempest-VolumesServicesTestJSON-176193917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2111574857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=794e9fc3-ff24-4619-b5ad-f94e4e025438,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15f3fbbfd30940cf90fc0d9cd0c7c0ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:57:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:57:02Z,use_quota=True,user_id='ddc3fb57e67049be8faf3572aeadca86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:57:01 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-52b6b283-d387-4472-9585-8268d3ac767f tempest-VolumesServicesTestJSON-176193917 None] Creating volume 794e9fc3-ff24-4619-b5ad-f94e4e025438 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:57:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-52b6b283-d387-4472-9585-8268d3ac767f tempest-VolumesServicesTestJSON-176193917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-52b6b283-d387-4472-9585-8268d3ac767f tempest-VolumesServicesTestJSON-176193917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:01 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-52b6b283-d387-4472-9585-8268d3ac767f tempest-VolumesServicesTestJSON-176193917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:57:01 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-52b6b283-d387-4472-9585-8268d3ac767f tempest-VolumesServicesTestJSON-176193917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:57:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-52b6b283-d387-4472-9585-8268d3ac767f tempest-VolumesServicesTestJSON-176193917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:01 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-52b6b283-d387-4472-9585-8268d3ac767f tempest-VolumesServicesTestJSON-176193917 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:57:01 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-52b6b283-d387-4472-9585-8268d3ac767f tempest-VolumesServicesTestJSON-176193917 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:57:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-52b6b283-d387-4472-9585-8268d3ac767f tempest-VolumesServicesTestJSON-176193917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-794e9fc3-ff24-4619-b5ad-f94e4e025438 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:01 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-de1f82e5-d1d3-4058-8dbb-0bbefa333489 tempest-SnapshotsActionsTest-464999979 None] Acquiring lock "cinder-69804c42-f179-402c-a980-34bc53db27d7-delete_snapshot" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:57:01 devstack sudo[97749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-794e9fc3-ff24-4619-b5ad-f94e4e025438 1073741824 Jul 30 16:57:01 devstack sudo[97749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:01 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-de1f82e5-d1d3-4058-8dbb-0bbefa333489 tempest-SnapshotsActionsTest-464999979 None] Lock "cinder-69804c42-f179-402c-a980-34bc53db27d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:57:01 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-de1f82e5-d1d3-4058-8dbb-0bbefa333489 tempest-SnapshotsActionsTest-464999979 None] Acquiring lock "cinder-quobyte-21948154-1938-4f10-8d97-a5c2f2f6ad1a" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:57:01 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:57:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] Flow 'volume_create_manager' (21c54c82-b542-4e18-b538-5c547e36f75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:57:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eef2763f-330a-42cc-9fef-b90358fb1014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:01 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-de1f82e5-d1d3-4058-8dbb-0bbefa333489 tempest-SnapshotsActionsTest-464999979 None] Lock "cinder-quobyte-21948154-1938-4f10-8d97-a5c2f2f6ad1a" acquired by "delete_snapshot" :: waited 0.048s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:57:01 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-de1f82e5-d1d3-4058-8dbb-0bbefa333489 tempest-SnapshotsActionsTest-464999979 None] Acquiring lock "cinder-quobyte-69804c42-f179-402c-a980-34bc53db27d7" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:57:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eef2763f-330a-42cc-9fef-b90358fb1014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-288083490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b3d2393-bff2-40db-9ac4-c5b5e5b9dc96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e86a79f380dc4455b7bcde07ff2aed0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:57:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:57:02Z,use_quota=True,user_id='88b916a959254bd2a43b9170d85014a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f794da5-633a-4886-bc2b-2015bd7cfe8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f794da5-633a-4886-bc2b-2015bd7cfe8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d38fae1-6828-4521-a2db-b0ef8b123c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:01 devstack cinder-volume[88591]: DEBUG cinder.image.glance [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] Creating Keystone auth plugin from conf {{(pid=88591) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 30 16:57:02 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-de1f82e5-d1d3-4058-8dbb-0bbefa333489 tempest-SnapshotsActionsTest-464999979 None] Lock "cinder-quobyte-69804c42-f179-402c-a980-34bc53db27d7" acquired by "_delete_snapshot" :: waited 0.066s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:57:02 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-de1f82e5-d1d3-4058-8dbb-0bbefa333489 tempest-SnapshotsActionsTest-464999979 None] Deleting offline snapshot 69804c42-f179-402c-a980-34bc53db27d7 of volume 21948154-1938-4f10-8d97-a5c2f2f6ad1a {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:57:02 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-de1f82e5-d1d3-4058-8dbb-0bbefa333489 tempest-SnapshotsActionsTest-464999979 None] snapshot_file for this snap is: volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.69804c42-f179-402c-a980-34bc53db27d7 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:57:02 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55bb062-5915-46d1-820b-2048ccf9efdb]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:57:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-de1f82e5-d1d3-4058-8dbb-0bbefa333489 tempest-SnapshotsActionsTest-464999979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.69804c42-f179-402c-a980-34bc53db27d7 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:02 devstack sudo[97751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.69804c42-f179-402c-a980-34bc53db27d7 Jul 30 16:57:02 devstack sudo[97751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d38fae1-6828-4521-a2db-b0ef8b123c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2b3d2393-bff2-40db-9ac4-c5b5e5b9dc96', 'volume_name': 'volume-2b3d2393-bff2-40db-9ac4-c5b5e5b9dc96', 'volume_size': 1, 'image_id': 'fb94d6e3-28d4-406f-8bad-19349d5f8454', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fb94d6e3-28d4-406f-8bad-19349d5f8454', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7e05c21dff7b441db433e2a7736519e9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fb94d6e3-28d4-406f-8bad-19349d5f8454', 'created_at': datetime.datetime(2026, 7, 30, 14, 42, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 42, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fb94d6e3-28d4-406f-8bad-19349d5f8454/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c15f5393-06a4-4955-8f26-7aa165dd6871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c15f5393-06a4-4955-8f26-7aa165dd6871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:02 devstack sudo[97749]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43eeecce-77da-472b-aa79-41f7aa759ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:02 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] Volume 2b3d2393-bff2-40db-9ac4-c5b5e5b9dc96: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2b3d2393-bff2-40db-9ac4-c5b5e5b9dc96', 'volume_size': 1, 'image_id': 'fb94d6e3-28d4-406f-8bad-19349d5f8454', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fb94d6e3-28d4-406f-8bad-19349d5f8454', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7e05c21dff7b441db433e2a7736519e9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fb94d6e3-28d4-406f-8bad-19349d5f8454', 'created_at': datetime.datetime(2026, 7, 30, 14, 42, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 42, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fb94d6e3-28d4-406f-8bad-19349d5f8454/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 30 16:57:02 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] Trying to clone 2b3d2393-bff2-40db-9ac4-c5b5e5b9dc96 from image fb94d6e3-28d4-406f-8bad-19349d5f8454 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fb94d6e3-28d4-406f-8bad-19349d5f8454', 'metadata': {}}]). {{(pid=88591) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 30 16:57:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-52b6b283-d387-4472-9585-8268d3ac767f tempest-VolumesServicesTestJSON-176193917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-794e9fc3-ff24-4619-b5ad-f94e4e025438 1073741824" returned: 0 in 0.606s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-52b6b283-d387-4472-9585-8268d3ac767f tempest-VolumesServicesTestJSON-176193917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-794e9fc3-ff24-4619-b5ad-f94e4e025438 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:02 devstack sudo[97751]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-de1f82e5-d1d3-4058-8dbb-0bbefa333489 tempest-SnapshotsActionsTest-464999979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.69804c42-f179-402c-a980-34bc53db27d7" returned: 0 in 0.459s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:02 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-de1f82e5-d1d3-4058-8dbb-0bbefa333489 tempest-SnapshotsActionsTest-464999979 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:57:02 devstack sudo[97761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-794e9fc3-ff24-4619-b5ad-f94e4e025438 Jul 30 16:57:02 devstack sudo[97761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:02 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b89fef-9e6d-4252-b5e5-7a58cd3c4b2c]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:57:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-de1f82e5-d1d3-4058-8dbb-0bbefa333489 tempest-SnapshotsActionsTest-464999979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:02 devstack sudo[97783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9 Jul 30 16:57:02 devstack sudo[97783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:02 devstack sudo[97761]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:02 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_oh55mlpydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88591) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 30 16:57:02 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] Image download 20.69 MB at 20.69 MB/s Jul 30 16:57:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-52b6b283-d387-4472-9585-8268d3ac767f tempest-VolumesServicesTestJSON-176193917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-794e9fc3-ff24-4619-b5ad-f94e4e025438" returned: 0 in 0.368s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:02 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-52b6b283-d387-4472-9585-8268d3ac767f tempest-VolumesServicesTestJSON-176193917 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:57:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-52b6b283-d387-4472-9585-8268d3ac767f tempest-VolumesServicesTestJSON-176193917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-52b6b283-d387-4472-9585-8268d3ac767f tempest-VolumesServicesTestJSON-176193917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d94132a-af1a-4a6a-9060-34265bb6c9d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-794e9fc3-ff24-4619-b5ad-f94e4e025438', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-52b6b283-d387-4472-9585-8268d3ac767f tempest-VolumesServicesTestJSON-176193917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8079f51b-cf1a-4d94-a125-f161939fc33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:02 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9222d3-3785-4160-b5ca-81a728861e16]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:57:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_oh55mlpydevstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:02 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-52b6b283-d387-4472-9585-8268d3ac767f tempest-VolumesServicesTestJSON-176193917 None] Volume volume-794e9fc3-ff24-4619-b5ad-f94e4e025438 (794e9fc3-ff24-4619-b5ad-f94e4e025438): created successfully Jul 30 16:57:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-52b6b283-d387-4472-9585-8268d3ac767f tempest-VolumesServicesTestJSON-176193917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8079f51b-cf1a-4d94-a125-f161939fc33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-52b6b283-d387-4472-9585-8268d3ac767f tempest-VolumesServicesTestJSON-176193917 None] Flow 'volume_create_manager' (7f95eac1-f79f-4300-93b5-137beb8b48aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:57:02 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-52b6b283-d387-4472-9585-8268d3ac767f tempest-VolumesServicesTestJSON-176193917 None] Created volume successfully. Jul 30 16:57:03 devstack sudo[97783]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-de1f82e5-d1d3-4058-8dbb-0bbefa333489 tempest-SnapshotsActionsTest-464999979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9" returned: 0 in 0.458s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:03 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-de1f82e5-d1d3-4058-8dbb-0bbefa333489 tempest-SnapshotsActionsTest-464999979 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:57:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-de1f82e5-d1d3-4058-8dbb-0bbefa333489 tempest-SnapshotsActionsTest-464999979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.69804c42-f179-402c-a980-34bc53db27d7 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:03 devstack sudo[97788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_oh55mlpydevstack@QuobyteHD Jul 30 16:57:03 devstack sudo[97788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:03 devstack sudo[97791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.69804c42-f179-402c-a980-34bc53db27d7 Jul 30 16:57:03 devstack sudo[97791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:03 devstack sudo[97788]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_oh55mlpydevstack@QuobyteHD" returned: 0 in 0.379s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:03 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] Temporary image fb94d6e3-28d4-406f-8bad-19349d5f8454 is fetched for user 88b916a959254bd2a43b9170d85014a3. {{(pid=88591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 30 16:57:03 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[686cacbe-7add-4ff6-9985-fbe4b414389c]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:57:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_oh55mlpydevstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:03 devstack sudo[97791]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-de1f82e5-d1d3-4058-8dbb-0bbefa333489 tempest-SnapshotsActionsTest-464999979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.69804c42-f179-402c-a980-34bc53db27d7" returned: 0 in 0.425s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-de1f82e5-d1d3-4058-8dbb-0bbefa333489 tempest-SnapshotsActionsTest-464999979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.69804c42-f179-402c-a980-34bc53db27d7 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:03 devstack sudo[97801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.69804c42-f179-402c-a980-34bc53db27d7 Jul 30 16:57:03 devstack sudo[97801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:03 devstack sudo[97800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_oh55mlpydevstack@QuobyteHD Jul 30 16:57:03 devstack sudo[97800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:03 devstack sudo[97801]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-de1f82e5-d1d3-4058-8dbb-0bbefa333489 tempest-SnapshotsActionsTest-464999979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.69804c42-f179-402c-a980-34bc53db27d7" returned: 0 in 0.283s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:03 devstack sudo[97800]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:03 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-1b26fc3c-0932-41fc-9165-eb2c51ffca1c tempest-VolumesServicesTestJSON-176193917 None] Acquiring lock "cinder-794e9fc3-ff24-4619-b5ad-f94e4e025438-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:57:03 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-de1f82e5-d1d3-4058-8dbb-0bbefa333489 tempest-SnapshotsActionsTest-464999979 None] Lock "cinder-quobyte-69804c42-f179-402c-a980-34bc53db27d7" released by "_delete_snapshot" :: held 1.785s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:57:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_oh55mlpydevstack@QuobyteHD" returned: 0 in 0.404s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:03 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-288083490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b3d2393-bff2-40db-9ac4-c5b5e5b9dc96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e86a79f380dc4455b7bcde07ff2aed0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:57:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:57:02Z,use_quota=True,user_id='88b916a959254bd2a43b9170d85014a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:57:03 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] Creating volume 2b3d2393-bff2-40db-9ac4-c5b5e5b9dc96 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:57:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:03 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:57:03 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:57:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:03 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:57:03 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:57:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2b3d2393-bff2-40db-9ac4-c5b5e5b9dc96 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:03 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-de1f82e5-d1d3-4058-8dbb-0bbefa333489 tempest-SnapshotsActionsTest-464999979 None] Lock "cinder-quobyte-21948154-1938-4f10-8d97-a5c2f2f6ad1a" released by "delete_snapshot" :: held 1.886s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:57:03 devstack sudo[97808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2b3d2393-bff2-40db-9ac4-c5b5e5b9dc96 1073741824 Jul 30 16:57:03 devstack sudo[97808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:03 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-1b26fc3c-0932-41fc-9165-eb2c51ffca1c tempest-VolumesServicesTestJSON-176193917 None] Lock "cinder-794e9fc3-ff24-4619-b5ad-f94e4e025438-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:57:03 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-1b26fc3c-0932-41fc-9165-eb2c51ffca1c tempest-VolumesServicesTestJSON-176193917 None] Acquiring lock "cinder-quobyte-794e9fc3-ff24-4619-b5ad-f94e4e025438" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:57:03 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-1b26fc3c-0932-41fc-9165-eb2c51ffca1c tempest-VolumesServicesTestJSON-176193917 None] Lock "cinder-quobyte-794e9fc3-ff24-4619-b5ad-f94e4e025438" acquired by "delete_volume" :: waited 0.033s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:57:03 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-de1f82e5-d1d3-4058-8dbb-0bbefa333489 tempest-SnapshotsActionsTest-464999979 None] Created reservations ['860ef1a7-1879-487b-9c67-9d4bb6fe3aa8', '15db7be3-8e7b-40ee-b4ff-942fd5b83c19', '9f519604-5669-4c22-819f-a951e379bece', '648fac8c-4016-43bc-befc-1d1ce98b40b4'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:57:04 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d5005f-2ea1-4db1-8c7a-06a702e8adc2]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:57:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1b26fc3c-0932-41fc-9165-eb2c51ffca1c tempest-VolumesServicesTestJSON-176193917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-794e9fc3-ff24-4619-b5ad-f94e4e025438 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:04 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-de1f82e5-d1d3-4058-8dbb-0bbefa333489 tempest-SnapshotsActionsTest-464999979 None] Delete snapshot completed successfully. Jul 30 16:57:04 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-de1f82e5-d1d3-4058-8dbb-0bbefa333489 tempest-SnapshotsActionsTest-464999979 None] Lock "cinder-69804c42-f179-402c-a980-34bc53db27d7-delete_snapshot" released by "delete_snapshot" :: held 2.236s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:57:04 devstack sudo[97812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-794e9fc3-ff24-4619-b5ad-f94e4e025438 Jul 30 16:57:04 devstack sudo[97812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:04 devstack sudo[97812]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1b26fc3c-0932-41fc-9165-eb2c51ffca1c tempest-VolumesServicesTestJSON-176193917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-794e9fc3-ff24-4619-b5ad-f94e4e025438" returned: 0 in 0.455s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1b26fc3c-0932-41fc-9165-eb2c51ffca1c tempest-VolumesServicesTestJSON-176193917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-794e9fc3-ff24-4619-b5ad-f94e4e025438 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:04 devstack sudo[97808]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2b3d2393-bff2-40db-9ac4-c5b5e5b9dc96 1073741824" returned: 0 in 0.666s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:04 devstack sudo[97821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-794e9fc3-ff24-4619-b5ad-f94e4e025438 Jul 30 16:57:04 devstack sudo[97821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2b3d2393-bff2-40db-9ac4-c5b5e5b9dc96 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:04 devstack sudo[97825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2b3d2393-bff2-40db-9ac4-c5b5e5b9dc96 Jul 30 16:57:04 devstack sudo[97825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:04 devstack sudo[97821]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1b26fc3c-0932-41fc-9165-eb2c51ffca1c tempest-VolumesServicesTestJSON-176193917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-794e9fc3-ff24-4619-b5ad-f94e4e025438" returned: 0 in 0.377s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:04 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-1b26fc3c-0932-41fc-9165-eb2c51ffca1c tempest-VolumesServicesTestJSON-176193917 None] Lock "cinder-quobyte-794e9fc3-ff24-4619-b5ad-f94e4e025438" released by "delete_volume" :: held 0.896s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:57:04 devstack sudo[97825]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2b3d2393-bff2-40db-9ac4-c5b5e5b9dc96" returned: 0 in 0.333s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:04 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:57:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:04 devstack cinder-volume[88591]: DEBUG cinder.volume.volume_utils [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] Attempting download of fb94d6e3-28d4-406f-8bad-19349d5f8454 ((None, [{'url': 'file:///opt/stack/data/glance/images/fb94d6e3-28d4-406f-8bad-19349d5f8454', 'metadata': {}}])) to volume 2b3d2393-bff2-40db-9ac4-c5b5e5b9dc96. {{(pid=88591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 30 16:57:04 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-1b26fc3c-0932-41fc-9165-eb2c51ffca1c tempest-VolumesServicesTestJSON-176193917 None] Created reservations ['20ddca08-7f46-45bf-aab1-35c6a0728899', 'c4c64996-56cd-4e67-a9bf-615e8addfc57', '18a73ce0-a292-4112-a08b-d64c8565f008', '11220bc1-d576-4aeb-88b1-cee283d9fb62'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:57:05 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[106dca2f-f0a7-4a7d-997c-e3161e1ce247]: (4, 'raw') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:57:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fb94d6e3-28d4-406f-8bad-19349d5f8454_u0jj7f3g {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1b26fc3c-0932-41fc-9165-eb2c51ffca1c tempest-VolumesServicesTestJSON-176193917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1b26fc3c-0932-41fc-9165-eb2c51ffca1c tempest-VolumesServicesTestJSON-176193917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:05 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-1b26fc3c-0932-41fc-9165-eb2c51ffca1c tempest-VolumesServicesTestJSON-176193917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:57:05 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-1b26fc3c-0932-41fc-9165-eb2c51ffca1c tempest-VolumesServicesTestJSON-176193917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:57:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1b26fc3c-0932-41fc-9165-eb2c51ffca1c tempest-VolumesServicesTestJSON-176193917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1b26fc3c-0932-41fc-9165-eb2c51ffca1c tempest-VolumesServicesTestJSON-176193917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:05 devstack sudo[97852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:57:05 devstack sudo[97852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:05 devstack sudo[97847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fb94d6e3-28d4-406f-8bad-19349d5f8454_u0jj7f3g Jul 30 16:57:05 devstack sudo[97847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:05 devstack sudo[97847]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fb94d6e3-28d4-406f-8bad-19349d5f8454_u0jj7f3g" returned: 0 in 0.509s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fb94d6e3-28d4-406f-8bad-19349d5f8454_u0jj7f3g {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-fcc48498-c193-4fed-bdf6-2bd7314b7da5 tempest-SnapshotsActionsTest-480286487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-fcc48498-c193-4fed-bdf6-2bd7314b7da5 tempest-SnapshotsActionsTest-480286487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:05 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-fcc48498-c193-4fed-bdf6-2bd7314b7da5 tempest-SnapshotsActionsTest-480286487 None] Creating offline snapshot 8f11510c-213d-41ac-8219-868391556b72 of volume 21948154-1938-4f10-8d97-a5c2f2f6ad1a {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:57:05 devstack sudo[97852]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1b26fc3c-0932-41fc-9165-eb2c51ffca1c tempest-VolumesServicesTestJSON-176193917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.521s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:05 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-1b26fc3c-0932-41fc-9165-eb2c51ffca1c tempest-VolumesServicesTestJSON-176193917 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:57:05 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-1b26fc3c-0932-41fc-9165-eb2c51ffca1c tempest-VolumesServicesTestJSON-176193917 None] Deleted volume successfully. Jul 30 16:57:05 devstack sudo[97859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fb94d6e3-28d4-406f-8bad-19349d5f8454_u0jj7f3g Jul 30 16:57:05 devstack sudo[97859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:05 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd539ab-3155-4199-9160-2ee90f328312]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:57:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fcc48498-c193-4fed-bdf6-2bd7314b7da5 tempest-SnapshotsActionsTest-480286487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:05 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-1b26fc3c-0932-41fc-9165-eb2c51ffca1c tempest-VolumesServicesTestJSON-176193917 None] Lock "cinder-794e9fc3-ff24-4619-b5ad-f94e4e025438-delete_volume" released by "delete_volume" :: held 2.022s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:57:06 devstack sudo[97861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9 Jul 30 16:57:06 devstack sudo[97861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:06 devstack sudo[97859]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fb94d6e3-28d4-406f-8bad-19349d5f8454_u0jj7f3g" returned: 1 in 0.450s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fb94d6e3-28d4-406f-8bad-19349d5f8454_u0jj7f3g' failed. Not Retrying. {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 16:57:06 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96ceba0-a1e0-415d-9df8-f4805ae72077]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:57:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_oh55mlpydevstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:06 devstack sudo[97865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_oh55mlpydevstack@QuobyteHD Jul 30 16:57:06 devstack sudo[97865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:06 devstack sudo[97861]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fcc48498-c193-4fed-bdf6-2bd7314b7da5 tempest-SnapshotsActionsTest-480286487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9" returned: 0 in 0.561s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:06 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-fcc48498-c193-4fed-bdf6-2bd7314b7da5 tempest-SnapshotsActionsTest-480286487 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:57:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fcc48498-c193-4fed-bdf6-2bd7314b7da5 tempest-SnapshotsActionsTest-480286487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.8f11510c-213d-41ac-8219-868391556b72 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:06 devstack sudo[97872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.8f11510c-213d-41ac-8219-868391556b72 1G Jul 30 16:57:06 devstack sudo[97872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:06 devstack sudo[97865]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_oh55mlpydevstack@QuobyteHD" returned: 0 in 0.411s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:06 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] fb94d6e3-28d4-406f-8bad-19349d5f8454 was qcow2, converting to qcow2 {{(pid=88591) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 30 16:57:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_oh55mlpydevstack@QuobyteHD /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2b3d2393-bff2-40db-9ac4-c5b5e5b9dc96 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:06 devstack sudo[97878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_oh55mlpydevstack@QuobyteHD /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2b3d2393-bff2-40db-9ac4-c5b5e5b9dc96 Jul 30 16:57:06 devstack sudo[97878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:07 devstack sudo[97872]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fcc48498-c193-4fed-bdf6-2bd7314b7da5 tempest-SnapshotsActionsTest-480286487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.8f11510c-213d-41ac-8219-868391556b72 1G" returned: 0 in 0.625s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fcc48498-c193-4fed-bdf6-2bd7314b7da5 tempest-SnapshotsActionsTest-480286487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.8f11510c-213d-41ac-8219-868391556b72 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:07 devstack sudo[97889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.8f11510c-213d-41ac-8219-868391556b72 Jul 30 16:57:07 devstack sudo[97889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:07 devstack sudo[97889]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fcc48498-c193-4fed-bdf6-2bd7314b7da5 tempest-SnapshotsActionsTest-480286487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.8f11510c-213d-41ac-8219-868391556b72" returned: 0 in 0.453s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:07 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-fcc48498-c193-4fed-bdf6-2bd7314b7da5 tempest-SnapshotsActionsTest-480286487 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.8f11510c-213d-41ac-8219-868391556b72 is being set with open permissions: ugo+rw Jul 30 16:57:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fcc48498-c193-4fed-bdf6-2bd7314b7da5 tempest-SnapshotsActionsTest-480286487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.8f11510c-213d-41ac-8219-868391556b72 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:07 devstack sudo[97896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.8f11510c-213d-41ac-8219-868391556b72 Jul 30 16:57:07 devstack sudo[97896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:07 devstack sudo[97896]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fcc48498-c193-4fed-bdf6-2bd7314b7da5 tempest-SnapshotsActionsTest-480286487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.8f11510c-213d-41ac-8219-868391556b72" returned: 0 in 0.463s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-fcc48498-c193-4fed-bdf6-2bd7314b7da5 tempest-SnapshotsActionsTest-480286487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.279s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:08 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-fcc48498-c193-4fed-bdf6-2bd7314b7da5 tempest-SnapshotsActionsTest-480286487 None] Create snapshot completed successfully Jul 30 16:57:08 devstack sudo[97878]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_oh55mlpydevstack@QuobyteHD /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2b3d2393-bff2-40db-9ac4-c5b5e5b9dc96" returned: 0 in 2.423s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:08 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_oh55mlpydevstack@QuobyteHD, size 112.00 MB, duration 2.42 sec, destination /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2b3d2393-bff2-40db-9ac4-c5b5e5b9dc96 {{(pid=88591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:57:08 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] Converted 112.00 MB image at 46.21 MB/s Jul 30 16:57:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2b3d2393-bff2-40db-9ac4-c5b5e5b9dc96 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:09 devstack sudo[97900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2b3d2393-bff2-40db-9ac4-c5b5e5b9dc96 1G Jul 30 16:57:09 devstack sudo[97900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:09 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-187166f9-f148-40ba-bba6-6762da08f259 tempest-SnapshotsActionsTest-464999979 None] Acquiring lock "cinder-8f11510c-213d-41ac-8219-868391556b72-delete_snapshot" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:57:09 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-187166f9-f148-40ba-bba6-6762da08f259 tempest-SnapshotsActionsTest-464999979 None] Lock "cinder-8f11510c-213d-41ac-8219-868391556b72-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:57:09 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-187166f9-f148-40ba-bba6-6762da08f259 tempest-SnapshotsActionsTest-464999979 None] Acquiring lock "cinder-quobyte-21948154-1938-4f10-8d97-a5c2f2f6ad1a" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:57:09 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-187166f9-f148-40ba-bba6-6762da08f259 tempest-SnapshotsActionsTest-464999979 None] Lock "cinder-quobyte-21948154-1938-4f10-8d97-a5c2f2f6ad1a" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:57:09 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-187166f9-f148-40ba-bba6-6762da08f259 tempest-SnapshotsActionsTest-464999979 None] Acquiring lock "cinder-quobyte-8f11510c-213d-41ac-8219-868391556b72" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:57:09 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-187166f9-f148-40ba-bba6-6762da08f259 tempest-SnapshotsActionsTest-464999979 None] Lock "cinder-quobyte-8f11510c-213d-41ac-8219-868391556b72" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:57:09 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-187166f9-f148-40ba-bba6-6762da08f259 tempest-SnapshotsActionsTest-464999979 None] Deleting offline snapshot 8f11510c-213d-41ac-8219-868391556b72 of volume 21948154-1938-4f10-8d97-a5c2f2f6ad1a {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:57:09 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-187166f9-f148-40ba-bba6-6762da08f259 tempest-SnapshotsActionsTest-464999979 None] snapshot_file for this snap is: volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.8f11510c-213d-41ac-8219-868391556b72 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:57:09 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90437b0-d25f-46c3-8578-045821111362]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:57:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-187166f9-f148-40ba-bba6-6762da08f259 tempest-SnapshotsActionsTest-464999979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.8f11510c-213d-41ac-8219-868391556b72 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:09 devstack sudo[97903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.8f11510c-213d-41ac-8219-868391556b72 Jul 30 16:57:09 devstack sudo[97903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:09 devstack sudo[97900]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2b3d2393-bff2-40db-9ac4-c5b5e5b9dc96 1G" returned: 0 in 0.487s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:09 devstack cinder-volume[88591]: DEBUG cinder.volume.volume_utils [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] Downloaded image fb94d6e3-28d4-406f-8bad-19349d5f8454 ((None, [{'url': 'file:///opt/stack/data/glance/images/fb94d6e3-28d4-406f-8bad-19349d5f8454', 'metadata': {}}])) to volume 2b3d2393-bff2-40db-9ac4-c5b5e5b9dc96 successfully. {{(pid=88591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 30 16:57:09 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] Temporary image fb94d6e3-28d4-406f-8bad-19349d5f8454 for user 88b916a959254bd2a43b9170d85014a3 is deleted. {{(pid=88591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 30 16:57:09 devstack cinder-volume[88591]: DEBUG cinder.volume.volume_utils [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] Marking volume 2b3d2393-bff2-40db-9ac4-c5b5e5b9dc96 as bootable. {{(pid=88591) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 30 16:57:09 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] Copying metadata from image fb94d6e3-28d4-406f-8bad-19349d5f8454 to 2b3d2393-bff2-40db-9ac4-c5b5e5b9dc96. {{(pid=88591) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 30 16:57:09 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] Creating volume glance metadata for volume 2b3d2393-bff2-40db-9ac4-c5b5e5b9dc96 backed by image fb94d6e3-28d4-406f-8bad-19349d5f8454 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fb94d6e3-28d4-406f-8bad-19349d5f8454', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88591) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 30 16:57:09 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43eeecce-77da-472b-aa79-41f7aa759ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b3d2393-bff2-40db-9ac4-c5b5e5b9dc96', 'volume_size': 1, 'image_id': 'fb94d6e3-28d4-406f-8bad-19349d5f8454', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fb94d6e3-28d4-406f-8bad-19349d5f8454', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7e05c21dff7b441db433e2a7736519e9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fb94d6e3-28d4-406f-8bad-19349d5f8454', 'created_at': datetime.datetime(2026, 7, 30, 14, 42, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 42, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fb94d6e3-28d4-406f-8bad-19349d5f8454/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:09 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9efa641e-932a-4faf-abe1-483aa8b641b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:09 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] Volume volume-2b3d2393-bff2-40db-9ac4-c5b5e5b9dc96 (2b3d2393-bff2-40db-9ac4-c5b5e5b9dc96): created successfully Jul 30 16:57:09 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9efa641e-932a-4faf-abe1-483aa8b641b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:09 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] Flow 'volume_create_manager' (21c54c82-b542-4e18-b538-5c547e36f75a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:57:09 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-cec577e4-e6c7-423a-8a17-4bfe4a909752 tempest-TestShelveInstance-1545066493 None] Created volume successfully. Jul 30 16:57:09 devstack sudo[97903]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-187166f9-f148-40ba-bba6-6762da08f259 tempest-SnapshotsActionsTest-464999979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.8f11510c-213d-41ac-8219-868391556b72" returned: 0 in 0.587s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:09 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-187166f9-f148-40ba-bba6-6762da08f259 tempest-SnapshotsActionsTest-464999979 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:57:09 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[0698d7e2-3e21-41ba-a8f8-1b1ed475701a]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:57:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-187166f9-f148-40ba-bba6-6762da08f259 tempest-SnapshotsActionsTest-464999979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:10 devstack sudo[97912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9 Jul 30 16:57:10 devstack sudo[97912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:10 devstack sudo[97912]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-187166f9-f148-40ba-bba6-6762da08f259 tempest-SnapshotsActionsTest-464999979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9" returned: 0 in 0.473s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:10 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-187166f9-f148-40ba-bba6-6762da08f259 tempest-SnapshotsActionsTest-464999979 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:57:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-187166f9-f148-40ba-bba6-6762da08f259 tempest-SnapshotsActionsTest-464999979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.8f11510c-213d-41ac-8219-868391556b72 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:10 devstack sudo[97919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.8f11510c-213d-41ac-8219-868391556b72 Jul 30 16:57:10 devstack sudo[97919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:10 devstack sudo[97919]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-187166f9-f148-40ba-bba6-6762da08f259 tempest-SnapshotsActionsTest-464999979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.8f11510c-213d-41ac-8219-868391556b72" returned: 0 in 0.592s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-187166f9-f148-40ba-bba6-6762da08f259 tempest-SnapshotsActionsTest-464999979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.8f11510c-213d-41ac-8219-868391556b72 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:10 devstack sudo[97925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.8f11510c-213d-41ac-8219-868391556b72 Jul 30 16:57:10 devstack sudo[97925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:11 devstack sudo[97925]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-187166f9-f148-40ba-bba6-6762da08f259 tempest-SnapshotsActionsTest-464999979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.8f11510c-213d-41ac-8219-868391556b72" returned: 0 in 0.295s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:11 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-187166f9-f148-40ba-bba6-6762da08f259 tempest-SnapshotsActionsTest-464999979 None] Lock "cinder-quobyte-8f11510c-213d-41ac-8219-868391556b72" released by "_delete_snapshot" :: held 2.087s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:57:11 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-187166f9-f148-40ba-bba6-6762da08f259 tempest-SnapshotsActionsTest-464999979 None] Lock "cinder-quobyte-21948154-1938-4f10-8d97-a5c2f2f6ad1a" released by "delete_snapshot" :: held 2.122s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:57:11 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-187166f9-f148-40ba-bba6-6762da08f259 tempest-SnapshotsActionsTest-464999979 None] Created reservations ['8f559e75-dd76-43d5-996c-288a014a28ba', '75628f7a-9f07-4a82-9d93-e67a6a7df91a', '7ff91064-83af-42b5-b9a8-84f39d6df369', 'f83692a2-f845-411d-898d-5ef63c50d9c2'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:57:11 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-187166f9-f148-40ba-bba6-6762da08f259 tempest-SnapshotsActionsTest-464999979 None] Delete snapshot completed successfully. Jul 30 16:57:11 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-187166f9-f148-40ba-bba6-6762da08f259 tempest-SnapshotsActionsTest-464999979 None] Lock "cinder-8f11510c-213d-41ac-8219-868391556b72-delete_snapshot" released by "delete_snapshot" :: held 2.309s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:57:12 devstack cinder-volume[88591]: DEBUG oslo_service.periodic_task [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:57:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:57:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:57:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:12 devstack sudo[97932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:57:12 devstack sudo[97932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3fc2254d-8667-43cb-ab6d-2f03a405b960 tempest-SnapshotsActionsTest-480286487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3fc2254d-8667-43cb-ab6d-2f03a405b960 tempest-SnapshotsActionsTest-480286487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:13 devstack sudo[97932]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.523s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:13 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:57:13 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-3fc2254d-8667-43cb-ab6d-2f03a405b960 tempest-SnapshotsActionsTest-480286487 None] Creating offline snapshot af12d2ac-ee96-4e31-a151-dab0d910e422 of volume 21948154-1938-4f10-8d97-a5c2f2f6ad1a {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:57:13 devstack cinder-volume[88591]: DEBUG oslo_service.periodic_task [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running periodic task VolumeManager._thread_info {{(pid=88591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:57:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] thread count: 28 {{(pid=88591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:57:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] thread info: [<_MainThread(MainThread, started 140677178003584)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:57:13 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ede933-5270-4a8f-97ef-9e34440f5db1]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:57:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3fc2254d-8667-43cb-ab6d-2f03a405b960 tempest-SnapshotsActionsTest-480286487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:13 devstack sudo[97935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9 Jul 30 16:57:13 devstack sudo[97935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:13 devstack sudo[97935]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3fc2254d-8667-43cb-ab6d-2f03a405b960 tempest-SnapshotsActionsTest-480286487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9" returned: 0 in 0.518s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:13 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-3fc2254d-8667-43cb-ab6d-2f03a405b960 tempest-SnapshotsActionsTest-480286487 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:57:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3fc2254d-8667-43cb-ab6d-2f03a405b960 tempest-SnapshotsActionsTest-480286487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.af12d2ac-ee96-4e31-a151-dab0d910e422 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:13 devstack sudo[97947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.af12d2ac-ee96-4e31-a151-dab0d910e422 1G Jul 30 16:57:13 devstack sudo[97947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-08b46b6c-364c-40b8-8009-3f9a23dfbc4b req-236009ff-a63f-480f-9776-596a256c09bd tempest-TestShelveInstance-1545066493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:14 devstack sudo[97947]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3fc2254d-8667-43cb-ab6d-2f03a405b960 tempest-SnapshotsActionsTest-480286487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.af12d2ac-ee96-4e31-a151-dab0d910e422 1G" returned: 0 in 0.671s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3fc2254d-8667-43cb-ab6d-2f03a405b960 tempest-SnapshotsActionsTest-480286487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.af12d2ac-ee96-4e31-a151-dab0d910e422 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:14 devstack sudo[97954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.af12d2ac-ee96-4e31-a151-dab0d910e422 Jul 30 16:57:14 devstack sudo[97954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:14 devstack sudo[97954]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3fc2254d-8667-43cb-ab6d-2f03a405b960 tempest-SnapshotsActionsTest-480286487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.af12d2ac-ee96-4e31-a151-dab0d910e422" returned: 0 in 0.394s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:14 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-3fc2254d-8667-43cb-ab6d-2f03a405b960 tempest-SnapshotsActionsTest-480286487 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.af12d2ac-ee96-4e31-a151-dab0d910e422 is being set with open permissions: ugo+rw Jul 30 16:57:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3fc2254d-8667-43cb-ab6d-2f03a405b960 tempest-SnapshotsActionsTest-480286487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.af12d2ac-ee96-4e31-a151-dab0d910e422 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:14 devstack sudo[97959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.af12d2ac-ee96-4e31-a151-dab0d910e422 Jul 30 16:57:14 devstack sudo[97959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:15 devstack sudo[97959]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3fc2254d-8667-43cb-ab6d-2f03a405b960 tempest-SnapshotsActionsTest-480286487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.af12d2ac-ee96-4e31-a151-dab0d910e422" returned: 0 in 0.341s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3fc2254d-8667-43cb-ab6d-2f03a405b960 tempest-SnapshotsActionsTest-480286487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.164s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-08b46b6c-364c-40b8-8009-3f9a23dfbc4b req-236009ff-a63f-480f-9776-596a256c09bd tempest-TestShelveInstance-1545066493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.284s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-08b46b6c-364c-40b8-8009-3f9a23dfbc4b req-236009ff-a63f-480f-9776-596a256c09bd tempest-TestShelveInstance-1545066493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:15 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-3fc2254d-8667-43cb-ab6d-2f03a405b960 tempest-SnapshotsActionsTest-480286487 None] Create snapshot completed successfully Jul 30 16:57:15 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-08b46b6c-364c-40b8-8009-3f9a23dfbc4b req-236009ff-a63f-480f-9776-596a256c09bd tempest-TestShelveInstance-1545066493 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202', 'name': 'volume-2b3d2393-bff2-40db-9ac4-c5b5e5b9dc96', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd6b348b7-fe2e-45e5-ae2d-ac54c2a563ac', 'enforce_multipath': True} {{(pid=88591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:57:15 devstack cinder-volume[88591]: INFO cinder.volume.manager [req-08b46b6c-364c-40b8-8009-3f9a23dfbc4b req-236009ff-a63f-480f-9776-596a256c09bd tempest-TestShelveInstance-1545066493 None] attachment_update completed successfully. Jul 30 16:57:16 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-165147a0-d469-42bf-8bea-5d9775381d9c tempest-SnapshotsActionsTest-464999979 None] Acquiring lock "cinder-af12d2ac-ee96-4e31-a151-dab0d910e422-delete_snapshot" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:57:16 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-165147a0-d469-42bf-8bea-5d9775381d9c tempest-SnapshotsActionsTest-464999979 None] Lock "cinder-af12d2ac-ee96-4e31-a151-dab0d910e422-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:57:16 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-165147a0-d469-42bf-8bea-5d9775381d9c tempest-SnapshotsActionsTest-464999979 None] Acquiring lock "cinder-quobyte-21948154-1938-4f10-8d97-a5c2f2f6ad1a" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:57:16 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-165147a0-d469-42bf-8bea-5d9775381d9c tempest-SnapshotsActionsTest-464999979 None] Lock "cinder-quobyte-21948154-1938-4f10-8d97-a5c2f2f6ad1a" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:57:16 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-165147a0-d469-42bf-8bea-5d9775381d9c tempest-SnapshotsActionsTest-464999979 None] Acquiring lock "cinder-quobyte-af12d2ac-ee96-4e31-a151-dab0d910e422" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:57:16 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-165147a0-d469-42bf-8bea-5d9775381d9c tempest-SnapshotsActionsTest-464999979 None] Lock "cinder-quobyte-af12d2ac-ee96-4e31-a151-dab0d910e422" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:57:16 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-165147a0-d469-42bf-8bea-5d9775381d9c tempest-SnapshotsActionsTest-464999979 None] Deleting offline snapshot af12d2ac-ee96-4e31-a151-dab0d910e422 of volume 21948154-1938-4f10-8d97-a5c2f2f6ad1a {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:57:16 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-165147a0-d469-42bf-8bea-5d9775381d9c tempest-SnapshotsActionsTest-464999979 None] snapshot_file for this snap is: volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.af12d2ac-ee96-4e31-a151-dab0d910e422 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:57:16 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1c6469-d4a9-4ba5-8f67-6e2b262dec6e]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:57:16 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-165147a0-d469-42bf-8bea-5d9775381d9c tempest-SnapshotsActionsTest-464999979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.af12d2ac-ee96-4e31-a151-dab0d910e422 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:16 devstack sudo[97966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.af12d2ac-ee96-4e31-a151-dab0d910e422 Jul 30 16:57:16 devstack sudo[97966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:17 devstack sudo[97966]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-165147a0-d469-42bf-8bea-5d9775381d9c tempest-SnapshotsActionsTest-464999979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.af12d2ac-ee96-4e31-a151-dab0d910e422" returned: 0 in 0.672s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:17 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-165147a0-d469-42bf-8bea-5d9775381d9c tempest-SnapshotsActionsTest-464999979 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:57:17 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d502a4-a58f-49df-b1ac-ef6b25519e11]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:57:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-165147a0-d469-42bf-8bea-5d9775381d9c tempest-SnapshotsActionsTest-464999979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:17 devstack sudo[97975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9 Jul 30 16:57:17 devstack sudo[97975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:17 devstack sudo[97975]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-165147a0-d469-42bf-8bea-5d9775381d9c tempest-SnapshotsActionsTest-464999979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9" returned: 0 in 0.562s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:17 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-165147a0-d469-42bf-8bea-5d9775381d9c tempest-SnapshotsActionsTest-464999979 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:57:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-165147a0-d469-42bf-8bea-5d9775381d9c tempest-SnapshotsActionsTest-464999979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.af12d2ac-ee96-4e31-a151-dab0d910e422 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:17 devstack sudo[98047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.af12d2ac-ee96-4e31-a151-dab0d910e422 Jul 30 16:57:17 devstack sudo[98047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:18 devstack sudo[98047]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-165147a0-d469-42bf-8bea-5d9775381d9c tempest-SnapshotsActionsTest-464999979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.af12d2ac-ee96-4e31-a151-dab0d910e422" returned: 0 in 0.694s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-165147a0-d469-42bf-8bea-5d9775381d9c tempest-SnapshotsActionsTest-464999979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.af12d2ac-ee96-4e31-a151-dab0d910e422 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:18 devstack sudo[98102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.af12d2ac-ee96-4e31-a151-dab0d910e422 Jul 30 16:57:18 devstack sudo[98102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:19 devstack sudo[98102]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-165147a0-d469-42bf-8bea-5d9775381d9c tempest-SnapshotsActionsTest-464999979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.af12d2ac-ee96-4e31-a151-dab0d910e422" returned: 0 in 0.659s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:19 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-165147a0-d469-42bf-8bea-5d9775381d9c tempest-SnapshotsActionsTest-464999979 None] Lock "cinder-quobyte-af12d2ac-ee96-4e31-a151-dab0d910e422" released by "_delete_snapshot" :: held 2.793s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:57:19 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-165147a0-d469-42bf-8bea-5d9775381d9c tempest-SnapshotsActionsTest-464999979 None] Lock "cinder-quobyte-21948154-1938-4f10-8d97-a5c2f2f6ad1a" released by "delete_snapshot" :: held 2.833s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:57:19 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-165147a0-d469-42bf-8bea-5d9775381d9c tempest-SnapshotsActionsTest-464999979 None] Created reservations ['9f80fd68-1d2e-4a77-9ea2-3d10e774c704', '166e6aa1-db1b-4592-9b92-7a7487701eff', '5338730f-0a42-41c8-9bec-fbc0d30a2a74', 'c490fe04-12ae-4144-9bd7-e43effcf68b9'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:57:19 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-165147a0-d469-42bf-8bea-5d9775381d9c tempest-SnapshotsActionsTest-464999979 None] Delete snapshot completed successfully. Jul 30 16:57:19 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-165147a0-d469-42bf-8bea-5d9775381d9c tempest-SnapshotsActionsTest-464999979 None] Lock "cinder-af12d2ac-ee96-4e31-a151-dab0d910e422-delete_snapshot" released by "delete_snapshot" :: held 3.196s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:57:20 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-30bbb3d3-14ae-4c16-984d-2e47f26dd1ef tempest-SnapshotsActionsTest-480286487 None] Acquiring lock "cinder-3d1a3634-f80a-410c-98c5-ceda6722caa9-delete_snapshot" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:57:20 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-30bbb3d3-14ae-4c16-984d-2e47f26dd1ef tempest-SnapshotsActionsTest-480286487 None] Lock "cinder-3d1a3634-f80a-410c-98c5-ceda6722caa9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:57:20 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-30bbb3d3-14ae-4c16-984d-2e47f26dd1ef tempest-SnapshotsActionsTest-480286487 None] Acquiring lock "cinder-quobyte-21948154-1938-4f10-8d97-a5c2f2f6ad1a" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:57:20 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-30bbb3d3-14ae-4c16-984d-2e47f26dd1ef tempest-SnapshotsActionsTest-480286487 None] Lock "cinder-quobyte-21948154-1938-4f10-8d97-a5c2f2f6ad1a" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:57:20 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-30bbb3d3-14ae-4c16-984d-2e47f26dd1ef tempest-SnapshotsActionsTest-480286487 None] Acquiring lock "cinder-quobyte-3d1a3634-f80a-410c-98c5-ceda6722caa9" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:57:20 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-30bbb3d3-14ae-4c16-984d-2e47f26dd1ef tempest-SnapshotsActionsTest-480286487 None] Lock "cinder-quobyte-3d1a3634-f80a-410c-98c5-ceda6722caa9" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:57:20 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-30bbb3d3-14ae-4c16-984d-2e47f26dd1ef tempest-SnapshotsActionsTest-480286487 None] Deleting offline snapshot 3d1a3634-f80a-410c-98c5-ceda6722caa9 of volume 21948154-1938-4f10-8d97-a5c2f2f6ad1a {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:57:20 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-30bbb3d3-14ae-4c16-984d-2e47f26dd1ef tempest-SnapshotsActionsTest-480286487 None] snapshot_file for this snap is: volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:57:20 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbfdb208-fcff-4f94-97e3-0580deba61e4]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:57:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-30bbb3d3-14ae-4c16-984d-2e47f26dd1ef tempest-SnapshotsActionsTest-480286487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:20 devstack sudo[98466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9 Jul 30 16:57:20 devstack sudo[98466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:21 devstack sudo[98466]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-30bbb3d3-14ae-4c16-984d-2e47f26dd1ef tempest-SnapshotsActionsTest-480286487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9" returned: 0 in 0.617s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:21 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-30bbb3d3-14ae-4c16-984d-2e47f26dd1ef tempest-SnapshotsActionsTest-480286487 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:57:21 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[edad9507-b188-42b7-a5e3-c8db3ea973b7]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:57:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-30bbb3d3-14ae-4c16-984d-2e47f26dd1ef tempest-SnapshotsActionsTest-480286487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:21 devstack sudo[98479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a Jul 30 16:57:21 devstack sudo[98479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:21 devstack sudo[98479]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-30bbb3d3-14ae-4c16-984d-2e47f26dd1ef tempest-SnapshotsActionsTest-480286487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a" returned: 0 in 0.538s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-30bbb3d3-14ae-4c16-984d-2e47f26dd1ef tempest-SnapshotsActionsTest-480286487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:21 devstack sudo[98486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9 Jul 30 16:57:21 devstack sudo[98486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:22 devstack sudo[98486]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-30bbb3d3-14ae-4c16-984d-2e47f26dd1ef tempest-SnapshotsActionsTest-480286487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9" returned: 0 in 0.754s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-30bbb3d3-14ae-4c16-984d-2e47f26dd1ef tempest-SnapshotsActionsTest-480286487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:22 devstack sudo[98516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9 Jul 30 16:57:22 devstack sudo[98516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:23 devstack sudo[98516]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-30bbb3d3-14ae-4c16-984d-2e47f26dd1ef tempest-SnapshotsActionsTest-480286487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a.3d1a3634-f80a-410c-98c5-ceda6722caa9" returned: 0 in 0.628s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:23 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-30bbb3d3-14ae-4c16-984d-2e47f26dd1ef tempest-SnapshotsActionsTest-480286487 None] Lock "cinder-quobyte-3d1a3634-f80a-410c-98c5-ceda6722caa9" released by "_delete_snapshot" :: held 2.803s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:57:23 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-30bbb3d3-14ae-4c16-984d-2e47f26dd1ef tempest-SnapshotsActionsTest-480286487 None] Lock "cinder-quobyte-21948154-1938-4f10-8d97-a5c2f2f6ad1a" released by "delete_snapshot" :: held 2.855s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:57:23 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b4e0ac1-5bcc-4153-b201-6e19c12c6f5c tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:57:23 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7b4e0ac1-5bcc-4153-b201-6e19c12c6f5c tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Flow 'volume_create_manager' (b502923d-5366-4f5a-9d26-8262a2e416f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:57:23 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7b4e0ac1-5bcc-4153-b201-6e19c12c6f5c tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbd819cf-f51f-4259-b01a-445af5095752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:23 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7b4e0ac1-5bcc-4153-b201-6e19c12c6f5c tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbd819cf-f51f-4259-b01a-445af5095752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1153819030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac55e716-dda4-4b65-877c-86a98602560d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccc786c26fed4cca8d651c5bcdb8eb2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:57:23Z,use_quota=True,user_id='5c1b938bc9ad4f2c951118e972e9a857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:23 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7b4e0ac1-5bcc-4153-b201-6e19c12c6f5c tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fbf3dc5-d0f6-4773-a83b-dab11095312c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:23 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7b4e0ac1-5bcc-4153-b201-6e19c12c6f5c tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fbf3dc5-d0f6-4773-a83b-dab11095312c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:23 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7b4e0ac1-5bcc-4153-b201-6e19c12c6f5c tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e5168d5-9b8c-4d96-9906-d1598ca8abad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:23 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7b4e0ac1-5bcc-4153-b201-6e19c12c6f5c tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e5168d5-9b8c-4d96-9906-d1598ca8abad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac55e716-dda4-4b65-877c-86a98602560d', 'volume_name': 'volume-ac55e716-dda4-4b65-877c-86a98602560d', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:23 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7b4e0ac1-5bcc-4153-b201-6e19c12c6f5c tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (377062f8-9d1e-4040-b942-1bb9f4bfc616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:23 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7b4e0ac1-5bcc-4153-b201-6e19c12c6f5c tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (377062f8-9d1e-4040-b942-1bb9f4bfc616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:23 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7b4e0ac1-5bcc-4153-b201-6e19c12c6f5c tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c9c4ef7-fa58-424e-a53f-a1c5de5bfb40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:23 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-7b4e0ac1-5bcc-4153-b201-6e19c12c6f5c tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Volume ac55e716-dda4-4b65-877c-86a98602560d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac55e716-dda4-4b65-877c-86a98602560d', 'volume_size': 1} Jul 30 16:57:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7b4e0ac1-5bcc-4153-b201-6e19c12c6f5c tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7b4e0ac1-5bcc-4153-b201-6e19c12c6f5c tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:23 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7b4e0ac1-5bcc-4153-b201-6e19c12c6f5c tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1153819030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac55e716-dda4-4b65-877c-86a98602560d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccc786c26fed4cca8d651c5bcdb8eb2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:57:23Z,use_quota=True,user_id='5c1b938bc9ad4f2c951118e972e9a857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:57:23 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-7b4e0ac1-5bcc-4153-b201-6e19c12c6f5c tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Creating volume ac55e716-dda4-4b65-877c-86a98602560d {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:57:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7b4e0ac1-5bcc-4153-b201-6e19c12c6f5c tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7b4e0ac1-5bcc-4153-b201-6e19c12c6f5c tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:23 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7b4e0ac1-5bcc-4153-b201-6e19c12c6f5c tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:57:23 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7b4e0ac1-5bcc-4153-b201-6e19c12c6f5c tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:57:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7b4e0ac1-5bcc-4153-b201-6e19c12c6f5c tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:23 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7b4e0ac1-5bcc-4153-b201-6e19c12c6f5c tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:57:23 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-7b4e0ac1-5bcc-4153-b201-6e19c12c6f5c tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:57:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7b4e0ac1-5bcc-4153-b201-6e19c12c6f5c tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac55e716-dda4-4b65-877c-86a98602560d 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:23 devstack sudo[98542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac55e716-dda4-4b65-877c-86a98602560d 1073741824 Jul 30 16:57:23 devstack sudo[98542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:23 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-30bbb3d3-14ae-4c16-984d-2e47f26dd1ef tempest-SnapshotsActionsTest-480286487 None] Created reservations ['01f830a9-523c-4015-92f9-a7f9bb2b319e', '16284aaf-638d-4c1a-beaf-696d4958db25', '98e09d4e-2ae9-4ac8-a42a-6a9012fdb96f', '5628bd0f-d37b-447d-91f1-881d656e4f21'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:57:23 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-30bbb3d3-14ae-4c16-984d-2e47f26dd1ef tempest-SnapshotsActionsTest-480286487 None] Delete snapshot completed successfully. Jul 30 16:57:23 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-30bbb3d3-14ae-4c16-984d-2e47f26dd1ef tempest-SnapshotsActionsTest-480286487 None] Lock "cinder-3d1a3634-f80a-410c-98c5-ceda6722caa9-delete_snapshot" released by "delete_snapshot" :: held 3.593s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:57:24 devstack sudo[98542]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7b4e0ac1-5bcc-4153-b201-6e19c12c6f5c tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac55e716-dda4-4b65-877c-86a98602560d 1073741824" returned: 0 in 0.784s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7b4e0ac1-5bcc-4153-b201-6e19c12c6f5c tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac55e716-dda4-4b65-877c-86a98602560d {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:24 devstack sudo[98569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac55e716-dda4-4b65-877c-86a98602560d Jul 30 16:57:24 devstack sudo[98569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:24 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b1a9a75b-9645-4ea8-ba2e-800564b2b971 tempest-SnapshotsActionsTest-480286487 None] Acquiring lock "cinder-21948154-1938-4f10-8d97-a5c2f2f6ad1a-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:57:24 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b1a9a75b-9645-4ea8-ba2e-800564b2b971 tempest-SnapshotsActionsTest-480286487 None] Lock "cinder-21948154-1938-4f10-8d97-a5c2f2f6ad1a-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:57:24 devstack sudo[98569]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7b4e0ac1-5bcc-4153-b201-6e19c12c6f5c tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac55e716-dda4-4b65-877c-86a98602560d" returned: 0 in 0.479s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:25 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7b4e0ac1-5bcc-4153-b201-6e19c12c6f5c tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] <== create_volume: return (1344ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:57:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7b4e0ac1-5bcc-4153-b201-6e19c12c6f5c tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.349s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7b4e0ac1-5bcc-4153-b201-6e19c12c6f5c tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c9c4ef7-fa58-424e-a53f-a1c5de5bfb40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac55e716-dda4-4b65-877c-86a98602560d', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7b4e0ac1-5bcc-4153-b201-6e19c12c6f5c tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31ae8b9d-a141-4ea6-a42a-cf322e8498e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:25 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b1a9a75b-9645-4ea8-ba2e-800564b2b971 tempest-SnapshotsActionsTest-480286487 None] Acquiring lock "cinder-quobyte-21948154-1938-4f10-8d97-a5c2f2f6ad1a" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:57:25 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-7b4e0ac1-5bcc-4153-b201-6e19c12c6f5c tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Volume volume-ac55e716-dda4-4b65-877c-86a98602560d (ac55e716-dda4-4b65-877c-86a98602560d): created successfully Jul 30 16:57:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7b4e0ac1-5bcc-4153-b201-6e19c12c6f5c tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31ae8b9d-a141-4ea6-a42a-cf322e8498e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7b4e0ac1-5bcc-4153-b201-6e19c12c6f5c tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Flow 'volume_create_manager' (b502923d-5366-4f5a-9d26-8262a2e416f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:57:25 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b1a9a75b-9645-4ea8-ba2e-800564b2b971 tempest-SnapshotsActionsTest-480286487 None] Lock "cinder-quobyte-21948154-1938-4f10-8d97-a5c2f2f6ad1a" acquired by "delete_volume" :: waited 0.063s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:57:25 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-7b4e0ac1-5bcc-4153-b201-6e19c12c6f5c tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Created volume successfully. Jul 30 16:57:25 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4a2208-8a24-4280-b586-03cd5fece0f2]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:57:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b1a9a75b-9645-4ea8-ba2e-800564b2b971 tempest-SnapshotsActionsTest-480286487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:25 devstack sudo[98583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a Jul 30 16:57:25 devstack sudo[98583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8e05dbf6-de36-4fe3-8740-fd2f5cc38870 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8e05dbf6-de36-4fe3-8740-fd2f5cc38870 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:26 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-8e05dbf6-de36-4fe3-8740-fd2f5cc38870 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Creating offline snapshot f7a490d6-82b5-4890-aef6-d2d5714e09a1 of volume ac55e716-dda4-4b65-877c-86a98602560d {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:57:26 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[45675dd9-a3b3-4e52-8aa0-90ca51b96f98]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:57:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8e05dbf6-de36-4fe3-8740-fd2f5cc38870 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac55e716-dda4-4b65-877c-86a98602560d {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:26 devstack sudo[98587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac55e716-dda4-4b65-877c-86a98602560d Jul 30 16:57:26 devstack sudo[98587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:26 devstack sudo[98583]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b1a9a75b-9645-4ea8-ba2e-800564b2b971 tempest-SnapshotsActionsTest-480286487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a" returned: 0 in 1.302s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b1a9a75b-9645-4ea8-ba2e-800564b2b971 tempest-SnapshotsActionsTest-480286487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:26 devstack sudo[98593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a Jul 30 16:57:26 devstack sudo[98593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:26 devstack sudo[98587]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8e05dbf6-de36-4fe3-8740-fd2f5cc38870 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac55e716-dda4-4b65-877c-86a98602560d" returned: 0 in 0.785s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8e05dbf6-de36-4fe3-8740-fd2f5cc38870 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac55e716-dda4-4b65-877c-86a98602560d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac55e716-dda4-4b65-877c-86a98602560d.f7a490d6-82b5-4890-aef6-d2d5714e09a1 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:27 devstack sudo[98600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac55e716-dda4-4b65-877c-86a98602560d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac55e716-dda4-4b65-877c-86a98602560d.f7a490d6-82b5-4890-aef6-d2d5714e09a1 1G Jul 30 16:57:27 devstack sudo[98600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:27 devstack sudo[98593]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b1a9a75b-9645-4ea8-ba2e-800564b2b971 tempest-SnapshotsActionsTest-480286487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-21948154-1938-4f10-8d97-a5c2f2f6ad1a" returned: 0 in 0.595s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:27 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b1a9a75b-9645-4ea8-ba2e-800564b2b971 tempest-SnapshotsActionsTest-480286487 None] Lock "cinder-quobyte-21948154-1938-4f10-8d97-a5c2f2f6ad1a" released by "delete_volume" :: held 2.051s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:57:27 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-b1a9a75b-9645-4ea8-ba2e-800564b2b971 tempest-SnapshotsActionsTest-480286487 None] Created reservations ['cdcb8784-000c-4943-b983-8fc221bc6b06', 'ac6807f4-3549-4413-ac69-482771eac15c', 'dccc7c6e-21eb-4999-8ef9-7b06642cf3d7', 'b76dc446-3368-482c-a136-2c4ad914b77f'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:57:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b1a9a75b-9645-4ea8-ba2e-800564b2b971 tempest-SnapshotsActionsTest-480286487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b1a9a75b-9645-4ea8-ba2e-800564b2b971 tempest-SnapshotsActionsTest-480286487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:27 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b1a9a75b-9645-4ea8-ba2e-800564b2b971 tempest-SnapshotsActionsTest-480286487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:57:27 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b1a9a75b-9645-4ea8-ba2e-800564b2b971 tempest-SnapshotsActionsTest-480286487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:57:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b1a9a75b-9645-4ea8-ba2e-800564b2b971 tempest-SnapshotsActionsTest-480286487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b1a9a75b-9645-4ea8-ba2e-800564b2b971 tempest-SnapshotsActionsTest-480286487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:27 devstack sudo[98605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:57:27 devstack sudo[98605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:27 devstack sudo[98600]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8e05dbf6-de36-4fe3-8740-fd2f5cc38870 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac55e716-dda4-4b65-877c-86a98602560d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac55e716-dda4-4b65-877c-86a98602560d.f7a490d6-82b5-4890-aef6-d2d5714e09a1 1G" returned: 0 in 0.975s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8e05dbf6-de36-4fe3-8740-fd2f5cc38870 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac55e716-dda4-4b65-877c-86a98602560d -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac55e716-dda4-4b65-877c-86a98602560d.f7a490d6-82b5-4890-aef6-d2d5714e09a1 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:28 devstack sudo[98608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac55e716-dda4-4b65-877c-86a98602560d -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac55e716-dda4-4b65-877c-86a98602560d.f7a490d6-82b5-4890-aef6-d2d5714e09a1 Jul 30 16:57:28 devstack sudo[98608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:28 devstack sudo[98605]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b1a9a75b-9645-4ea8-ba2e-800564b2b971 tempest-SnapshotsActionsTest-480286487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.642s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:28 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-b1a9a75b-9645-4ea8-ba2e-800564b2b971 tempest-SnapshotsActionsTest-480286487 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:57:28 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-b1a9a75b-9645-4ea8-ba2e-800564b2b971 tempest-SnapshotsActionsTest-480286487 None] Deleted volume successfully. Jul 30 16:57:28 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b1a9a75b-9645-4ea8-ba2e-800564b2b971 tempest-SnapshotsActionsTest-480286487 None] Lock "cinder-21948154-1938-4f10-8d97-a5c2f2f6ad1a-delete_volume" released by "delete_volume" :: held 3.281s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:57:28 devstack sudo[98608]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8e05dbf6-de36-4fe3-8740-fd2f5cc38870 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac55e716-dda4-4b65-877c-86a98602560d -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac55e716-dda4-4b65-877c-86a98602560d.f7a490d6-82b5-4890-aef6-d2d5714e09a1" returned: 0 in 0.806s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:28 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-8e05dbf6-de36-4fe3-8740-fd2f5cc38870 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac55e716-dda4-4b65-877c-86a98602560d.f7a490d6-82b5-4890-aef6-d2d5714e09a1 is being set with open permissions: ugo+rw Jul 30 16:57:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8e05dbf6-de36-4fe3-8740-fd2f5cc38870 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac55e716-dda4-4b65-877c-86a98602560d.f7a490d6-82b5-4890-aef6-d2d5714e09a1 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:28 devstack sudo[98615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac55e716-dda4-4b65-877c-86a98602560d.f7a490d6-82b5-4890-aef6-d2d5714e09a1 Jul 30 16:57:28 devstack sudo[98615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:29 devstack sudo[98615]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8e05dbf6-de36-4fe3-8740-fd2f5cc38870 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac55e716-dda4-4b65-877c-86a98602560d.f7a490d6-82b5-4890-aef6-d2d5714e09a1" returned: 0 in 0.639s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8e05dbf6-de36-4fe3-8740-fd2f5cc38870 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac55e716-dda4-4b65-877c-86a98602560d.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:29 devstack sudo[98618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac55e716-dda4-4b65-877c-86a98602560d.info Jul 30 16:57:29 devstack sudo[98618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:29 devstack sudo[98618]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8e05dbf6-de36-4fe3-8740-fd2f5cc38870 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac55e716-dda4-4b65-877c-86a98602560d.info" returned: 0 in 0.494s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:29 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-8e05dbf6-de36-4fe3-8740-fd2f5cc38870 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac55e716-dda4-4b65-877c-86a98602560d.info is being set with open permissions: ugo+rw Jul 30 16:57:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8e05dbf6-de36-4fe3-8740-fd2f5cc38870 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac55e716-dda4-4b65-877c-86a98602560d.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:30 devstack sudo[98621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac55e716-dda4-4b65-877c-86a98602560d.info Jul 30 16:57:30 devstack sudo[98621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:30 devstack sudo[98621]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8e05dbf6-de36-4fe3-8740-fd2f5cc38870 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac55e716-dda4-4b65-877c-86a98602560d.info" returned: 0 in 0.387s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8e05dbf6-de36-4fe3-8740-fd2f5cc38870 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.390s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:30 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-8e05dbf6-de36-4fe3-8740-fd2f5cc38870 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Create snapshot completed successfully Jul 30 16:57:32 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-3852e23b-7255-477d-9487-5338de672dc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Acquiring lock "cinder-f7a490d6-82b5-4890-aef6-d2d5714e09a1-delete_snapshot" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:57:32 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-3852e23b-7255-477d-9487-5338de672dc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Lock "cinder-f7a490d6-82b5-4890-aef6-d2d5714e09a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.069s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:57:32 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-3852e23b-7255-477d-9487-5338de672dc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Acquiring lock "cinder-quobyte-ac55e716-dda4-4b65-877c-86a98602560d" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:57:32 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-3852e23b-7255-477d-9487-5338de672dc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Lock "cinder-quobyte-ac55e716-dda4-4b65-877c-86a98602560d" acquired by "delete_snapshot" :: waited 0.043s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:57:32 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-3852e23b-7255-477d-9487-5338de672dc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Acquiring lock "cinder-quobyte-f7a490d6-82b5-4890-aef6-d2d5714e09a1" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:57:32 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-3852e23b-7255-477d-9487-5338de672dc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Lock "cinder-quobyte-f7a490d6-82b5-4890-aef6-d2d5714e09a1" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:57:32 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-3852e23b-7255-477d-9487-5338de672dc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Deleting offline snapshot f7a490d6-82b5-4890-aef6-d2d5714e09a1 of volume ac55e716-dda4-4b65-877c-86a98602560d {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:57:32 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-3852e23b-7255-477d-9487-5338de672dc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] snapshot_file for this snap is: volume-ac55e716-dda4-4b65-877c-86a98602560d.f7a490d6-82b5-4890-aef6-d2d5714e09a1 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:57:32 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab8b5e7-ce0c-4403-bbc7-ba0ca90cd2b3]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:57:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3852e23b-7255-477d-9487-5338de672dc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac55e716-dda4-4b65-877c-86a98602560d.f7a490d6-82b5-4890-aef6-d2d5714e09a1 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:32 devstack sudo[98629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac55e716-dda4-4b65-877c-86a98602560d.f7a490d6-82b5-4890-aef6-d2d5714e09a1 Jul 30 16:57:32 devstack sudo[98629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:33 devstack sudo[98629]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3852e23b-7255-477d-9487-5338de672dc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac55e716-dda4-4b65-877c-86a98602560d.f7a490d6-82b5-4890-aef6-d2d5714e09a1" returned: 0 in 0.844s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:33 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-3852e23b-7255-477d-9487-5338de672dc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac55e716-dda4-4b65-877c-86a98602560d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:57:33 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5d6450-589e-4f0c-9937-cb1ccfd6aef7]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:57:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3852e23b-7255-477d-9487-5338de672dc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac55e716-dda4-4b65-877c-86a98602560d {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:33 devstack sudo[98635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac55e716-dda4-4b65-877c-86a98602560d Jul 30 16:57:33 devstack sudo[98635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:33 devstack sudo[98635]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3852e23b-7255-477d-9487-5338de672dc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac55e716-dda4-4b65-877c-86a98602560d" returned: 0 in 0.526s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3852e23b-7255-477d-9487-5338de672dc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac55e716-dda4-4b65-877c-86a98602560d.f7a490d6-82b5-4890-aef6-d2d5714e09a1 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:33 devstack sudo[98640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac55e716-dda4-4b65-877c-86a98602560d.f7a490d6-82b5-4890-aef6-d2d5714e09a1 Jul 30 16:57:33 devstack sudo[98640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:34 devstack sudo[98640]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3852e23b-7255-477d-9487-5338de672dc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac55e716-dda4-4b65-877c-86a98602560d.f7a490d6-82b5-4890-aef6-d2d5714e09a1" returned: 0 in 0.476s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3852e23b-7255-477d-9487-5338de672dc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac55e716-dda4-4b65-877c-86a98602560d.f7a490d6-82b5-4890-aef6-d2d5714e09a1 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:34 devstack sudo[98645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac55e716-dda4-4b65-877c-86a98602560d.f7a490d6-82b5-4890-aef6-d2d5714e09a1 Jul 30 16:57:34 devstack sudo[98645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:34 devstack sudo[98645]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3852e23b-7255-477d-9487-5338de672dc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac55e716-dda4-4b65-877c-86a98602560d.f7a490d6-82b5-4890-aef6-d2d5714e09a1" returned: 0 in 0.447s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:34 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-3852e23b-7255-477d-9487-5338de672dc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Lock "cinder-quobyte-f7a490d6-82b5-4890-aef6-d2d5714e09a1" released by "_delete_snapshot" :: held 2.501s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:57:34 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-3852e23b-7255-477d-9487-5338de672dc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Lock "cinder-quobyte-ac55e716-dda4-4b65-877c-86a98602560d" released by "delete_snapshot" :: held 2.560s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:57:34 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-3852e23b-7255-477d-9487-5338de672dc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Created reservations ['41d3e691-f0c3-4828-974b-cbce6e505572', '3dc93575-1840-41e3-a573-614f8fe38f6d', 'c2579eb8-eaaa-4b97-ae35-67f9a658fcf1', 'bcc1e615-7cb4-4da3-8659-b7d0602c0e1c'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:57:34 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-3852e23b-7255-477d-9487-5338de672dc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Delete snapshot completed successfully. Jul 30 16:57:34 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-3852e23b-7255-477d-9487-5338de672dc6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Lock "cinder-f7a490d6-82b5-4890-aef6-d2d5714e09a1-delete_snapshot" released by "delete_snapshot" :: held 2.856s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:57:35 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c2bb58b8-feeb-4532-9173-4a17b73d04d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Acquiring lock "cinder-ac55e716-dda4-4b65-877c-86a98602560d-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:57:35 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c2bb58b8-feeb-4532-9173-4a17b73d04d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Lock "cinder-ac55e716-dda4-4b65-877c-86a98602560d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:57:35 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c2bb58b8-feeb-4532-9173-4a17b73d04d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Acquiring lock "cinder-quobyte-ac55e716-dda4-4b65-877c-86a98602560d" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:57:35 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c2bb58b8-feeb-4532-9173-4a17b73d04d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Lock "cinder-quobyte-ac55e716-dda4-4b65-877c-86a98602560d" acquired by "delete_volume" :: waited 0.023s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:57:35 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[663ab071-52d8-4a65-a613-f4a38d1be0c5]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:57:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c2bb58b8-feeb-4532-9173-4a17b73d04d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac55e716-dda4-4b65-877c-86a98602560d {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:35 devstack sudo[98648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac55e716-dda4-4b65-877c-86a98602560d Jul 30 16:57:35 devstack sudo[98648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:36 devstack sudo[98648]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c2bb58b8-feeb-4532-9173-4a17b73d04d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac55e716-dda4-4b65-877c-86a98602560d" returned: 0 in 0.498s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c2bb58b8-feeb-4532-9173-4a17b73d04d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac55e716-dda4-4b65-877c-86a98602560d {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:36 devstack sudo[98654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac55e716-dda4-4b65-877c-86a98602560d Jul 30 16:57:36 devstack sudo[98654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:36 devstack sudo[98654]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c2bb58b8-feeb-4532-9173-4a17b73d04d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ac55e716-dda4-4b65-877c-86a98602560d" returned: 0 in 0.309s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:36 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c2bb58b8-feeb-4532-9173-4a17b73d04d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Lock "cinder-quobyte-ac55e716-dda4-4b65-877c-86a98602560d" released by "delete_volume" :: held 0.923s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:57:36 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-c2bb58b8-feeb-4532-9173-4a17b73d04d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Created reservations ['74b6035b-d41b-42ee-88ef-e2822cadf2f3', '1216bf24-9e90-490b-bae5-a5a44dafa810', '53d4e190-a014-4426-bbd4-5d9d696d5942', '204b4df0-9977-47c8-913b-43c7f5cfb9a7'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:57:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c2bb58b8-feeb-4532-9173-4a17b73d04d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c2bb58b8-feeb-4532-9173-4a17b73d04d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:36 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-c2bb58b8-feeb-4532-9173-4a17b73d04d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:57:36 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-c2bb58b8-feeb-4532-9173-4a17b73d04d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:57:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c2bb58b8-feeb-4532-9173-4a17b73d04d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c2bb58b8-feeb-4532-9173-4a17b73d04d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:36 devstack sudo[98657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:57:36 devstack sudo[98657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:37 devstack sudo[98657]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c2bb58b8-feeb-4532-9173-4a17b73d04d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.299s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:37 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-c2bb58b8-feeb-4532-9173-4a17b73d04d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:57:37 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-c2bb58b8-feeb-4532-9173-4a17b73d04d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Deleted volume successfully. Jul 30 16:57:37 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c2bb58b8-feeb-4532-9173-4a17b73d04d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2027085229 None] Lock "cinder-ac55e716-dda4-4b65-877c-86a98602560d-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:57:38 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-b64b7305-f2b5-4288-a6b1-9c808d7d95f2 tempest-VolumeRetypeWithoutMigrationTest-309367895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:57:38 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b64b7305-f2b5-4288-a6b1-9c808d7d95f2 tempest-VolumeRetypeWithoutMigrationTest-309367895 None] Flow 'volume_create_manager' (94eb9d82-7ca0-4a3d-a48f-c2a352855f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:57:38 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b64b7305-f2b5-4288-a6b1-9c808d7d95f2 tempest-VolumeRetypeWithoutMigrationTest-309367895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e0dbf47-5cc6-48eb-8ef4-231088af3981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:38 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b64b7305-f2b5-4288-a6b1-9c808d7d95f2 tempest-VolumeRetypeWithoutMigrationTest-309367895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e0dbf47-5cc6-48eb-8ef4-231088af3981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-613119243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41ebac6b-4269-4fd5-9fc9-f59a07d9f6a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbdeb0d3bac84d5aae11044bf070ab1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:57:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:57:39Z,use_quota=True,user_id='49d702491af344189eae1305e39be79d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d7f22be-c4d9-4fe5-891a-90a6a786b8b1),volume_type_id=5d7f22be-c4d9-4fe5-891a-90a6a786b8b1)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:38 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b64b7305-f2b5-4288-a6b1-9c808d7d95f2 tempest-VolumeRetypeWithoutMigrationTest-309367895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff04e12b-b03b-4b4a-94c8-c5206278c92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:38 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b64b7305-f2b5-4288-a6b1-9c808d7d95f2 tempest-VolumeRetypeWithoutMigrationTest-309367895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff04e12b-b03b-4b4a-94c8-c5206278c92b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:38 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b64b7305-f2b5-4288-a6b1-9c808d7d95f2 tempest-VolumeRetypeWithoutMigrationTest-309367895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7eff0a4-c44e-4fba-933f-27eb2747f542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:38 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b64b7305-f2b5-4288-a6b1-9c808d7d95f2 tempest-VolumeRetypeWithoutMigrationTest-309367895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7eff0a4-c44e-4fba-933f-27eb2747f542) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41ebac6b-4269-4fd5-9fc9-f59a07d9f6a3', 'volume_name': 'volume-41ebac6b-4269-4fd5-9fc9-f59a07d9f6a3', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:38 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b64b7305-f2b5-4288-a6b1-9c808d7d95f2 tempest-VolumeRetypeWithoutMigrationTest-309367895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (712b83b4-13b6-474e-b799-94ee89e3ecf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:38 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b64b7305-f2b5-4288-a6b1-9c808d7d95f2 tempest-VolumeRetypeWithoutMigrationTest-309367895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (712b83b4-13b6-474e-b799-94ee89e3ecf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:38 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b64b7305-f2b5-4288-a6b1-9c808d7d95f2 tempest-VolumeRetypeWithoutMigrationTest-309367895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c8061d2-a582-40f2-b2b8-9ec34359e3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:38 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-b64b7305-f2b5-4288-a6b1-9c808d7d95f2 tempest-VolumeRetypeWithoutMigrationTest-309367895 None] Volume 41ebac6b-4269-4fd5-9fc9-f59a07d9f6a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41ebac6b-4269-4fd5-9fc9-f59a07d9f6a3', 'volume_size': 1} Jul 30 16:57:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b64b7305-f2b5-4288-a6b1-9c808d7d95f2 tempest-VolumeRetypeWithoutMigrationTest-309367895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b64b7305-f2b5-4288-a6b1-9c808d7d95f2 tempest-VolumeRetypeWithoutMigrationTest-309367895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:38 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b64b7305-f2b5-4288-a6b1-9c808d7d95f2 tempest-VolumeRetypeWithoutMigrationTest-309367895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-613119243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41ebac6b-4269-4fd5-9fc9-f59a07d9f6a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbdeb0d3bac84d5aae11044bf070ab1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:57:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:57:39Z,use_quota=True,user_id='49d702491af344189eae1305e39be79d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d7f22be-c4d9-4fe5-891a-90a6a786b8b1),volume_type_id=5d7f22be-c4d9-4fe5-891a-90a6a786b8b1)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:57:38 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-b64b7305-f2b5-4288-a6b1-9c808d7d95f2 tempest-VolumeRetypeWithoutMigrationTest-309367895 None] Creating volume 41ebac6b-4269-4fd5-9fc9-f59a07d9f6a3 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:57:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b64b7305-f2b5-4288-a6b1-9c808d7d95f2 tempest-VolumeRetypeWithoutMigrationTest-309367895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b64b7305-f2b5-4288-a6b1-9c808d7d95f2 tempest-VolumeRetypeWithoutMigrationTest-309367895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:38 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b64b7305-f2b5-4288-a6b1-9c808d7d95f2 tempest-VolumeRetypeWithoutMigrationTest-309367895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:57:38 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b64b7305-f2b5-4288-a6b1-9c808d7d95f2 tempest-VolumeRetypeWithoutMigrationTest-309367895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:57:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b64b7305-f2b5-4288-a6b1-9c808d7d95f2 tempest-VolumeRetypeWithoutMigrationTest-309367895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:38 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b64b7305-f2b5-4288-a6b1-9c808d7d95f2 tempest-VolumeRetypeWithoutMigrationTest-309367895 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:57:38 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-b64b7305-f2b5-4288-a6b1-9c808d7d95f2 tempest-VolumeRetypeWithoutMigrationTest-309367895 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:57:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b64b7305-f2b5-4288-a6b1-9c808d7d95f2 tempest-VolumeRetypeWithoutMigrationTest-309367895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-41ebac6b-4269-4fd5-9fc9-f59a07d9f6a3 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:38 devstack sudo[98684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-41ebac6b-4269-4fd5-9fc9-f59a07d9f6a3 1073741824 Jul 30 16:57:38 devstack sudo[98684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:39 devstack sudo[98684]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b64b7305-f2b5-4288-a6b1-9c808d7d95f2 tempest-VolumeRetypeWithoutMigrationTest-309367895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-41ebac6b-4269-4fd5-9fc9-f59a07d9f6a3 1073741824" returned: 0 in 0.612s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b64b7305-f2b5-4288-a6b1-9c808d7d95f2 tempest-VolumeRetypeWithoutMigrationTest-309367895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-41ebac6b-4269-4fd5-9fc9-f59a07d9f6a3 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:39 devstack sudo[98689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-41ebac6b-4269-4fd5-9fc9-f59a07d9f6a3 Jul 30 16:57:39 devstack sudo[98689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:39 devstack sudo[98689]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b64b7305-f2b5-4288-a6b1-9c808d7d95f2 tempest-VolumeRetypeWithoutMigrationTest-309367895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-41ebac6b-4269-4fd5-9fc9-f59a07d9f6a3" returned: 0 in 0.404s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:39 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b64b7305-f2b5-4288-a6b1-9c808d7d95f2 tempest-VolumeRetypeWithoutMigrationTest-309367895 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:57:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b64b7305-f2b5-4288-a6b1-9c808d7d95f2 tempest-VolumeRetypeWithoutMigrationTest-309367895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b64b7305-f2b5-4288-a6b1-9c808d7d95f2 tempest-VolumeRetypeWithoutMigrationTest-309367895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c8061d2-a582-40f2-b2b8-9ec34359e3a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41ebac6b-4269-4fd5-9fc9-f59a07d9f6a3', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b64b7305-f2b5-4288-a6b1-9c808d7d95f2 tempest-VolumeRetypeWithoutMigrationTest-309367895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5ab7750-7e51-4f8b-999e-aac0ee193634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:40 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-b64b7305-f2b5-4288-a6b1-9c808d7d95f2 tempest-VolumeRetypeWithoutMigrationTest-309367895 None] Volume volume-41ebac6b-4269-4fd5-9fc9-f59a07d9f6a3 (41ebac6b-4269-4fd5-9fc9-f59a07d9f6a3): created successfully Jul 30 16:57:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b64b7305-f2b5-4288-a6b1-9c808d7d95f2 tempest-VolumeRetypeWithoutMigrationTest-309367895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5ab7750-7e51-4f8b-999e-aac0ee193634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b64b7305-f2b5-4288-a6b1-9c808d7d95f2 tempest-VolumeRetypeWithoutMigrationTest-309367895 None] Flow 'volume_create_manager' (94eb9d82-7ca0-4a3d-a48f-c2a352855f09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:57:40 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-b64b7305-f2b5-4288-a6b1-9c808d7d95f2 tempest-VolumeRetypeWithoutMigrationTest-309367895 None] Created volume successfully. Jul 30 16:57:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-cff20c34-adad-4bbb-8b54-de3fb9933e72 tempest-VolumeRetypeWithoutMigrationTest-309367895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-cff20c34-adad-4bbb-8b54-de3fb9933e72 tempest-VolumeRetypeWithoutMigrationTest-309367895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:41 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-cff20c34-adad-4bbb-8b54-de3fb9933e72 tempest-VolumeRetypeWithoutMigrationTest-309367895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:57:41 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-cff20c34-adad-4bbb-8b54-de3fb9933e72 tempest-VolumeRetypeWithoutMigrationTest-309367895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:57:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-cff20c34-adad-4bbb-8b54-de3fb9933e72 tempest-VolumeRetypeWithoutMigrationTest-309367895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cff20c34-adad-4bbb-8b54-de3fb9933e72 tempest-VolumeRetypeWithoutMigrationTest-309367895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:41 devstack sudo[98718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:57:41 devstack sudo[98718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:41 devstack sudo[98718]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cff20c34-adad-4bbb-8b54-de3fb9933e72 tempest-VolumeRetypeWithoutMigrationTest-309367895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.355s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:41 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-cff20c34-adad-4bbb-8b54-de3fb9933e72 tempest-VolumeRetypeWithoutMigrationTest-309367895 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:57:41 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-cff20c34-adad-4bbb-8b54-de3fb9933e72 tempest-VolumeRetypeWithoutMigrationTest-309367895 None] Retype volume completed successfully. Jul 30 16:57:42 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-3d28940b-9c0a-4ec6-964f-c855a961debd tempest-VolumeRetypeWithoutMigrationTest-309367895 None] Acquiring lock "cinder-41ebac6b-4269-4fd5-9fc9-f59a07d9f6a3-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:57:42 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-3d28940b-9c0a-4ec6-964f-c855a961debd tempest-VolumeRetypeWithoutMigrationTest-309367895 None] Lock "cinder-41ebac6b-4269-4fd5-9fc9-f59a07d9f6a3-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:57:42 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-3d28940b-9c0a-4ec6-964f-c855a961debd tempest-VolumeRetypeWithoutMigrationTest-309367895 None] Acquiring lock "cinder-quobyte-41ebac6b-4269-4fd5-9fc9-f59a07d9f6a3" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:57:42 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-3d28940b-9c0a-4ec6-964f-c855a961debd tempest-VolumeRetypeWithoutMigrationTest-309367895 None] Lock "cinder-quobyte-41ebac6b-4269-4fd5-9fc9-f59a07d9f6a3" acquired by "delete_volume" :: waited 0.015s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:57:42 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b141ee11-99f3-452a-8cc9-d4a4e3512386]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:57:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3d28940b-9c0a-4ec6-964f-c855a961debd tempest-VolumeRetypeWithoutMigrationTest-309367895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-41ebac6b-4269-4fd5-9fc9-f59a07d9f6a3 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:42 devstack sudo[98730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-41ebac6b-4269-4fd5-9fc9-f59a07d9f6a3 Jul 30 16:57:42 devstack sudo[98730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:43 devstack sudo[98730]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3d28940b-9c0a-4ec6-964f-c855a961debd tempest-VolumeRetypeWithoutMigrationTest-309367895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-41ebac6b-4269-4fd5-9fc9-f59a07d9f6a3" returned: 0 in 0.390s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3d28940b-9c0a-4ec6-964f-c855a961debd tempest-VolumeRetypeWithoutMigrationTest-309367895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-41ebac6b-4269-4fd5-9fc9-f59a07d9f6a3 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:43 devstack sudo[98735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-41ebac6b-4269-4fd5-9fc9-f59a07d9f6a3 Jul 30 16:57:43 devstack sudo[98735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:43 devstack sudo[98735]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3d28940b-9c0a-4ec6-964f-c855a961debd tempest-VolumeRetypeWithoutMigrationTest-309367895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-41ebac6b-4269-4fd5-9fc9-f59a07d9f6a3" returned: 0 in 0.252s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:43 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-3d28940b-9c0a-4ec6-964f-c855a961debd tempest-VolumeRetypeWithoutMigrationTest-309367895 None] Lock "cinder-quobyte-41ebac6b-4269-4fd5-9fc9-f59a07d9f6a3" released by "delete_volume" :: held 0.684s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:57:43 devstack cinder-volume[88591]: WARNING cinder.quota [None req-3d28940b-9c0a-4ec6-964f-c855a961debd tempest-VolumeRetypeWithoutMigrationTest-309367895 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:57:43 devstack cinder-volume[88591]: WARNING cinder.quota [None req-3d28940b-9c0a-4ec6-964f-c855a961debd tempest-VolumeRetypeWithoutMigrationTest-309367895 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:57:43 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-3d28940b-9c0a-4ec6-964f-c855a961debd tempest-VolumeRetypeWithoutMigrationTest-309367895 None] Created reservations ['356277f0-781a-4726-90bc-5679f1d68396', 'bb3ebaff-4f61-40dc-814c-0feb3bf00ddf', 'c71982cd-8647-4f2e-bd62-b75ed5c3ceaf', '85ffa88e-84de-4926-a21c-5bd8f825c5c7'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:57:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3d28940b-9c0a-4ec6-964f-c855a961debd tempest-VolumeRetypeWithoutMigrationTest-309367895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3d28940b-9c0a-4ec6-964f-c855a961debd tempest-VolumeRetypeWithoutMigrationTest-309367895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:43 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-3d28940b-9c0a-4ec6-964f-c855a961debd tempest-VolumeRetypeWithoutMigrationTest-309367895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:57:43 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-3d28940b-9c0a-4ec6-964f-c855a961debd tempest-VolumeRetypeWithoutMigrationTest-309367895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:57:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3d28940b-9c0a-4ec6-964f-c855a961debd tempest-VolumeRetypeWithoutMigrationTest-309367895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3d28940b-9c0a-4ec6-964f-c855a961debd tempest-VolumeRetypeWithoutMigrationTest-309367895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:43 devstack sudo[98748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:57:43 devstack sudo[98748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:43 devstack sudo[98748]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3d28940b-9c0a-4ec6-964f-c855a961debd tempest-VolumeRetypeWithoutMigrationTest-309367895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.321s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:43 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-3d28940b-9c0a-4ec6-964f-c855a961debd tempest-VolumeRetypeWithoutMigrationTest-309367895 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:57:43 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-3d28940b-9c0a-4ec6-964f-c855a961debd tempest-VolumeRetypeWithoutMigrationTest-309367895 None] Deleted volume successfully. Jul 30 16:57:43 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-3d28940b-9c0a-4ec6-964f-c855a961debd tempest-VolumeRetypeWithoutMigrationTest-309367895 None] Lock "cinder-41ebac6b-4269-4fd5-9fc9-f59a07d9f6a3-delete_volume" released by "delete_volume" :: held 1.240s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:57:47 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:UPDATE=120,cinder:DELETE=12,cinder:SELECT=89,cinder:INSERT=28 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:57:47 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:SELECT=120,cinder:INSERT=37,cinder:UPDATE=92,cinder:DELETE=5 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:57:47 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-81fcd565-a47e-4b76-bf0f-9b1c360bd210 tempest-AbsoluteLimitsTests-1990791446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:57:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-81fcd565-a47e-4b76-bf0f-9b1c360bd210 tempest-AbsoluteLimitsTests-1990791446 None] Flow 'volume_create_manager' (da35ed97-ee2b-42f9-8567-c5b50f8e8451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:57:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-81fcd565-a47e-4b76-bf0f-9b1c360bd210 tempest-AbsoluteLimitsTests-1990791446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a05529f-736d-4edf-849f-14185ce9c3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-81fcd565-a47e-4b76-bf0f-9b1c360bd210 tempest-AbsoluteLimitsTests-1990791446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a05529f-736d-4edf-849f-14185ce9c3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1486725755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=055902eb-44b0-41b3-a2e0-77bdb4d8f1ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f09c1099933846069a0038e5411a2ff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:57:47Z,use_quota=True,user_id='03e3dc9bf9ec4621839db2db5c880e81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-81fcd565-a47e-4b76-bf0f-9b1c360bd210 tempest-AbsoluteLimitsTests-1990791446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c33c4431-c465-4c80-94a4-6ec2129fb926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-81fcd565-a47e-4b76-bf0f-9b1c360bd210 tempest-AbsoluteLimitsTests-1990791446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c33c4431-c465-4c80-94a4-6ec2129fb926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-81fcd565-a47e-4b76-bf0f-9b1c360bd210 tempest-AbsoluteLimitsTests-1990791446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (564faa12-89c6-4368-8698-44f4a06b7311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-81fcd565-a47e-4b76-bf0f-9b1c360bd210 tempest-AbsoluteLimitsTests-1990791446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (564faa12-89c6-4368-8698-44f4a06b7311) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '055902eb-44b0-41b3-a2e0-77bdb4d8f1ee', 'volume_name': 'volume-055902eb-44b0-41b3-a2e0-77bdb4d8f1ee', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-81fcd565-a47e-4b76-bf0f-9b1c360bd210 tempest-AbsoluteLimitsTests-1990791446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10354e1f-537c-4ae8-ad6e-5df8f9c50c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-81fcd565-a47e-4b76-bf0f-9b1c360bd210 tempest-AbsoluteLimitsTests-1990791446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10354e1f-537c-4ae8-ad6e-5df8f9c50c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-81fcd565-a47e-4b76-bf0f-9b1c360bd210 tempest-AbsoluteLimitsTests-1990791446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a3fddf1-ae38-4341-b54b-2796dec9161c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:47 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-81fcd565-a47e-4b76-bf0f-9b1c360bd210 tempest-AbsoluteLimitsTests-1990791446 None] Volume 055902eb-44b0-41b3-a2e0-77bdb4d8f1ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-055902eb-44b0-41b3-a2e0-77bdb4d8f1ee', 'volume_size': 1} Jul 30 16:57:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-81fcd565-a47e-4b76-bf0f-9b1c360bd210 tempest-AbsoluteLimitsTests-1990791446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-81fcd565-a47e-4b76-bf0f-9b1c360bd210 tempest-AbsoluteLimitsTests-1990791446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:47 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-81fcd565-a47e-4b76-bf0f-9b1c360bd210 tempest-AbsoluteLimitsTests-1990791446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1486725755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=055902eb-44b0-41b3-a2e0-77bdb4d8f1ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f09c1099933846069a0038e5411a2ff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:57:47Z,use_quota=True,user_id='03e3dc9bf9ec4621839db2db5c880e81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:57:47 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-81fcd565-a47e-4b76-bf0f-9b1c360bd210 tempest-AbsoluteLimitsTests-1990791446 None] Creating volume 055902eb-44b0-41b3-a2e0-77bdb4d8f1ee {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:57:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-81fcd565-a47e-4b76-bf0f-9b1c360bd210 tempest-AbsoluteLimitsTests-1990791446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-81fcd565-a47e-4b76-bf0f-9b1c360bd210 tempest-AbsoluteLimitsTests-1990791446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:47 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-81fcd565-a47e-4b76-bf0f-9b1c360bd210 tempest-AbsoluteLimitsTests-1990791446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:57:47 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-81fcd565-a47e-4b76-bf0f-9b1c360bd210 tempest-AbsoluteLimitsTests-1990791446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:57:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-81fcd565-a47e-4b76-bf0f-9b1c360bd210 tempest-AbsoluteLimitsTests-1990791446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:47 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-81fcd565-a47e-4b76-bf0f-9b1c360bd210 tempest-AbsoluteLimitsTests-1990791446 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:57:47 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-81fcd565-a47e-4b76-bf0f-9b1c360bd210 tempest-AbsoluteLimitsTests-1990791446 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:57:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-81fcd565-a47e-4b76-bf0f-9b1c360bd210 tempest-AbsoluteLimitsTests-1990791446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-055902eb-44b0-41b3-a2e0-77bdb4d8f1ee 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:47 devstack sudo[98777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-055902eb-44b0-41b3-a2e0-77bdb4d8f1ee 1073741824 Jul 30 16:57:47 devstack sudo[98777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:47 devstack sudo[98777]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-81fcd565-a47e-4b76-bf0f-9b1c360bd210 tempest-AbsoluteLimitsTests-1990791446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-055902eb-44b0-41b3-a2e0-77bdb4d8f1ee 1073741824" returned: 0 in 0.500s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-81fcd565-a47e-4b76-bf0f-9b1c360bd210 tempest-AbsoluteLimitsTests-1990791446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-055902eb-44b0-41b3-a2e0-77bdb4d8f1ee {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:47 devstack sudo[98783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-055902eb-44b0-41b3-a2e0-77bdb4d8f1ee Jul 30 16:57:47 devstack sudo[98783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:48 devstack sudo[98783]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-81fcd565-a47e-4b76-bf0f-9b1c360bd210 tempest-AbsoluteLimitsTests-1990791446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-055902eb-44b0-41b3-a2e0-77bdb4d8f1ee" returned: 0 in 0.351s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:48 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-81fcd565-a47e-4b76-bf0f-9b1c360bd210 tempest-AbsoluteLimitsTests-1990791446 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:57:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-81fcd565-a47e-4b76-bf0f-9b1c360bd210 tempest-AbsoluteLimitsTests-1990791446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:48 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-81fcd565-a47e-4b76-bf0f-9b1c360bd210 tempest-AbsoluteLimitsTests-1990791446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a3fddf1-ae38-4341-b54b-2796dec9161c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-055902eb-44b0-41b3-a2e0-77bdb4d8f1ee', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:48 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-81fcd565-a47e-4b76-bf0f-9b1c360bd210 tempest-AbsoluteLimitsTests-1990791446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4478e281-3833-4620-81cf-9d10fa437c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:48 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-81fcd565-a47e-4b76-bf0f-9b1c360bd210 tempest-AbsoluteLimitsTests-1990791446 None] Volume volume-055902eb-44b0-41b3-a2e0-77bdb4d8f1ee (055902eb-44b0-41b3-a2e0-77bdb4d8f1ee): created successfully Jul 30 16:57:48 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-81fcd565-a47e-4b76-bf0f-9b1c360bd210 tempest-AbsoluteLimitsTests-1990791446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4478e281-3833-4620-81cf-9d10fa437c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:48 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-81fcd565-a47e-4b76-bf0f-9b1c360bd210 tempest-AbsoluteLimitsTests-1990791446 None] Flow 'volume_create_manager' (da35ed97-ee2b-42f9-8567-c5b50f8e8451) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:57:48 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-81fcd565-a47e-4b76-bf0f-9b1c360bd210 tempest-AbsoluteLimitsTests-1990791446 None] Created volume successfully. Jul 30 16:57:49 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-0c73c268-6e66-4475-8e06-8e89c9935bc6 tempest-AbsoluteLimitsTests-1990791446 None] Acquiring lock "cinder-055902eb-44b0-41b3-a2e0-77bdb4d8f1ee-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:57:49 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-0c73c268-6e66-4475-8e06-8e89c9935bc6 tempest-AbsoluteLimitsTests-1990791446 None] Lock "cinder-055902eb-44b0-41b3-a2e0-77bdb4d8f1ee-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:57:49 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-0c73c268-6e66-4475-8e06-8e89c9935bc6 tempest-AbsoluteLimitsTests-1990791446 None] Acquiring lock "cinder-quobyte-055902eb-44b0-41b3-a2e0-77bdb4d8f1ee" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:57:49 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-0c73c268-6e66-4475-8e06-8e89c9935bc6 tempest-AbsoluteLimitsTests-1990791446 None] Lock "cinder-quobyte-055902eb-44b0-41b3-a2e0-77bdb4d8f1ee" acquired by "delete_volume" :: waited 0.044s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:57:49 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[78bdacdb-153d-412a-a9a8-8f984c411445]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:57:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0c73c268-6e66-4475-8e06-8e89c9935bc6 tempest-AbsoluteLimitsTests-1990791446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-055902eb-44b0-41b3-a2e0-77bdb4d8f1ee {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:49 devstack sudo[98796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-055902eb-44b0-41b3-a2e0-77bdb4d8f1ee Jul 30 16:57:49 devstack sudo[98796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:50 devstack sudo[98796]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0c73c268-6e66-4475-8e06-8e89c9935bc6 tempest-AbsoluteLimitsTests-1990791446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-055902eb-44b0-41b3-a2e0-77bdb4d8f1ee" returned: 0 in 0.531s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0c73c268-6e66-4475-8e06-8e89c9935bc6 tempest-AbsoluteLimitsTests-1990791446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-055902eb-44b0-41b3-a2e0-77bdb4d8f1ee {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:50 devstack sudo[98807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-055902eb-44b0-41b3-a2e0-77bdb4d8f1ee Jul 30 16:57:50 devstack sudo[98807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:50 devstack sudo[98807]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0c73c268-6e66-4475-8e06-8e89c9935bc6 tempest-AbsoluteLimitsTests-1990791446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-055902eb-44b0-41b3-a2e0-77bdb4d8f1ee" returned: 0 in 0.414s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:50 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-0c73c268-6e66-4475-8e06-8e89c9935bc6 tempest-AbsoluteLimitsTests-1990791446 None] Lock "cinder-quobyte-055902eb-44b0-41b3-a2e0-77bdb4d8f1ee" released by "delete_volume" :: held 1.035s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:57:50 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-0c73c268-6e66-4475-8e06-8e89c9935bc6 tempest-AbsoluteLimitsTests-1990791446 None] Created reservations ['9b268316-fe9d-4733-b5de-6eca73a55613', 'de47c376-bab0-4d7d-9904-93128ef6cb4a', '715b285c-987c-45d4-b212-8af0a8639365', '91318f73-d469-4d98-9ee9-0f4acadbdc1f'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:57:50 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-4777faf4-ac3a-4174-bdfd-b93d09634eec tempest-VolumesTransfersV357Test-1638566111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:57:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-4777faf4-ac3a-4174-bdfd-b93d09634eec tempest-VolumesTransfersV357Test-1638566111 None] Flow 'volume_create_manager' (41a79226-2ec7-4291-be46-f087278aa078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:57:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-4777faf4-ac3a-4174-bdfd-b93d09634eec tempest-VolumesTransfersV357Test-1638566111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b61d619c-c51d-4454-b7bc-e93b0b52d7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-4777faf4-ac3a-4174-bdfd-b93d09634eec tempest-VolumesTransfersV357Test-1638566111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b61d619c-c51d-4454-b7bc-e93b0b52d7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-296849750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ba850a3-b3a5-4f58-8d9e-04bbf7cfb633,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5577f4fc8c924681aedaa0e1fcde6599',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:57:51Z,use_quota=True,user_id='384cc438a4dc4de9b9b14225474ec3cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-4777faf4-ac3a-4174-bdfd-b93d09634eec tempest-VolumesTransfersV357Test-1638566111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86363657-53b5-4474-9baa-f7f6adf9b186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-4777faf4-ac3a-4174-bdfd-b93d09634eec tempest-VolumesTransfersV357Test-1638566111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86363657-53b5-4474-9baa-f7f6adf9b186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-4777faf4-ac3a-4174-bdfd-b93d09634eec tempest-VolumesTransfersV357Test-1638566111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6dd98eb-ab3a-45c8-bb90-ea1ff5e825da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-4777faf4-ac3a-4174-bdfd-b93d09634eec tempest-VolumesTransfersV357Test-1638566111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6dd98eb-ab3a-45c8-bb90-ea1ff5e825da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ba850a3-b3a5-4f58-8d9e-04bbf7cfb633', 'volume_name': 'volume-4ba850a3-b3a5-4f58-8d9e-04bbf7cfb633', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-4777faf4-ac3a-4174-bdfd-b93d09634eec tempest-VolumesTransfersV357Test-1638566111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30ff05cb-4f14-46e7-b53b-932a9c8242eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-4777faf4-ac3a-4174-bdfd-b93d09634eec tempest-VolumesTransfersV357Test-1638566111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30ff05cb-4f14-46e7-b53b-932a9c8242eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:51 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-4777faf4-ac3a-4174-bdfd-b93d09634eec tempest-VolumesTransfersV357Test-1638566111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (568dc14f-e011-4346-a850-f82f3cfab9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:51 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-4777faf4-ac3a-4174-bdfd-b93d09634eec tempest-VolumesTransfersV357Test-1638566111 None] Volume 4ba850a3-b3a5-4f58-8d9e-04bbf7cfb633: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ba850a3-b3a5-4f58-8d9e-04bbf7cfb633', 'volume_size': 1} Jul 30 16:57:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-4777faf4-ac3a-4174-bdfd-b93d09634eec tempest-VolumesTransfersV357Test-1638566111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-4777faf4-ac3a-4174-bdfd-b93d09634eec tempest-VolumesTransfersV357Test-1638566111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:51 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-4777faf4-ac3a-4174-bdfd-b93d09634eec tempest-VolumesTransfersV357Test-1638566111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-296849750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ba850a3-b3a5-4f58-8d9e-04bbf7cfb633,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5577f4fc8c924681aedaa0e1fcde6599',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:57:51Z,use_quota=True,user_id='384cc438a4dc4de9b9b14225474ec3cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:57:51 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-4777faf4-ac3a-4174-bdfd-b93d09634eec tempest-VolumesTransfersV357Test-1638566111 None] Creating volume 4ba850a3-b3a5-4f58-8d9e-04bbf7cfb633 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:57:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-4777faf4-ac3a-4174-bdfd-b93d09634eec tempest-VolumesTransfersV357Test-1638566111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-4777faf4-ac3a-4174-bdfd-b93d09634eec tempest-VolumesTransfersV357Test-1638566111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:51 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-4777faf4-ac3a-4174-bdfd-b93d09634eec tempest-VolumesTransfersV357Test-1638566111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:57:51 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-4777faf4-ac3a-4174-bdfd-b93d09634eec tempest-VolumesTransfersV357Test-1638566111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:57:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-4777faf4-ac3a-4174-bdfd-b93d09634eec tempest-VolumesTransfersV357Test-1638566111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:51 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-4777faf4-ac3a-4174-bdfd-b93d09634eec tempest-VolumesTransfersV357Test-1638566111 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:57:51 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-4777faf4-ac3a-4174-bdfd-b93d09634eec tempest-VolumesTransfersV357Test-1638566111 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:57:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4777faf4-ac3a-4174-bdfd-b93d09634eec tempest-VolumesTransfersV357Test-1638566111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-4ba850a3-b3a5-4f58-8d9e-04bbf7cfb633 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0c73c268-6e66-4475-8e06-8e89c9935bc6 tempest-AbsoluteLimitsTests-1990791446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0c73c268-6e66-4475-8e06-8e89c9935bc6 tempest-AbsoluteLimitsTests-1990791446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:51 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-0c73c268-6e66-4475-8e06-8e89c9935bc6 tempest-AbsoluteLimitsTests-1990791446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:57:51 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-0c73c268-6e66-4475-8e06-8e89c9935bc6 tempest-AbsoluteLimitsTests-1990791446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:57:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0c73c268-6e66-4475-8e06-8e89c9935bc6 tempest-AbsoluteLimitsTests-1990791446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0c73c268-6e66-4475-8e06-8e89c9935bc6 tempest-AbsoluteLimitsTests-1990791446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:51 devstack sudo[98815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-4ba850a3-b3a5-4f58-8d9e-04bbf7cfb633 1073741824 Jul 30 16:57:51 devstack sudo[98815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:51 devstack sudo[98817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:57:51 devstack sudo[98817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:51 devstack sudo[98817]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0c73c268-6e66-4475-8e06-8e89c9935bc6 tempest-AbsoluteLimitsTests-1990791446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.294s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:51 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-0c73c268-6e66-4475-8e06-8e89c9935bc6 tempest-AbsoluteLimitsTests-1990791446 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:57:51 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-0c73c268-6e66-4475-8e06-8e89c9935bc6 tempest-AbsoluteLimitsTests-1990791446 None] Deleted volume successfully. Jul 30 16:57:51 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-0c73c268-6e66-4475-8e06-8e89c9935bc6 tempest-AbsoluteLimitsTests-1990791446 None] Lock "cinder-055902eb-44b0-41b3-a2e0-77bdb4d8f1ee-delete_volume" released by "delete_volume" :: held 1.763s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:57:51 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-10c6e098-0f3d-4600-b55e-bfb5355f3b57 tempest-AttachVolumeTestJSON-687994885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:57:51 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-10c6e098-0f3d-4600-b55e-bfb5355f3b57 tempest-AttachVolumeTestJSON-687994885 None] Flow 'volume_create_manager' (280d2872-2140-49aa-b5c9-2e9e621f67b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:57:51 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-10c6e098-0f3d-4600-b55e-bfb5355f3b57 tempest-AttachVolumeTestJSON-687994885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4de0b03-c9a7-42f3-bef9-c0e68cc80649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:51 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-10c6e098-0f3d-4600-b55e-bfb5355f3b57 tempest-AttachVolumeTestJSON-687994885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4de0b03-c9a7-42f3-bef9-c0e68cc80649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-733558008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf15aa21-c8c4-4b4a-b26f-582d82dee8db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cde844a21fc42d6ac8b37b8c878e244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:57:51Z,use_quota=True,user_id='f546c4889e724be9b90ac2eb476d3a6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:51 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-10c6e098-0f3d-4600-b55e-bfb5355f3b57 tempest-AttachVolumeTestJSON-687994885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d497a1b-8d36-47ca-9173-0a1492bf990a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:51 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-10c6e098-0f3d-4600-b55e-bfb5355f3b57 tempest-AttachVolumeTestJSON-687994885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d497a1b-8d36-47ca-9173-0a1492bf990a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:51 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-10c6e098-0f3d-4600-b55e-bfb5355f3b57 tempest-AttachVolumeTestJSON-687994885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90fd6727-30b9-4e68-9aae-f7b17d8e28e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:51 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-10c6e098-0f3d-4600-b55e-bfb5355f3b57 tempest-AttachVolumeTestJSON-687994885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90fd6727-30b9-4e68-9aae-f7b17d8e28e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf15aa21-c8c4-4b4a-b26f-582d82dee8db', 'volume_name': 'volume-bf15aa21-c8c4-4b4a-b26f-582d82dee8db', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:51 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-10c6e098-0f3d-4600-b55e-bfb5355f3b57 tempest-AttachVolumeTestJSON-687994885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58a4d037-98ee-44ce-ac73-34062001f38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:51 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-10c6e098-0f3d-4600-b55e-bfb5355f3b57 tempest-AttachVolumeTestJSON-687994885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58a4d037-98ee-44ce-ac73-34062001f38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:51 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-10c6e098-0f3d-4600-b55e-bfb5355f3b57 tempest-AttachVolumeTestJSON-687994885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a17e091e-a32e-40bd-a8c8-94022a795a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:51 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-10c6e098-0f3d-4600-b55e-bfb5355f3b57 tempest-AttachVolumeTestJSON-687994885 None] Volume bf15aa21-c8c4-4b4a-b26f-582d82dee8db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf15aa21-c8c4-4b4a-b26f-582d82dee8db', 'volume_size': 1} Jul 30 16:57:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-10c6e098-0f3d-4600-b55e-bfb5355f3b57 tempest-AttachVolumeTestJSON-687994885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:51 devstack sudo[98815]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4777faf4-ac3a-4174-bdfd-b93d09634eec tempest-VolumesTransfersV357Test-1638566111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-4ba850a3-b3a5-4f58-8d9e-04bbf7cfb633 1073741824" returned: 0 in 0.558s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4777faf4-ac3a-4174-bdfd-b93d09634eec tempest-VolumesTransfersV357Test-1638566111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-4ba850a3-b3a5-4f58-8d9e-04bbf7cfb633 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:51 devstack sudo[98827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-4ba850a3-b3a5-4f58-8d9e-04bbf7cfb633 Jul 30 16:57:51 devstack sudo[98827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:51 devstack sudo[98827]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4777faf4-ac3a-4174-bdfd-b93d09634eec tempest-VolumesTransfersV357Test-1638566111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-4ba850a3-b3a5-4f58-8d9e-04bbf7cfb633" returned: 0 in 0.308s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:51 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-4777faf4-ac3a-4174-bdfd-b93d09634eec tempest-VolumesTransfersV357Test-1638566111 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:57:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-4777faf4-ac3a-4174-bdfd-b93d09634eec tempest-VolumesTransfersV357Test-1638566111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-10c6e098-0f3d-4600-b55e-bfb5355f3b57 tempest-AttachVolumeTestJSON-687994885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.427s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:51 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-10c6e098-0f3d-4600-b55e-bfb5355f3b57 tempest-AttachVolumeTestJSON-687994885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-733558008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf15aa21-c8c4-4b4a-b26f-582d82dee8db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cde844a21fc42d6ac8b37b8c878e244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:57:51Z,use_quota=True,user_id='f546c4889e724be9b90ac2eb476d3a6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:57:51 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-10c6e098-0f3d-4600-b55e-bfb5355f3b57 tempest-AttachVolumeTestJSON-687994885 None] Creating volume bf15aa21-c8c4-4b4a-b26f-582d82dee8db {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:57:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-10c6e098-0f3d-4600-b55e-bfb5355f3b57 tempest-AttachVolumeTestJSON-687994885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-10c6e098-0f3d-4600-b55e-bfb5355f3b57 tempest-AttachVolumeTestJSON-687994885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:51 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-10c6e098-0f3d-4600-b55e-bfb5355f3b57 tempest-AttachVolumeTestJSON-687994885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:57:51 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-10c6e098-0f3d-4600-b55e-bfb5355f3b57 tempest-AttachVolumeTestJSON-687994885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:57:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-10c6e098-0f3d-4600-b55e-bfb5355f3b57 tempest-AttachVolumeTestJSON-687994885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:51 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-10c6e098-0f3d-4600-b55e-bfb5355f3b57 tempest-AttachVolumeTestJSON-687994885 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:57:51 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-10c6e098-0f3d-4600-b55e-bfb5355f3b57 tempest-AttachVolumeTestJSON-687994885 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:57:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-10c6e098-0f3d-4600-b55e-bfb5355f3b57 tempest-AttachVolumeTestJSON-687994885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf15aa21-c8c4-4b4a-b26f-582d82dee8db 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:51 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-4777faf4-ac3a-4174-bdfd-b93d09634eec tempest-VolumesTransfersV357Test-1638566111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (568dc14f-e011-4346-a850-f82f3cfab9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ba850a3-b3a5-4f58-8d9e-04bbf7cfb633', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:51 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-4777faf4-ac3a-4174-bdfd-b93d09634eec tempest-VolumesTransfersV357Test-1638566111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (075cdd78-2e53-4e87-add8-ed654f4c7b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:51 devstack sudo[98835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf15aa21-c8c4-4b4a-b26f-582d82dee8db 1073741824 Jul 30 16:57:51 devstack sudo[98835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:52 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-4777faf4-ac3a-4174-bdfd-b93d09634eec tempest-VolumesTransfersV357Test-1638566111 None] Volume volume-4ba850a3-b3a5-4f58-8d9e-04bbf7cfb633 (4ba850a3-b3a5-4f58-8d9e-04bbf7cfb633): created successfully Jul 30 16:57:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-4777faf4-ac3a-4174-bdfd-b93d09634eec tempest-VolumesTransfersV357Test-1638566111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (075cdd78-2e53-4e87-add8-ed654f4c7b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-4777faf4-ac3a-4174-bdfd-b93d09634eec tempest-VolumesTransfersV357Test-1638566111 None] Flow 'volume_create_manager' (41a79226-2ec7-4291-be46-f087278aa078) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:57:52 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-4777faf4-ac3a-4174-bdfd-b93d09634eec tempest-VolumesTransfersV357Test-1638566111 None] Created volume successfully. Jul 30 16:57:52 devstack sudo[98835]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-10c6e098-0f3d-4600-b55e-bfb5355f3b57 tempest-AttachVolumeTestJSON-687994885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf15aa21-c8c4-4b4a-b26f-582d82dee8db 1073741824" returned: 0 in 0.556s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-10c6e098-0f3d-4600-b55e-bfb5355f3b57 tempest-AttachVolumeTestJSON-687994885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf15aa21-c8c4-4b4a-b26f-582d82dee8db {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:52 devstack sudo[98844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf15aa21-c8c4-4b4a-b26f-582d82dee8db Jul 30 16:57:52 devstack sudo[98844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:52 devstack sudo[98844]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-10c6e098-0f3d-4600-b55e-bfb5355f3b57 tempest-AttachVolumeTestJSON-687994885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf15aa21-c8c4-4b4a-b26f-582d82dee8db" returned: 0 in 0.301s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:52 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-10c6e098-0f3d-4600-b55e-bfb5355f3b57 tempest-AttachVolumeTestJSON-687994885 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:57:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-10c6e098-0f3d-4600-b55e-bfb5355f3b57 tempest-AttachVolumeTestJSON-687994885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-10c6e098-0f3d-4600-b55e-bfb5355f3b57 tempest-AttachVolumeTestJSON-687994885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a17e091e-a32e-40bd-a8c8-94022a795a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf15aa21-c8c4-4b4a-b26f-582d82dee8db', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-10c6e098-0f3d-4600-b55e-bfb5355f3b57 tempest-AttachVolumeTestJSON-687994885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37c1bf2a-3c0a-48da-9e90-456c0b8c58ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:52 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-10c6e098-0f3d-4600-b55e-bfb5355f3b57 tempest-AttachVolumeTestJSON-687994885 None] Volume volume-bf15aa21-c8c4-4b4a-b26f-582d82dee8db (bf15aa21-c8c4-4b4a-b26f-582d82dee8db): created successfully Jul 30 16:57:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-10c6e098-0f3d-4600-b55e-bfb5355f3b57 tempest-AttachVolumeTestJSON-687994885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37c1bf2a-3c0a-48da-9e90-456c0b8c58ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-10c6e098-0f3d-4600-b55e-bfb5355f3b57 tempest-AttachVolumeTestJSON-687994885 None] Flow 'volume_create_manager' (280d2872-2140-49aa-b5c9-2e9e621f67b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:57:52 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-10c6e098-0f3d-4600-b55e-bfb5355f3b57 tempest-AttachVolumeTestJSON-687994885 None] Created volume successfully. Jul 30 16:57:54 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-c3547269-cc9a-4c83-91ed-63125d90d167 tempest-VolumesTransfersV357Test-283753071 None] Transfer volume completed successfully. Jul 30 16:57:54 devstack cinder-volume[88591]: INFO cinder.volume.manager [req-c9480ebf-e9a4-4ec8-87fe-84dd8f060cb1 req-bbae2cd1-c46b-410e-95cc-067762d5d0c2 tempest-TestShelveInstance-1545066493 None] Terminate volume connection completed successfully. Jul 30 16:57:54 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-c9480ebf-e9a4-4ec8-87fe-84dd8f060cb1 req-bbae2cd1-c46b-410e-95cc-067762d5d0c2 tempest-TestShelveInstance-1545066493 None] Deleting attachment d6b348b7-fe2e-45e5-ae2d-ac54c2a563ac. {{(pid=88591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:57:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-7676109e-4a17-472a-8505-0909e7d9b320 req-6e6bb939-afac-4132-abb7-24d754003fb5 tempest-AttachVolumeTestJSON-687994885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-7676109e-4a17-472a-8505-0909e7d9b320 req-6e6bb939-afac-4132-abb7-24d754003fb5 tempest-AttachVolumeTestJSON-687994885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-7676109e-4a17-472a-8505-0909e7d9b320 req-6e6bb939-afac-4132-abb7-24d754003fb5 tempest-AttachVolumeTestJSON-687994885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:55 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-7676109e-4a17-472a-8505-0909e7d9b320 req-6e6bb939-afac-4132-abb7-24d754003fb5 tempest-AttachVolumeTestJSON-687994885 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202', 'name': 'volume-bf15aa21-c8c4-4b4a-b26f-582d82dee8db', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0d81d367-fd52-43ef-a8b7-6da04af01be3', 'enforce_multipath': True} {{(pid=88591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:57:55 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-3b55b82c-7f2d-404b-a8d7-5c2667812001 tempest-VolumesTransfersV357Test-2001503402 None] Acquiring lock "cinder-4ba850a3-b3a5-4f58-8d9e-04bbf7cfb633-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:57:55 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-3b55b82c-7f2d-404b-a8d7-5c2667812001 tempest-VolumesTransfersV357Test-2001503402 None] Lock "cinder-4ba850a3-b3a5-4f58-8d9e-04bbf7cfb633-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:57:55 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-3b55b82c-7f2d-404b-a8d7-5c2667812001 tempest-VolumesTransfersV357Test-2001503402 None] Acquiring lock "cinder-quobyte-4ba850a3-b3a5-4f58-8d9e-04bbf7cfb633" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:57:55 devstack cinder-volume[88591]: INFO cinder.volume.manager [req-7676109e-4a17-472a-8505-0909e7d9b320 req-6e6bb939-afac-4132-abb7-24d754003fb5 tempest-AttachVolumeTestJSON-687994885 None] attachment_update completed successfully. Jul 30 16:57:55 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-3b55b82c-7f2d-404b-a8d7-5c2667812001 tempest-VolumesTransfersV357Test-2001503402 None] Lock "cinder-quobyte-4ba850a3-b3a5-4f58-8d9e-04bbf7cfb633" acquired by "delete_volume" :: waited 0.024s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:57:55 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36b04d1-5050-483f-ba83-208046513ebd]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:57:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3b55b82c-7f2d-404b-a8d7-5c2667812001 tempest-VolumesTransfersV357Test-2001503402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-4ba850a3-b3a5-4f58-8d9e-04bbf7cfb633 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:55 devstack sudo[98877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-4ba850a3-b3a5-4f58-8d9e-04bbf7cfb633 Jul 30 16:57:55 devstack sudo[98877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:56 devstack sudo[98877]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3b55b82c-7f2d-404b-a8d7-5c2667812001 tempest-VolumesTransfersV357Test-2001503402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-4ba850a3-b3a5-4f58-8d9e-04bbf7cfb633" returned: 0 in 0.463s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3b55b82c-7f2d-404b-a8d7-5c2667812001 tempest-VolumesTransfersV357Test-2001503402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-4ba850a3-b3a5-4f58-8d9e-04bbf7cfb633 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:56 devstack sudo[99265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-4ba850a3-b3a5-4f58-8d9e-04bbf7cfb633 Jul 30 16:57:56 devstack sudo[99265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:56 devstack sudo[99265]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3b55b82c-7f2d-404b-a8d7-5c2667812001 tempest-VolumesTransfersV357Test-2001503402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-4ba850a3-b3a5-4f58-8d9e-04bbf7cfb633" returned: 0 in 0.270s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:56 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-3b55b82c-7f2d-404b-a8d7-5c2667812001 tempest-VolumesTransfersV357Test-2001503402 None] Lock "cinder-quobyte-4ba850a3-b3a5-4f58-8d9e-04bbf7cfb633" released by "delete_volume" :: held 0.811s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:57:56 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-3b55b82c-7f2d-404b-a8d7-5c2667812001 tempest-VolumesTransfersV357Test-2001503402 None] Created reservations ['ec4be428-069c-402a-b580-bc01552cf5a3', '3a78183b-c482-45d7-a3ea-61ba2f6c1b00', 'b5e2b39f-0858-40c2-97c8-c2a93a02a018', 'bb31ed12-c937-4445-9e90-5529ce26bf6e'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:57:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3b55b82c-7f2d-404b-a8d7-5c2667812001 tempest-VolumesTransfersV357Test-2001503402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3b55b82c-7f2d-404b-a8d7-5c2667812001 tempest-VolumesTransfersV357Test-2001503402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:56 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-3b55b82c-7f2d-404b-a8d7-5c2667812001 tempest-VolumesTransfersV357Test-2001503402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:57:56 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-3b55b82c-7f2d-404b-a8d7-5c2667812001 tempest-VolumesTransfersV357Test-2001503402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:57:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3b55b82c-7f2d-404b-a8d7-5c2667812001 tempest-VolumesTransfersV357Test-2001503402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3b55b82c-7f2d-404b-a8d7-5c2667812001 tempest-VolumesTransfersV357Test-2001503402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:56 devstack sudo[99270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:57:56 devstack sudo[99270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:57 devstack sudo[99270]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3b55b82c-7f2d-404b-a8d7-5c2667812001 tempest-VolumesTransfersV357Test-2001503402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.590s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:57 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-3b55b82c-7f2d-404b-a8d7-5c2667812001 tempest-VolumesTransfersV357Test-2001503402 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:57:57 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-3b55b82c-7f2d-404b-a8d7-5c2667812001 tempest-VolumesTransfersV357Test-2001503402 None] Deleted volume successfully. Jul 30 16:57:57 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-3b55b82c-7f2d-404b-a8d7-5c2667812001 tempest-VolumesTransfersV357Test-2001503402 None] Lock "cinder-4ba850a3-b3a5-4f58-8d9e-04bbf7cfb633-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:57:57 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4da9675-6632-4149-b3dc-40c7e089d416 tempest-VolumesTransfersV357Test-1638566111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:57:57 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a4da9675-6632-4149-b3dc-40c7e089d416 tempest-VolumesTransfersV357Test-1638566111 None] Flow 'volume_create_manager' (1cfa62fb-1898-464d-b9d2-d76dd2ec73f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:57:57 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a4da9675-6632-4149-b3dc-40c7e089d416 tempest-VolumesTransfersV357Test-1638566111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a13d337-c33e-4661-b756-fb60c07f95bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:57 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a4da9675-6632-4149-b3dc-40c7e089d416 tempest-VolumesTransfersV357Test-1638566111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a13d337-c33e-4661-b756-fb60c07f95bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1839103705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14bd2f5d-e92e-4e57-aec2-640600bc93b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5577f4fc8c924681aedaa0e1fcde6599',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:57:58Z,use_quota=True,user_id='384cc438a4dc4de9b9b14225474ec3cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:57 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a4da9675-6632-4149-b3dc-40c7e089d416 tempest-VolumesTransfersV357Test-1638566111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b926bbe-1f7a-4e8f-9af7-769a88adf651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:57 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a4da9675-6632-4149-b3dc-40c7e089d416 tempest-VolumesTransfersV357Test-1638566111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b926bbe-1f7a-4e8f-9af7-769a88adf651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:57 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a4da9675-6632-4149-b3dc-40c7e089d416 tempest-VolumesTransfersV357Test-1638566111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cc082e5-0ef5-424f-8abd-fb135431e39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:57 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a4da9675-6632-4149-b3dc-40c7e089d416 tempest-VolumesTransfersV357Test-1638566111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cc082e5-0ef5-424f-8abd-fb135431e39a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14bd2f5d-e92e-4e57-aec2-640600bc93b0', 'volume_name': 'volume-14bd2f5d-e92e-4e57-aec2-640600bc93b0', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:57 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a4da9675-6632-4149-b3dc-40c7e089d416 tempest-VolumesTransfersV357Test-1638566111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9420a65-5d76-4b61-9700-71b54e24d4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:57 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a4da9675-6632-4149-b3dc-40c7e089d416 tempest-VolumesTransfersV357Test-1638566111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9420a65-5d76-4b61-9700-71b54e24d4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:57 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a4da9675-6632-4149-b3dc-40c7e089d416 tempest-VolumesTransfersV357Test-1638566111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce4a2d6e-bedc-49ad-a829-f584041e9c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:57 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-a4da9675-6632-4149-b3dc-40c7e089d416 tempest-VolumesTransfersV357Test-1638566111 None] Volume 14bd2f5d-e92e-4e57-aec2-640600bc93b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14bd2f5d-e92e-4e57-aec2-640600bc93b0', 'volume_size': 1} Jul 30 16:57:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a4da9675-6632-4149-b3dc-40c7e089d416 tempest-VolumesTransfersV357Test-1638566111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a4da9675-6632-4149-b3dc-40c7e089d416 tempest-VolumesTransfersV357Test-1638566111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:57 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a4da9675-6632-4149-b3dc-40c7e089d416 tempest-VolumesTransfersV357Test-1638566111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1839103705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14bd2f5d-e92e-4e57-aec2-640600bc93b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5577f4fc8c924681aedaa0e1fcde6599',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:57:58Z,use_quota=True,user_id='384cc438a4dc4de9b9b14225474ec3cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:57:57 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-a4da9675-6632-4149-b3dc-40c7e089d416 tempest-VolumesTransfersV357Test-1638566111 None] Creating volume 14bd2f5d-e92e-4e57-aec2-640600bc93b0 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:57:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a4da9675-6632-4149-b3dc-40c7e089d416 tempest-VolumesTransfersV357Test-1638566111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a4da9675-6632-4149-b3dc-40c7e089d416 tempest-VolumesTransfersV357Test-1638566111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:57 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a4da9675-6632-4149-b3dc-40c7e089d416 tempest-VolumesTransfersV357Test-1638566111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:57:57 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a4da9675-6632-4149-b3dc-40c7e089d416 tempest-VolumesTransfersV357Test-1638566111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:57:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a4da9675-6632-4149-b3dc-40c7e089d416 tempest-VolumesTransfersV357Test-1638566111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:57 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a4da9675-6632-4149-b3dc-40c7e089d416 tempest-VolumesTransfersV357Test-1638566111 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:57:57 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-a4da9675-6632-4149-b3dc-40c7e089d416 tempest-VolumesTransfersV357Test-1638566111 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:57:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a4da9675-6632-4149-b3dc-40c7e089d416 tempest-VolumesTransfersV357Test-1638566111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-14bd2f5d-e92e-4e57-aec2-640600bc93b0 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:57 devstack sudo[99274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-14bd2f5d-e92e-4e57-aec2-640600bc93b0 1073741824 Jul 30 16:57:57 devstack sudo[99274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:58 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe6be593-680d-4139-8a5f-61560296c6e1 tempest-AttachVolumeTestJSON-687994885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:57:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fe6be593-680d-4139-8a5f-61560296c6e1 tempest-AttachVolumeTestJSON-687994885 None] Flow 'volume_create_manager' (11698ec9-e3df-4d04-8438-aed746cbd31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:57:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fe6be593-680d-4139-8a5f-61560296c6e1 tempest-AttachVolumeTestJSON-687994885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aab61254-bb7e-4d6e-abe2-9a25a195ebf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fe6be593-680d-4139-8a5f-61560296c6e1 tempest-AttachVolumeTestJSON-687994885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aab61254-bb7e-4d6e-abe2-9a25a195ebf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-675081422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9453c0c-4089-47e1-8d82-3f59528336d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cde844a21fc42d6ac8b37b8c878e244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:57:58Z,use_quota=True,user_id='f546c4889e724be9b90ac2eb476d3a6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fe6be593-680d-4139-8a5f-61560296c6e1 tempest-AttachVolumeTestJSON-687994885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b7f3f30-d2e2-4573-b033-eda2862855a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fe6be593-680d-4139-8a5f-61560296c6e1 tempest-AttachVolumeTestJSON-687994885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b7f3f30-d2e2-4573-b033-eda2862855a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fe6be593-680d-4139-8a5f-61560296c6e1 tempest-AttachVolumeTestJSON-687994885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80ced73a-0230-4650-9538-3702831bfff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fe6be593-680d-4139-8a5f-61560296c6e1 tempest-AttachVolumeTestJSON-687994885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80ced73a-0230-4650-9538-3702831bfff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9453c0c-4089-47e1-8d82-3f59528336d6', 'volume_name': 'volume-c9453c0c-4089-47e1-8d82-3f59528336d6', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fe6be593-680d-4139-8a5f-61560296c6e1 tempest-AttachVolumeTestJSON-687994885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3f921fc-883a-4329-a8f4-edd6bd8a63cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fe6be593-680d-4139-8a5f-61560296c6e1 tempest-AttachVolumeTestJSON-687994885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3f921fc-883a-4329-a8f4-edd6bd8a63cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fe6be593-680d-4139-8a5f-61560296c6e1 tempest-AttachVolumeTestJSON-687994885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (830309d2-004d-477f-b398-c369bacd4d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:58 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-fe6be593-680d-4139-8a5f-61560296c6e1 tempest-AttachVolumeTestJSON-687994885 None] Volume c9453c0c-4089-47e1-8d82-3f59528336d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9453c0c-4089-47e1-8d82-3f59528336d6', 'volume_size': 1} Jul 30 16:57:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-fe6be593-680d-4139-8a5f-61560296c6e1 tempest-AttachVolumeTestJSON-687994885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:58 devstack sudo[99274]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a4da9675-6632-4149-b3dc-40c7e089d416 tempest-VolumesTransfersV357Test-1638566111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-14bd2f5d-e92e-4e57-aec2-640600bc93b0 1073741824" returned: 0 in 0.652s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:58 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee9bf027-7188-409e-b25b-28056915f207 tempest-VolumesMetadataTest-241115663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:57:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ee9bf027-7188-409e-b25b-28056915f207 tempest-VolumesMetadataTest-241115663 None] Flow 'volume_create_manager' (224c578d-f18f-4369-baf1-8648cbf7ec67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:57:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ee9bf027-7188-409e-b25b-28056915f207 tempest-VolumesMetadataTest-241115663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (106961bf-5278-41d2-ac2c-af81a12a267e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a4da9675-6632-4149-b3dc-40c7e089d416 tempest-VolumesTransfersV357Test-1638566111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-14bd2f5d-e92e-4e57-aec2-640600bc93b0 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ee9bf027-7188-409e-b25b-28056915f207 tempest-VolumesMetadataTest-241115663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (106961bf-5278-41d2-ac2c-af81a12a267e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-22007053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c846668c-1144-4119-8430-ce92167137f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55e59d86413049558fe2fb355be6370d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:57:58Z,use_quota=True,user_id='1c9461e82d124f9e9f1dd471c79e511d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ee9bf027-7188-409e-b25b-28056915f207 tempest-VolumesMetadataTest-241115663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39296ab2-f039-4033-8c31-4676d9953d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:58 devstack sudo[99281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-14bd2f5d-e92e-4e57-aec2-640600bc93b0 Jul 30 16:57:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ee9bf027-7188-409e-b25b-28056915f207 tempest-VolumesMetadataTest-241115663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39296ab2-f039-4033-8c31-4676d9953d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:58 devstack sudo[99281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ee9bf027-7188-409e-b25b-28056915f207 tempest-VolumesMetadataTest-241115663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c125ab4-e751-40da-bc09-3c8657598f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ee9bf027-7188-409e-b25b-28056915f207 tempest-VolumesMetadataTest-241115663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c125ab4-e751-40da-bc09-3c8657598f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c846668c-1144-4119-8430-ce92167137f6', 'volume_name': 'volume-c846668c-1144-4119-8430-ce92167137f6', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ee9bf027-7188-409e-b25b-28056915f207 tempest-VolumesMetadataTest-241115663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1492daec-ef70-4212-b934-e844f3edc81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ee9bf027-7188-409e-b25b-28056915f207 tempest-VolumesMetadataTest-241115663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1492daec-ef70-4212-b934-e844f3edc81d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ee9bf027-7188-409e-b25b-28056915f207 tempest-VolumesMetadataTest-241115663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93c71c57-d5e0-4397-ae81-9add418832f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:58 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-ee9bf027-7188-409e-b25b-28056915f207 tempest-VolumesMetadataTest-241115663 None] Volume c846668c-1144-4119-8430-ce92167137f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c846668c-1144-4119-8430-ce92167137f6', 'volume_size': 1} Jul 30 16:57:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ee9bf027-7188-409e-b25b-28056915f207 tempest-VolumesMetadataTest-241115663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:58 devstack sudo[99281]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a4da9675-6632-4149-b3dc-40c7e089d416 tempest-VolumesTransfersV357Test-1638566111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-14bd2f5d-e92e-4e57-aec2-640600bc93b0" returned: 0 in 0.291s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:58 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a4da9675-6632-4149-b3dc-40c7e089d416 tempest-VolumesTransfersV357Test-1638566111 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:57:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a4da9675-6632-4149-b3dc-40c7e089d416 tempest-VolumesTransfersV357Test-1638566111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-fe6be593-680d-4139-8a5f-61560296c6e1 tempest-AttachVolumeTestJSON-687994885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.504s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:58 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-fe6be593-680d-4139-8a5f-61560296c6e1 tempest-AttachVolumeTestJSON-687994885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-675081422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9453c0c-4089-47e1-8d82-3f59528336d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cde844a21fc42d6ac8b37b8c878e244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:57:58Z,use_quota=True,user_id='f546c4889e724be9b90ac2eb476d3a6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:57:58 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-fe6be593-680d-4139-8a5f-61560296c6e1 tempest-AttachVolumeTestJSON-687994885 None] Creating volume c9453c0c-4089-47e1-8d82-3f59528336d6 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:57:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-fe6be593-680d-4139-8a5f-61560296c6e1 tempest-AttachVolumeTestJSON-687994885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-fe6be593-680d-4139-8a5f-61560296c6e1 tempest-AttachVolumeTestJSON-687994885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:58 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-fe6be593-680d-4139-8a5f-61560296c6e1 tempest-AttachVolumeTestJSON-687994885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:57:58 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-fe6be593-680d-4139-8a5f-61560296c6e1 tempest-AttachVolumeTestJSON-687994885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:57:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-fe6be593-680d-4139-8a5f-61560296c6e1 tempest-AttachVolumeTestJSON-687994885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:58 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-fe6be593-680d-4139-8a5f-61560296c6e1 tempest-AttachVolumeTestJSON-687994885 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:57:58 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-fe6be593-680d-4139-8a5f-61560296c6e1 tempest-AttachVolumeTestJSON-687994885 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:57:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fe6be593-680d-4139-8a5f-61560296c6e1 tempest-AttachVolumeTestJSON-687994885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9453c0c-4089-47e1-8d82-3f59528336d6 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a4da9675-6632-4149-b3dc-40c7e089d416 tempest-VolumesTransfersV357Test-1638566111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce4a2d6e-bedc-49ad-a829-f584041e9c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14bd2f5d-e92e-4e57-aec2-640600bc93b0', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:58 devstack sudo[99284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9453c0c-4089-47e1-8d82-3f59528336d6 1073741824 Jul 30 16:57:58 devstack sudo[99284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a4da9675-6632-4149-b3dc-40c7e089d416 tempest-VolumesTransfersV357Test-1638566111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a43ca26a-eaf5-4f08-ac32-abeea59cc532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:58 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-a4da9675-6632-4149-b3dc-40c7e089d416 tempest-VolumesTransfersV357Test-1638566111 None] Volume volume-14bd2f5d-e92e-4e57-aec2-640600bc93b0 (14bd2f5d-e92e-4e57-aec2-640600bc93b0): created successfully Jul 30 16:57:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a4da9675-6632-4149-b3dc-40c7e089d416 tempest-VolumesTransfersV357Test-1638566111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a43ca26a-eaf5-4f08-ac32-abeea59cc532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a4da9675-6632-4149-b3dc-40c7e089d416 tempest-VolumesTransfersV357Test-1638566111 None] Flow 'volume_create_manager' (1cfa62fb-1898-464d-b9d2-d76dd2ec73f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:57:58 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-a4da9675-6632-4149-b3dc-40c7e089d416 tempest-VolumesTransfersV357Test-1638566111 None] Created volume successfully. Jul 30 16:57:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-c4013517-4bb7-4273-a1e9-450892e78e0c req-068591b8-d4dd-4eef-bae6-56226c2f34f8 tempest-TestShelveInstance-1545066493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:59 devstack sudo[99284]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fe6be593-680d-4139-8a5f-61560296c6e1 tempest-AttachVolumeTestJSON-687994885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9453c0c-4089-47e1-8d82-3f59528336d6 1073741824" returned: 0 in 0.470s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fe6be593-680d-4139-8a5f-61560296c6e1 tempest-AttachVolumeTestJSON-687994885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9453c0c-4089-47e1-8d82-3f59528336d6 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:59 devstack sudo[99297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9453c0c-4089-47e1-8d82-3f59528336d6 Jul 30 16:57:59 devstack sudo[99297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:59 devstack sudo[99297]: pam_unix(sudo:session): session closed for user root Jul 30 16:57:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fe6be593-680d-4139-8a5f-61560296c6e1 tempest-AttachVolumeTestJSON-687994885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9453c0c-4089-47e1-8d82-3f59528336d6" returned: 0 in 0.250s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:57:59 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-fe6be593-680d-4139-8a5f-61560296c6e1 tempest-AttachVolumeTestJSON-687994885 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:57:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-fe6be593-680d-4139-8a5f-61560296c6e1 tempest-AttachVolumeTestJSON-687994885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ee9bf027-7188-409e-b25b-28056915f207 tempest-VolumesMetadataTest-241115663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:59 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ee9bf027-7188-409e-b25b-28056915f207 tempest-VolumesMetadataTest-241115663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-22007053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c846668c-1144-4119-8430-ce92167137f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55e59d86413049558fe2fb355be6370d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:57:58Z,use_quota=True,user_id='1c9461e82d124f9e9f1dd471c79e511d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:57:59 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-ee9bf027-7188-409e-b25b-28056915f207 tempest-VolumesMetadataTest-241115663 None] Creating volume c846668c-1144-4119-8430-ce92167137f6 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:57:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ee9bf027-7188-409e-b25b-28056915f207 tempest-VolumesMetadataTest-241115663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:57:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ee9bf027-7188-409e-b25b-28056915f207 tempest-VolumesMetadataTest-241115663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:57:59 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ee9bf027-7188-409e-b25b-28056915f207 tempest-VolumesMetadataTest-241115663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:57:59 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ee9bf027-7188-409e-b25b-28056915f207 tempest-VolumesMetadataTest-241115663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:57:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ee9bf027-7188-409e-b25b-28056915f207 tempest-VolumesMetadataTest-241115663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:57:59 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ee9bf027-7188-409e-b25b-28056915f207 tempest-VolumesMetadataTest-241115663 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:57:59 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-ee9bf027-7188-409e-b25b-28056915f207 tempest-VolumesMetadataTest-241115663 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:57:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ee9bf027-7188-409e-b25b-28056915f207 tempest-VolumesMetadataTest-241115663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c846668c-1144-4119-8430-ce92167137f6 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:57:59 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fe6be593-680d-4139-8a5f-61560296c6e1 tempest-AttachVolumeTestJSON-687994885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (830309d2-004d-477f-b398-c369bacd4d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9453c0c-4089-47e1-8d82-3f59528336d6', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:59 devstack sudo[99300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c846668c-1144-4119-8430-ce92167137f6 1073741824 Jul 30 16:57:59 devstack sudo[99300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:57:59 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fe6be593-680d-4139-8a5f-61560296c6e1 tempest-AttachVolumeTestJSON-687994885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e22cff0-95f8-454c-afd3-f3104f942aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:57:59 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-fe6be593-680d-4139-8a5f-61560296c6e1 tempest-AttachVolumeTestJSON-687994885 None] Volume volume-c9453c0c-4089-47e1-8d82-3f59528336d6 (c9453c0c-4089-47e1-8d82-3f59528336d6): created successfully Jul 30 16:57:59 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fe6be593-680d-4139-8a5f-61560296c6e1 tempest-AttachVolumeTestJSON-687994885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e22cff0-95f8-454c-afd3-f3104f942aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:57:59 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fe6be593-680d-4139-8a5f-61560296c6e1 tempest-AttachVolumeTestJSON-687994885 None] Flow 'volume_create_manager' (11698ec9-e3df-4d04-8438-aed746cbd31e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:57:59 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-fe6be593-680d-4139-8a5f-61560296c6e1 tempest-AttachVolumeTestJSON-687994885 None] Created volume successfully. Jul 30 16:58:00 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f6efeae6-7c9a-4882-8c7b-5e2cbc9774b5 tempest-VolumesTransfersV357Test-2001503402 None] Acquiring lock "cinder-14bd2f5d-e92e-4e57-aec2-640600bc93b0-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:00 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f6efeae6-7c9a-4882-8c7b-5e2cbc9774b5 tempest-VolumesTransfersV357Test-2001503402 None] Lock "cinder-14bd2f5d-e92e-4e57-aec2-640600bc93b0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:00 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f6efeae6-7c9a-4882-8c7b-5e2cbc9774b5 tempest-VolumesTransfersV357Test-2001503402 None] Acquiring lock "cinder-quobyte-14bd2f5d-e92e-4e57-aec2-640600bc93b0" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:00 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f6efeae6-7c9a-4882-8c7b-5e2cbc9774b5 tempest-VolumesTransfersV357Test-2001503402 None] Lock "cinder-quobyte-14bd2f5d-e92e-4e57-aec2-640600bc93b0" acquired by "delete_volume" :: waited 0.022s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:00 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[678178f7-2ddb-4b33-9f9f-adbe70d6c378]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f6efeae6-7c9a-4882-8c7b-5e2cbc9774b5 tempest-VolumesTransfersV357Test-2001503402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-14bd2f5d-e92e-4e57-aec2-640600bc93b0 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:00 devstack sudo[99300]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ee9bf027-7188-409e-b25b-28056915f207 tempest-VolumesMetadataTest-241115663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c846668c-1144-4119-8430-ce92167137f6 1073741824" returned: 0 in 0.515s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ee9bf027-7188-409e-b25b-28056915f207 tempest-VolumesMetadataTest-241115663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c846668c-1144-4119-8430-ce92167137f6 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:00 devstack sudo[99307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c846668c-1144-4119-8430-ce92167137f6 Jul 30 16:58:00 devstack sudo[99307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:00 devstack sudo[99306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-14bd2f5d-e92e-4e57-aec2-640600bc93b0 Jul 30 16:58:00 devstack sudo[99306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:00 devstack sudo[99307]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ee9bf027-7188-409e-b25b-28056915f207 tempest-VolumesMetadataTest-241115663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c846668c-1144-4119-8430-ce92167137f6" returned: 0 in 0.253s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:00 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ee9bf027-7188-409e-b25b-28056915f207 tempest-VolumesMetadataTest-241115663 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:58:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ee9bf027-7188-409e-b25b-28056915f207 tempest-VolumesMetadataTest-241115663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-c4013517-4bb7-4273-a1e9-450892e78e0c req-068591b8-d4dd-4eef-bae6-56226c2f34f8 tempest-TestShelveInstance-1545066493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.226s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:00 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ee9bf027-7188-409e-b25b-28056915f207 tempest-VolumesMetadataTest-241115663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93c71c57-d5e0-4397-ae81-9add418832f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c846668c-1144-4119-8430-ce92167137f6', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:00 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ee9bf027-7188-409e-b25b-28056915f207 tempest-VolumesMetadataTest-241115663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6190e7ef-bf37-4d09-8993-3d8902154fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-c4013517-4bb7-4273-a1e9-450892e78e0c req-068591b8-d4dd-4eef-bae6-56226c2f34f8 tempest-TestShelveInstance-1545066493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:00 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-ee9bf027-7188-409e-b25b-28056915f207 tempest-VolumesMetadataTest-241115663 None] Volume volume-c846668c-1144-4119-8430-ce92167137f6 (c846668c-1144-4119-8430-ce92167137f6): created successfully Jul 30 16:58:00 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ee9bf027-7188-409e-b25b-28056915f207 tempest-VolumesMetadataTest-241115663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6190e7ef-bf37-4d09-8993-3d8902154fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:00 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ee9bf027-7188-409e-b25b-28056915f207 tempest-VolumesMetadataTest-241115663 None] Flow 'volume_create_manager' (224c578d-f18f-4369-baf1-8648cbf7ec67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:58:00 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-ee9bf027-7188-409e-b25b-28056915f207 tempest-VolumesMetadataTest-241115663 None] Created volume successfully. Jul 30 16:58:00 devstack sudo[99306]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f6efeae6-7c9a-4882-8c7b-5e2cbc9774b5 tempest-VolumesTransfersV357Test-2001503402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-14bd2f5d-e92e-4e57-aec2-640600bc93b0" returned: 0 in 0.435s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f6efeae6-7c9a-4882-8c7b-5e2cbc9774b5 tempest-VolumesTransfersV357Test-2001503402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-14bd2f5d-e92e-4e57-aec2-640600bc93b0 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:00 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-c4013517-4bb7-4273-a1e9-450892e78e0c req-068591b8-d4dd-4eef-bae6-56226c2f34f8 tempest-TestShelveInstance-1545066493 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202', 'name': 'volume-2b3d2393-bff2-40db-9ac4-c5b5e5b9dc96', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '911e90c5-afed-42bd-bfca-ae20473b4ab0', 'enforce_multipath': True} {{(pid=88591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:58:00 devstack sudo[99317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-14bd2f5d-e92e-4e57-aec2-640600bc93b0 Jul 30 16:58:00 devstack sudo[99317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:00 devstack cinder-volume[88591]: INFO cinder.volume.manager [req-c4013517-4bb7-4273-a1e9-450892e78e0c req-068591b8-d4dd-4eef-bae6-56226c2f34f8 tempest-TestShelveInstance-1545066493 None] attachment_update completed successfully. Jul 30 16:58:00 devstack sudo[99317]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f6efeae6-7c9a-4882-8c7b-5e2cbc9774b5 tempest-VolumesTransfersV357Test-2001503402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-14bd2f5d-e92e-4e57-aec2-640600bc93b0" returned: 0 in 0.386s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:00 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f6efeae6-7c9a-4882-8c7b-5e2cbc9774b5 tempest-VolumesTransfersV357Test-2001503402 None] Lock "cinder-quobyte-14bd2f5d-e92e-4e57-aec2-640600bc93b0" released by "delete_volume" :: held 0.872s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:01 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-f6efeae6-7c9a-4882-8c7b-5e2cbc9774b5 tempest-VolumesTransfersV357Test-2001503402 None] Created reservations ['1133c310-b779-4248-9a13-38429cdb1720', 'bad47851-dd27-4c80-99d1-ec05e9c1d07d', '9937a919-dbe3-4773-bb88-b02567d4f63b', 'beb7a0dc-f3e3-4ebb-a67e-9d11750de071'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:58:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-03499856-06ab-4f4e-bffc-1ac8f2c702ae req-e4d1b354-4d2e-4302-8f0c-2b3a3aea30dc tempest-AttachVolumeTestJSON-687994885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-03499856-06ab-4f4e-bffc-1ac8f2c702ae req-e4d1b354-4d2e-4302-8f0c-2b3a3aea30dc tempest-AttachVolumeTestJSON-687994885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-03499856-06ab-4f4e-bffc-1ac8f2c702ae req-e4d1b354-4d2e-4302-8f0c-2b3a3aea30dc tempest-AttachVolumeTestJSON-687994885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f6efeae6-7c9a-4882-8c7b-5e2cbc9774b5 tempest-VolumesTransfersV357Test-2001503402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f6efeae6-7c9a-4882-8c7b-5e2cbc9774b5 tempest-VolumesTransfersV357Test-2001503402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:01 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f6efeae6-7c9a-4882-8c7b-5e2cbc9774b5 tempest-VolumesTransfersV357Test-2001503402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:58:01 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f6efeae6-7c9a-4882-8c7b-5e2cbc9774b5 tempest-VolumesTransfersV357Test-2001503402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:58:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f6efeae6-7c9a-4882-8c7b-5e2cbc9774b5 tempest-VolumesTransfersV357Test-2001503402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f6efeae6-7c9a-4882-8c7b-5e2cbc9774b5 tempest-VolumesTransfersV357Test-2001503402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-03499856-06ab-4f4e-bffc-1ac8f2c702ae req-e4d1b354-4d2e-4302-8f0c-2b3a3aea30dc tempest-AttachVolumeTestJSON-687994885 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202', 'name': 'volume-c9453c0c-4089-47e1-8d82-3f59528336d6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2a01b6ea-30ab-4207-b8d8-e4898edd1d77', 'enforce_multipath': True} {{(pid=88591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:58:01 devstack sudo[99328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:58:01 devstack sudo[99328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:01 devstack cinder-volume[88591]: INFO cinder.volume.manager [req-03499856-06ab-4f4e-bffc-1ac8f2c702ae req-e4d1b354-4d2e-4302-8f0c-2b3a3aea30dc tempest-AttachVolumeTestJSON-687994885 None] attachment_update completed successfully. Jul 30 16:58:01 devstack sudo[99328]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f6efeae6-7c9a-4882-8c7b-5e2cbc9774b5 tempest-VolumesTransfersV357Test-2001503402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.394s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:01 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-f6efeae6-7c9a-4882-8c7b-5e2cbc9774b5 tempest-VolumesTransfersV357Test-2001503402 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:58:01 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-f6efeae6-7c9a-4882-8c7b-5e2cbc9774b5 tempest-VolumesTransfersV357Test-2001503402 None] Deleted volume successfully. Jul 30 16:58:01 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f6efeae6-7c9a-4882-8c7b-5e2cbc9774b5 tempest-VolumesTransfersV357Test-2001503402 None] Lock "cinder-14bd2f5d-e92e-4e57-aec2-640600bc93b0-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:01 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-bb9cb9cc-a6da-4923-a17a-776a733d5c17 tempest-VolumesMetadataTest-241115663 None] Acquiring lock "cinder-c846668c-1144-4119-8430-ce92167137f6-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:01 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-bb9cb9cc-a6da-4923-a17a-776a733d5c17 tempest-VolumesMetadataTest-241115663 None] Lock "cinder-c846668c-1144-4119-8430-ce92167137f6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:01 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-bb9cb9cc-a6da-4923-a17a-776a733d5c17 tempest-VolumesMetadataTest-241115663 None] Acquiring lock "cinder-quobyte-c846668c-1144-4119-8430-ce92167137f6" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:01 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-bb9cb9cc-a6da-4923-a17a-776a733d5c17 tempest-VolumesMetadataTest-241115663 None] Lock "cinder-quobyte-c846668c-1144-4119-8430-ce92167137f6" acquired by "delete_volume" :: waited 0.035s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:02 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[937b6e1d-7445-418d-909c-542b4d3c3a52]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bb9cb9cc-a6da-4923-a17a-776a733d5c17 tempest-VolumesMetadataTest-241115663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c846668c-1144-4119-8430-ce92167137f6 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:02 devstack sudo[99337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c846668c-1144-4119-8430-ce92167137f6 Jul 30 16:58:02 devstack sudo[99337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:02 devstack sudo[99337]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bb9cb9cc-a6da-4923-a17a-776a733d5c17 tempest-VolumesMetadataTest-241115663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c846668c-1144-4119-8430-ce92167137f6" returned: 0 in 0.575s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bb9cb9cc-a6da-4923-a17a-776a733d5c17 tempest-VolumesMetadataTest-241115663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c846668c-1144-4119-8430-ce92167137f6 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:02 devstack sudo[99342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c846668c-1144-4119-8430-ce92167137f6 Jul 30 16:58:02 devstack sudo[99342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:03 devstack sudo[99342]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bb9cb9cc-a6da-4923-a17a-776a733d5c17 tempest-VolumesMetadataTest-241115663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c846668c-1144-4119-8430-ce92167137f6" returned: 0 in 0.395s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:03 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-bb9cb9cc-a6da-4923-a17a-776a733d5c17 tempest-VolumesMetadataTest-241115663 None] Lock "cinder-quobyte-c846668c-1144-4119-8430-ce92167137f6" released by "delete_volume" :: held 1.072s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:03 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-bb9cb9cc-a6da-4923-a17a-776a733d5c17 tempest-VolumesMetadataTest-241115663 None] Created reservations ['c75b4610-7b75-4058-95d7-4ab3103f7026', '0c5eaf8e-6649-433d-a2f3-addcf6d03a41', 'e362178b-dcca-4359-8d86-ec294fdc0f63', '9cdbba51-57be-44be-a4a4-b0bf01904f8c'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:58:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-bb9cb9cc-a6da-4923-a17a-776a733d5c17 tempest-VolumesMetadataTest-241115663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-bb9cb9cc-a6da-4923-a17a-776a733d5c17 tempest-VolumesMetadataTest-241115663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:03 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-bb9cb9cc-a6da-4923-a17a-776a733d5c17 tempest-VolumesMetadataTest-241115663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:58:03 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-bb9cb9cc-a6da-4923-a17a-776a733d5c17 tempest-VolumesMetadataTest-241115663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:58:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-bb9cb9cc-a6da-4923-a17a-776a733d5c17 tempest-VolumesMetadataTest-241115663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bb9cb9cc-a6da-4923-a17a-776a733d5c17 tempest-VolumesMetadataTest-241115663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:03 devstack sudo[99348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:58:03 devstack sudo[99348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:03 devstack sudo[99348]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bb9cb9cc-a6da-4923-a17a-776a733d5c17 tempest-VolumesMetadataTest-241115663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.417s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:03 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-bb9cb9cc-a6da-4923-a17a-776a733d5c17 tempest-VolumesMetadataTest-241115663 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:58:03 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-bb9cb9cc-a6da-4923-a17a-776a733d5c17 tempest-VolumesMetadataTest-241115663 None] Deleted volume successfully. Jul 30 16:58:03 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-bb9cb9cc-a6da-4923-a17a-776a733d5c17 tempest-VolumesMetadataTest-241115663 None] Lock "cinder-c846668c-1144-4119-8430-ce92167137f6-delete_volume" released by "delete_volume" :: held 1.842s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:04 devstack cinder-volume[88591]: INFO cinder.volume.manager [req-6fab8795-666d-48b9-bf7d-3f1437c6a877 req-5c3b2631-be21-4208-bb94-00005195c1f4 tempest-AttachVolumeTestJSON-687994885 None] Terminate volume connection completed successfully. Jul 30 16:58:04 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-6fab8795-666d-48b9-bf7d-3f1437c6a877 req-5c3b2631-be21-4208-bb94-00005195c1f4 tempest-AttachVolumeTestJSON-687994885 None] Deleting attachment 0d81d367-fd52-43ef-a8b7-6da04af01be3. {{(pid=88591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:58:07 devstack cinder-volume[88591]: INFO cinder.volume.manager [req-fdcf0321-779d-4c63-a31a-37f502502a7b req-23a223db-3681-4288-8dd5-cbcd3861fce0 tempest-AttachVolumeTestJSON-687994885 None] Terminate volume connection completed successfully. Jul 30 16:58:07 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-fdcf0321-779d-4c63-a31a-37f502502a7b req-23a223db-3681-4288-8dd5-cbcd3861fce0 tempest-AttachVolumeTestJSON-687994885 None] Deleting attachment 2a01b6ea-30ab-4207-b8d8-e4898edd1d77. {{(pid=88591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:58:12 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0fa5163-d399-440f-b549-275b2a037295 tempest-VolumesCloneNegativeTest-440939818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:58:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a0fa5163-d399-440f-b549-275b2a037295 tempest-VolumesCloneNegativeTest-440939818 None] Flow 'volume_create_manager' (ab41173f-f106-436f-83b5-7c566e880ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:58:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a0fa5163-d399-440f-b549-275b2a037295 tempest-VolumesCloneNegativeTest-440939818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2c59e85-c47d-43e9-8aba-2a8505816834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a0fa5163-d399-440f-b549-275b2a037295 tempest-VolumesCloneNegativeTest-440939818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2c59e85-c47d-43e9-8aba-2a8505816834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1457814714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2840ca0d-35d6-4d9f-97f0-c1f45aaa7ba5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54f7c733ac6a4fcfb0e148522d535834',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:58:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:58:12Z,use_quota=True,user_id='d5b17684d2b04869a3467d810761d63d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a0fa5163-d399-440f-b549-275b2a037295 tempest-VolumesCloneNegativeTest-440939818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfd3ecfa-c761-41eb-930d-bfa3b29cedfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a0fa5163-d399-440f-b549-275b2a037295 tempest-VolumesCloneNegativeTest-440939818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfd3ecfa-c761-41eb-930d-bfa3b29cedfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a0fa5163-d399-440f-b549-275b2a037295 tempest-VolumesCloneNegativeTest-440939818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3993f4f9-556f-4052-9bde-91a5a8109705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a0fa5163-d399-440f-b549-275b2a037295 tempest-VolumesCloneNegativeTest-440939818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3993f4f9-556f-4052-9bde-91a5a8109705) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2840ca0d-35d6-4d9f-97f0-c1f45aaa7ba5', 'volume_name': 'volume-2840ca0d-35d6-4d9f-97f0-c1f45aaa7ba5', 'volume_size': 2}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a0fa5163-d399-440f-b549-275b2a037295 tempest-VolumesCloneNegativeTest-440939818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22368591-d3ce-4788-a0f2-bae6c4808fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a0fa5163-d399-440f-b549-275b2a037295 tempest-VolumesCloneNegativeTest-440939818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22368591-d3ce-4788-a0f2-bae6c4808fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a0fa5163-d399-440f-b549-275b2a037295 tempest-VolumesCloneNegativeTest-440939818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb0e956d-5aeb-44fc-b280-9ae0d92825b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:12 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-a0fa5163-d399-440f-b549-275b2a037295 tempest-VolumesCloneNegativeTest-440939818 None] Volume 2840ca0d-35d6-4d9f-97f0-c1f45aaa7ba5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2840ca0d-35d6-4d9f-97f0-c1f45aaa7ba5', 'volume_size': 2} Jul 30 16:58:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a0fa5163-d399-440f-b549-275b2a037295 tempest-VolumesCloneNegativeTest-440939818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a0fa5163-d399-440f-b549-275b2a037295 tempest-VolumesCloneNegativeTest-440939818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a0fa5163-d399-440f-b549-275b2a037295 tempest-VolumesCloneNegativeTest-440939818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1457814714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2840ca0d-35d6-4d9f-97f0-c1f45aaa7ba5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54f7c733ac6a4fcfb0e148522d535834',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:58:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:58:12Z,use_quota=True,user_id='d5b17684d2b04869a3467d810761d63d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:58:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-a0fa5163-d399-440f-b549-275b2a037295 tempest-VolumesCloneNegativeTest-440939818 None] Creating volume 2840ca0d-35d6-4d9f-97f0-c1f45aaa7ba5 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:58:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a0fa5163-d399-440f-b549-275b2a037295 tempest-VolumesCloneNegativeTest-440939818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a0fa5163-d399-440f-b549-275b2a037295 tempest-VolumesCloneNegativeTest-440939818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a0fa5163-d399-440f-b549-275b2a037295 tempest-VolumesCloneNegativeTest-440939818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:58:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a0fa5163-d399-440f-b549-275b2a037295 tempest-VolumesCloneNegativeTest-440939818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:58:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a0fa5163-d399-440f-b549-275b2a037295 tempest-VolumesCloneNegativeTest-440939818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a0fa5163-d399-440f-b549-275b2a037295 tempest-VolumesCloneNegativeTest-440939818 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:58:12 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-a0fa5163-d399-440f-b549-275b2a037295 tempest-VolumesCloneNegativeTest-440939818 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:58:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a0fa5163-d399-440f-b549-275b2a037295 tempest-VolumesCloneNegativeTest-440939818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2840ca0d-35d6-4d9f-97f0-c1f45aaa7ba5 2147483648 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:12 devstack sudo[99471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2840ca0d-35d6-4d9f-97f0-c1f45aaa7ba5 2147483648 Jul 30 16:58:12 devstack sudo[99471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:12 devstack cinder-volume[88591]: DEBUG oslo_service.periodic_task [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:58:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:58:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:58:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:12 devstack sudo[99475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:58:12 devstack sudo[99475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:12 devstack sudo[99475]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.431s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:13 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:58:13 devstack cinder-volume[88591]: DEBUG oslo_service.periodic_task [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running periodic task VolumeManager._thread_info {{(pid=88591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:58:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] thread count: 28 {{(pid=88591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:58:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] thread info: [<_MainThread(MainThread, started 140677178003584)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:58:13 devstack sudo[99471]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a0fa5163-d399-440f-b549-275b2a037295 tempest-VolumesCloneNegativeTest-440939818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2840ca0d-35d6-4d9f-97f0-c1f45aaa7ba5 2147483648" returned: 0 in 0.857s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a0fa5163-d399-440f-b549-275b2a037295 tempest-VolumesCloneNegativeTest-440939818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2840ca0d-35d6-4d9f-97f0-c1f45aaa7ba5 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:13 devstack sudo[99480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2840ca0d-35d6-4d9f-97f0-c1f45aaa7ba5 Jul 30 16:58:13 devstack sudo[99480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:13 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d80839c-6427-4159-9848-c4be2b7bdff9 tempest-VolumesTransfersTest-908610306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:58:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6d80839c-6427-4159-9848-c4be2b7bdff9 tempest-VolumesTransfersTest-908610306 None] Flow 'volume_create_manager' (c34ba69a-1db3-463f-8aeb-67a6671b35b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:58:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6d80839c-6427-4159-9848-c4be2b7bdff9 tempest-VolumesTransfersTest-908610306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5c5d9d4-0db2-45ad-a359-32f9753c84fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6d80839c-6427-4159-9848-c4be2b7bdff9 tempest-VolumesTransfersTest-908610306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5c5d9d4-0db2-45ad-a359-32f9753c84fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-169973456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=127faa23-67b3-4a3e-8960-6c4c9a2c717a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3dfca2481b24e7e9c77a30f0e43cff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:58:13Z,use_quota=True,user_id='672664ab421a4b13b85f4420e4bc9d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6d80839c-6427-4159-9848-c4be2b7bdff9 tempest-VolumesTransfersTest-908610306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cb74be0-b329-4819-88ae-00e9bae16dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6d80839c-6427-4159-9848-c4be2b7bdff9 tempest-VolumesTransfersTest-908610306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cb74be0-b329-4819-88ae-00e9bae16dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6d80839c-6427-4159-9848-c4be2b7bdff9 tempest-VolumesTransfersTest-908610306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (044e4536-2f7b-4895-9a4d-2ed667f391f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6d80839c-6427-4159-9848-c4be2b7bdff9 tempest-VolumesTransfersTest-908610306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (044e4536-2f7b-4895-9a4d-2ed667f391f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '127faa23-67b3-4a3e-8960-6c4c9a2c717a', 'volume_name': 'volume-127faa23-67b3-4a3e-8960-6c4c9a2c717a', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6d80839c-6427-4159-9848-c4be2b7bdff9 tempest-VolumesTransfersTest-908610306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6131a80-86d4-4cd3-b70f-54851d59713e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6d80839c-6427-4159-9848-c4be2b7bdff9 tempest-VolumesTransfersTest-908610306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6131a80-86d4-4cd3-b70f-54851d59713e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6d80839c-6427-4159-9848-c4be2b7bdff9 tempest-VolumesTransfersTest-908610306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bf7f93a-e39c-4744-aba1-ddfb006e9f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:13 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-6d80839c-6427-4159-9848-c4be2b7bdff9 tempest-VolumesTransfersTest-908610306 None] Volume 127faa23-67b3-4a3e-8960-6c4c9a2c717a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-127faa23-67b3-4a3e-8960-6c4c9a2c717a', 'volume_size': 1} Jul 30 16:58:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-6d80839c-6427-4159-9848-c4be2b7bdff9 tempest-VolumesTransfersTest-908610306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:13 devstack sudo[99480]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a0fa5163-d399-440f-b549-275b2a037295 tempest-VolumesCloneNegativeTest-440939818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2840ca0d-35d6-4d9f-97f0-c1f45aaa7ba5" returned: 0 in 0.352s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:13 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a0fa5163-d399-440f-b549-275b2a037295 tempest-VolumesCloneNegativeTest-440939818 None] <== create_volume: return (1298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:58:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a0fa5163-d399-440f-b549-275b2a037295 tempest-VolumesCloneNegativeTest-440939818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.304s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-6d80839c-6427-4159-9848-c4be2b7bdff9 tempest-VolumesTransfersTest-908610306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.020s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:13 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-6d80839c-6427-4159-9848-c4be2b7bdff9 tempest-VolumesTransfersTest-908610306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-169973456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=127faa23-67b3-4a3e-8960-6c4c9a2c717a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3dfca2481b24e7e9c77a30f0e43cff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:58:13Z,use_quota=True,user_id='672664ab421a4b13b85f4420e4bc9d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:58:13 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-6d80839c-6427-4159-9848-c4be2b7bdff9 tempest-VolumesTransfersTest-908610306 None] Creating volume 127faa23-67b3-4a3e-8960-6c4c9a2c717a {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:58:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-6d80839c-6427-4159-9848-c4be2b7bdff9 tempest-VolumesTransfersTest-908610306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-6d80839c-6427-4159-9848-c4be2b7bdff9 tempest-VolumesTransfersTest-908610306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:13 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-6d80839c-6427-4159-9848-c4be2b7bdff9 tempest-VolumesTransfersTest-908610306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:58:13 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-6d80839c-6427-4159-9848-c4be2b7bdff9 tempest-VolumesTransfersTest-908610306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:58:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-6d80839c-6427-4159-9848-c4be2b7bdff9 tempest-VolumesTransfersTest-908610306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:13 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-6d80839c-6427-4159-9848-c4be2b7bdff9 tempest-VolumesTransfersTest-908610306 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:58:13 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-6d80839c-6427-4159-9848-c4be2b7bdff9 tempest-VolumesTransfersTest-908610306 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:58:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6d80839c-6427-4159-9848-c4be2b7bdff9 tempest-VolumesTransfersTest-908610306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-127faa23-67b3-4a3e-8960-6c4c9a2c717a 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a0fa5163-d399-440f-b549-275b2a037295 tempest-VolumesCloneNegativeTest-440939818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb0e956d-5aeb-44fc-b280-9ae0d92825b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2840ca0d-35d6-4d9f-97f0-c1f45aaa7ba5', 'volume_size': 2}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:13 devstack sudo[99483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-127faa23-67b3-4a3e-8960-6c4c9a2c717a 1073741824 Jul 30 16:58:13 devstack sudo[99483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a0fa5163-d399-440f-b549-275b2a037295 tempest-VolumesCloneNegativeTest-440939818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bef05b4-bdbf-4f00-99b4-fa4ce58c72cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:13 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-a0fa5163-d399-440f-b549-275b2a037295 tempest-VolumesCloneNegativeTest-440939818 None] Volume volume-2840ca0d-35d6-4d9f-97f0-c1f45aaa7ba5 (2840ca0d-35d6-4d9f-97f0-c1f45aaa7ba5): created successfully Jul 30 16:58:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a0fa5163-d399-440f-b549-275b2a037295 tempest-VolumesCloneNegativeTest-440939818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bef05b4-bdbf-4f00-99b4-fa4ce58c72cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a0fa5163-d399-440f-b549-275b2a037295 tempest-VolumesCloneNegativeTest-440939818 None] Flow 'volume_create_manager' (ab41173f-f106-436f-83b5-7c566e880ffd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:58:13 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-a0fa5163-d399-440f-b549-275b2a037295 tempest-VolumesCloneNegativeTest-440939818 None] Created volume successfully. Jul 30 16:58:14 devstack sudo[99483]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6d80839c-6427-4159-9848-c4be2b7bdff9 tempest-VolumesTransfersTest-908610306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-127faa23-67b3-4a3e-8960-6c4c9a2c717a 1073741824" returned: 0 in 0.618s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6d80839c-6427-4159-9848-c4be2b7bdff9 tempest-VolumesTransfersTest-908610306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-127faa23-67b3-4a3e-8960-6c4c9a2c717a {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:14 devstack sudo[99490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-127faa23-67b3-4a3e-8960-6c4c9a2c717a Jul 30 16:58:14 devstack sudo[99490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:14 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-26cd1aee-705e-4608-b933-66f9fe04e6d8 tempest-VolumesCloneNegativeTest-440939818 None] Acquiring lock "cinder-2840ca0d-35d6-4d9f-97f0-c1f45aaa7ba5-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:14 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-5f5a0f9e-6d23-485c-909f-f3b268b40ca1 tempest-AttachVolumeTestJSON-687994885 None] Acquiring lock "cinder-c9453c0c-4089-47e1-8d82-3f59528336d6-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:14 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-26cd1aee-705e-4608-b933-66f9fe04e6d8 tempest-VolumesCloneNegativeTest-440939818 None] Lock "cinder-2840ca0d-35d6-4d9f-97f0-c1f45aaa7ba5-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:14 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-5f5a0f9e-6d23-485c-909f-f3b268b40ca1 tempest-AttachVolumeTestJSON-687994885 None] Lock "cinder-c9453c0c-4089-47e1-8d82-3f59528336d6-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:14 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-26cd1aee-705e-4608-b933-66f9fe04e6d8 tempest-VolumesCloneNegativeTest-440939818 None] Acquiring lock "cinder-quobyte-2840ca0d-35d6-4d9f-97f0-c1f45aaa7ba5" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:14 devstack sudo[99490]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:14 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-5f5a0f9e-6d23-485c-909f-f3b268b40ca1 tempest-AttachVolumeTestJSON-687994885 None] Acquiring lock "cinder-quobyte-c9453c0c-4089-47e1-8d82-3f59528336d6" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:14 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-26cd1aee-705e-4608-b933-66f9fe04e6d8 tempest-VolumesCloneNegativeTest-440939818 None] Lock "cinder-quobyte-2840ca0d-35d6-4d9f-97f0-c1f45aaa7ba5" acquired by "delete_volume" :: waited 0.040s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6d80839c-6427-4159-9848-c4be2b7bdff9 tempest-VolumesTransfersTest-908610306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-127faa23-67b3-4a3e-8960-6c4c9a2c717a" returned: 0 in 0.436s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:14 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-6d80839c-6427-4159-9848-c4be2b7bdff9 tempest-VolumesTransfersTest-908610306 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:58:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-6d80839c-6427-4159-9848-c4be2b7bdff9 tempest-VolumesTransfersTest-908610306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:14 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5801180b-45f7-4491-9e4a-3a87f8ac3b5e]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-26cd1aee-705e-4608-b933-66f9fe04e6d8 tempest-VolumesCloneNegativeTest-440939818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2840ca0d-35d6-4d9f-97f0-c1f45aaa7ba5 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:14 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-5f5a0f9e-6d23-485c-909f-f3b268b40ca1 tempest-AttachVolumeTestJSON-687994885 None] Lock "cinder-quobyte-c9453c0c-4089-47e1-8d82-3f59528336d6" acquired by "delete_volume" :: waited 0.050s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:14 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6d80839c-6427-4159-9848-c4be2b7bdff9 tempest-VolumesTransfersTest-908610306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bf7f93a-e39c-4744-aba1-ddfb006e9f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-127faa23-67b3-4a3e-8960-6c4c9a2c717a', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:14 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6d80839c-6427-4159-9848-c4be2b7bdff9 tempest-VolumesTransfersTest-908610306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f72f410-5d02-4b11-b3b6-1d471fab3a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:14 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67d099c-3826-4b3c-8b2a-a98380de4ce4]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5f5a0f9e-6d23-485c-909f-f3b268b40ca1 tempest-AttachVolumeTestJSON-687994885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9453c0c-4089-47e1-8d82-3f59528336d6 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:14 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-6d80839c-6427-4159-9848-c4be2b7bdff9 tempest-VolumesTransfersTest-908610306 None] Volume volume-127faa23-67b3-4a3e-8960-6c4c9a2c717a (127faa23-67b3-4a3e-8960-6c4c9a2c717a): created successfully Jul 30 16:58:14 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6d80839c-6427-4159-9848-c4be2b7bdff9 tempest-VolumesTransfersTest-908610306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f72f410-5d02-4b11-b3b6-1d471fab3a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:14 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6d80839c-6427-4159-9848-c4be2b7bdff9 tempest-VolumesTransfersTest-908610306 None] Flow 'volume_create_manager' (c34ba69a-1db3-463f-8aeb-67a6671b35b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:58:14 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-6d80839c-6427-4159-9848-c4be2b7bdff9 tempest-VolumesTransfersTest-908610306 None] Created volume successfully. Jul 30 16:58:14 devstack sudo[99493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2840ca0d-35d6-4d9f-97f0-c1f45aaa7ba5 Jul 30 16:58:14 devstack sudo[99493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:14 devstack sudo[99494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9453c0c-4089-47e1-8d82-3f59528336d6 Jul 30 16:58:14 devstack sudo[99494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:15 devstack sudo[99493]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-26cd1aee-705e-4608-b933-66f9fe04e6d8 tempest-VolumesCloneNegativeTest-440939818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2840ca0d-35d6-4d9f-97f0-c1f45aaa7ba5" returned: 0 in 0.387s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-26cd1aee-705e-4608-b933-66f9fe04e6d8 tempest-VolumesCloneNegativeTest-440939818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2840ca0d-35d6-4d9f-97f0-c1f45aaa7ba5 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:15 devstack sudo[99500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2840ca0d-35d6-4d9f-97f0-c1f45aaa7ba5 Jul 30 16:58:15 devstack sudo[99500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:15 devstack sudo[99494]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5f5a0f9e-6d23-485c-909f-f3b268b40ca1 tempest-AttachVolumeTestJSON-687994885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9453c0c-4089-47e1-8d82-3f59528336d6" returned: 0 in 0.413s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5f5a0f9e-6d23-485c-909f-f3b268b40ca1 tempest-AttachVolumeTestJSON-687994885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9453c0c-4089-47e1-8d82-3f59528336d6 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:15 devstack sudo[99505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9453c0c-4089-47e1-8d82-3f59528336d6 Jul 30 16:58:15 devstack sudo[99505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:15 devstack sudo[99500]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-26cd1aee-705e-4608-b933-66f9fe04e6d8 tempest-VolumesCloneNegativeTest-440939818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2840ca0d-35d6-4d9f-97f0-c1f45aaa7ba5" returned: 0 in 0.276s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:15 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-26cd1aee-705e-4608-b933-66f9fe04e6d8 tempest-VolumesCloneNegativeTest-440939818 None] Lock "cinder-quobyte-2840ca0d-35d6-4d9f-97f0-c1f45aaa7ba5" released by "delete_volume" :: held 0.720s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:15 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-26cd1aee-705e-4608-b933-66f9fe04e6d8 tempest-VolumesCloneNegativeTest-440939818 None] Created reservations ['af7316d6-70f6-4a2c-8da2-4032f10e9f35', '72a9630d-2c9b-44b5-9774-f38cd2f2f360', '7b90ba01-3b21-4bdd-9ae3-0a24059cfbf2', '916f1656-e412-4566-8128-c98a8e01ac21'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:58:15 devstack sudo[99505]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5f5a0f9e-6d23-485c-909f-f3b268b40ca1 tempest-AttachVolumeTestJSON-687994885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9453c0c-4089-47e1-8d82-3f59528336d6" returned: 0 in 0.314s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:15 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-5f5a0f9e-6d23-485c-909f-f3b268b40ca1 tempest-AttachVolumeTestJSON-687994885 None] Lock "cinder-quobyte-c9453c0c-4089-47e1-8d82-3f59528336d6" released by "delete_volume" :: held 0.797s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-26cd1aee-705e-4608-b933-66f9fe04e6d8 tempest-VolumesCloneNegativeTest-440939818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-26cd1aee-705e-4608-b933-66f9fe04e6d8 tempest-VolumesCloneNegativeTest-440939818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:15 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-26cd1aee-705e-4608-b933-66f9fe04e6d8 tempest-VolumesCloneNegativeTest-440939818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:58:15 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-26cd1aee-705e-4608-b933-66f9fe04e6d8 tempest-VolumesCloneNegativeTest-440939818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:58:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-26cd1aee-705e-4608-b933-66f9fe04e6d8 tempest-VolumesCloneNegativeTest-440939818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-26cd1aee-705e-4608-b933-66f9fe04e6d8 tempest-VolumesCloneNegativeTest-440939818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:15 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-5f5a0f9e-6d23-485c-909f-f3b268b40ca1 tempest-AttachVolumeTestJSON-687994885 None] Created reservations ['6fe7807a-a7ac-4632-8781-7cb3c7152c1b', '0e37f0cb-68f3-4fe2-bff9-7076f56026b9', '35a3e6ae-ea09-4b29-8953-784cee93cc80', 'f7f81eef-48d3-45b8-a787-e6ac1831a41f'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:58:15 devstack sudo[99509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:58:15 devstack sudo[99509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5f5a0f9e-6d23-485c-909f-f3b268b40ca1 tempest-AttachVolumeTestJSON-687994885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5f5a0f9e-6d23-485c-909f-f3b268b40ca1 tempest-AttachVolumeTestJSON-687994885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:15 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-5f5a0f9e-6d23-485c-909f-f3b268b40ca1 tempest-AttachVolumeTestJSON-687994885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:58:15 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-5f5a0f9e-6d23-485c-909f-f3b268b40ca1 tempest-AttachVolumeTestJSON-687994885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:58:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5f5a0f9e-6d23-485c-909f-f3b268b40ca1 tempest-AttachVolumeTestJSON-687994885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5f5a0f9e-6d23-485c-909f-f3b268b40ca1 tempest-AttachVolumeTestJSON-687994885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:15 devstack sudo[99535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:58:15 devstack sudo[99535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:16 devstack sudo[99509]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:16 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-26cd1aee-705e-4608-b933-66f9fe04e6d8 tempest-VolumesCloneNegativeTest-440939818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.511s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:16 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-26cd1aee-705e-4608-b933-66f9fe04e6d8 tempest-VolumesCloneNegativeTest-440939818 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:58:16 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-26cd1aee-705e-4608-b933-66f9fe04e6d8 tempest-VolumesCloneNegativeTest-440939818 None] Deleted volume successfully. Jul 30 16:58:16 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ba730b9b-cfd5-478d-b0ac-4f921873c782 tempest-AttachVolumeTestJSON-687994885 None] Acquiring lock "cinder-bf15aa21-c8c4-4b4a-b26f-582d82dee8db-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:16 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ba730b9b-cfd5-478d-b0ac-4f921873c782 tempest-AttachVolumeTestJSON-687994885 None] Lock "cinder-bf15aa21-c8c4-4b4a-b26f-582d82dee8db-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:16 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-26cd1aee-705e-4608-b933-66f9fe04e6d8 tempest-VolumesCloneNegativeTest-440939818 None] Lock "cinder-2840ca0d-35d6-4d9f-97f0-c1f45aaa7ba5-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:16 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ba730b9b-cfd5-478d-b0ac-4f921873c782 tempest-AttachVolumeTestJSON-687994885 None] Acquiring lock "cinder-quobyte-bf15aa21-c8c4-4b4a-b26f-582d82dee8db" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:16 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ba730b9b-cfd5-478d-b0ac-4f921873c782 tempest-AttachVolumeTestJSON-687994885 None] Lock "cinder-quobyte-bf15aa21-c8c4-4b4a-b26f-582d82dee8db" acquired by "delete_volume" :: waited 0.026s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:16 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e407808-c501-44be-be7d-8f2d77474530]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:16 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ba730b9b-cfd5-478d-b0ac-4f921873c782 tempest-AttachVolumeTestJSON-687994885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf15aa21-c8c4-4b4a-b26f-582d82dee8db {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:16 devstack sudo[99535]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:16 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5f5a0f9e-6d23-485c-909f-f3b268b40ca1 tempest-AttachVolumeTestJSON-687994885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.509s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:16 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-5f5a0f9e-6d23-485c-909f-f3b268b40ca1 tempest-AttachVolumeTestJSON-687994885 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:58:16 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-5f5a0f9e-6d23-485c-909f-f3b268b40ca1 tempest-AttachVolumeTestJSON-687994885 None] Deleted volume successfully. Jul 30 16:58:16 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-5f5a0f9e-6d23-485c-909f-f3b268b40ca1 tempest-AttachVolumeTestJSON-687994885 None] Lock "cinder-c9453c0c-4089-47e1-8d82-3f59528336d6-delete_volume" released by "delete_volume" :: held 1.850s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:16 devstack sudo[99539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf15aa21-c8c4-4b4a-b26f-582d82dee8db Jul 30 16:58:16 devstack sudo[99539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:16 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-9b37d5a8-9b47-415c-b2a0-3f73ec2a57ed tempest-VolumesTransfersTest-1492181686 None] Transfer volume completed successfully. Jul 30 16:58:16 devstack sudo[99539]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:16 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ba730b9b-cfd5-478d-b0ac-4f921873c782 tempest-AttachVolumeTestJSON-687994885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf15aa21-c8c4-4b4a-b26f-582d82dee8db" returned: 0 in 0.570s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:16 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ba730b9b-cfd5-478d-b0ac-4f921873c782 tempest-AttachVolumeTestJSON-687994885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf15aa21-c8c4-4b4a-b26f-582d82dee8db {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:16 devstack sudo[99544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf15aa21-c8c4-4b4a-b26f-582d82dee8db Jul 30 16:58:16 devstack sudo[99544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:17 devstack sudo[99544]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ba730b9b-cfd5-478d-b0ac-4f921873c782 tempest-AttachVolumeTestJSON-687994885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf15aa21-c8c4-4b4a-b26f-582d82dee8db" returned: 0 in 0.405s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:17 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ba730b9b-cfd5-478d-b0ac-4f921873c782 tempest-AttachVolumeTestJSON-687994885 None] Lock "cinder-quobyte-bf15aa21-c8c4-4b4a-b26f-582d82dee8db" released by "delete_volume" :: held 1.047s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:17 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-ba730b9b-cfd5-478d-b0ac-4f921873c782 tempest-AttachVolumeTestJSON-687994885 None] Created reservations ['611357e1-c2b8-46da-9e6b-e0638cd56575', 'b0dab4b6-7ecd-4f9b-9b03-c6df3dc44241', 'd82c80b7-09bd-445d-b6ec-b59574c3b6b3', '50341d63-e3ee-49e4-b36b-08ae038caff9'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:58:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ba730b9b-cfd5-478d-b0ac-4f921873c782 tempest-AttachVolumeTestJSON-687994885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ba730b9b-cfd5-478d-b0ac-4f921873c782 tempest-AttachVolumeTestJSON-687994885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:17 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ba730b9b-cfd5-478d-b0ac-4f921873c782 tempest-AttachVolumeTestJSON-687994885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:58:17 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ba730b9b-cfd5-478d-b0ac-4f921873c782 tempest-AttachVolumeTestJSON-687994885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:58:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ba730b9b-cfd5-478d-b0ac-4f921873c782 tempest-AttachVolumeTestJSON-687994885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ba730b9b-cfd5-478d-b0ac-4f921873c782 tempest-AttachVolumeTestJSON-687994885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:17 devstack sudo[99547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:58:17 devstack sudo[99547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:17 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-1c49e0be-1442-48cd-97d9-a517d4af44ef tempest-VolumesTransfersTest-521630690 None] Acquiring lock "cinder-127faa23-67b3-4a3e-8960-6c4c9a2c717a-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:17 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-1c49e0be-1442-48cd-97d9-a517d4af44ef tempest-VolumesTransfersTest-521630690 None] Lock "cinder-127faa23-67b3-4a3e-8960-6c4c9a2c717a-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:17 devstack sudo[99547]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ba730b9b-cfd5-478d-b0ac-4f921873c782 tempest-AttachVolumeTestJSON-687994885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.399s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:17 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-ba730b9b-cfd5-478d-b0ac-4f921873c782 tempest-AttachVolumeTestJSON-687994885 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:58:17 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-ba730b9b-cfd5-478d-b0ac-4f921873c782 tempest-AttachVolumeTestJSON-687994885 None] Deleted volume successfully. Jul 30 16:58:17 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-1c49e0be-1442-48cd-97d9-a517d4af44ef tempest-VolumesTransfersTest-521630690 None] Acquiring lock "cinder-quobyte-127faa23-67b3-4a3e-8960-6c4c9a2c717a" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:18 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-1c49e0be-1442-48cd-97d9-a517d4af44ef tempest-VolumesTransfersTest-521630690 None] Lock "cinder-quobyte-127faa23-67b3-4a3e-8960-6c4c9a2c717a" acquired by "delete_volume" :: waited 0.038s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:18 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ba730b9b-cfd5-478d-b0ac-4f921873c782 tempest-AttachVolumeTestJSON-687994885 None] Lock "cinder-bf15aa21-c8c4-4b4a-b26f-582d82dee8db-delete_volume" released by "delete_volume" :: held 1.841s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:18 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99ab2f5-2c0c-46d9-adfb-5e0347851249]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1c49e0be-1442-48cd-97d9-a517d4af44ef tempest-VolumesTransfersTest-521630690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-127faa23-67b3-4a3e-8960-6c4c9a2c717a {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:18 devstack sudo[99550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-127faa23-67b3-4a3e-8960-6c4c9a2c717a Jul 30 16:58:18 devstack sudo[99550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:18 devstack sudo[99550]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1c49e0be-1442-48cd-97d9-a517d4af44ef tempest-VolumesTransfersTest-521630690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-127faa23-67b3-4a3e-8960-6c4c9a2c717a" returned: 0 in 0.430s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1c49e0be-1442-48cd-97d9-a517d4af44ef tempest-VolumesTransfersTest-521630690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-127faa23-67b3-4a3e-8960-6c4c9a2c717a {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:18 devstack sudo[99555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-127faa23-67b3-4a3e-8960-6c4c9a2c717a Jul 30 16:58:18 devstack sudo[99555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:18 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-5624cc02-09fa-45d4-b186-9ab4f7a11f93 tempest-AttachVolumeTestJSON-687994885 None] Acquiring lock "cinder-7be431fa-65ec-4c16-beec-12e92b54be73-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:18 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-5624cc02-09fa-45d4-b186-9ab4f7a11f93 tempest-AttachVolumeTestJSON-687994885 None] Lock "cinder-7be431fa-65ec-4c16-beec-12e92b54be73-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:18 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-5624cc02-09fa-45d4-b186-9ab4f7a11f93 tempest-AttachVolumeTestJSON-687994885 None] Acquiring lock "cinder-quobyte-7be431fa-65ec-4c16-beec-12e92b54be73" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:18 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-5624cc02-09fa-45d4-b186-9ab4f7a11f93 tempest-AttachVolumeTestJSON-687994885 None] Lock "cinder-quobyte-7be431fa-65ec-4c16-beec-12e92b54be73" acquired by "delete_volume" :: waited 0.031s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:18 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba2828b-6f91-4940-8c9a-6146985ce03a]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5624cc02-09fa-45d4-b186-9ab4f7a11f93 tempest-AttachVolumeTestJSON-687994885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-7be431fa-65ec-4c16-beec-12e92b54be73 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:18 devstack sudo[99555]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1c49e0be-1442-48cd-97d9-a517d4af44ef tempest-VolumesTransfersTest-521630690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-127faa23-67b3-4a3e-8960-6c4c9a2c717a" returned: 0 in 0.332s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:18 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-1c49e0be-1442-48cd-97d9-a517d4af44ef tempest-VolumesTransfersTest-521630690 None] Lock "cinder-quobyte-127faa23-67b3-4a3e-8960-6c4c9a2c717a" released by "delete_volume" :: held 0.833s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:18 devstack sudo[99558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-7be431fa-65ec-4c16-beec-12e92b54be73 Jul 30 16:58:18 devstack sudo[99558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:18 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-1c49e0be-1442-48cd-97d9-a517d4af44ef tempest-VolumesTransfersTest-521630690 None] Created reservations ['c20e4649-1aa4-4599-8353-50d67898423b', 'f283d171-6052-488f-9320-7d3dc4c04d73', 'cae245fe-daf8-4e69-87b1-871183f29f17', 'c4f7f25e-dbd6-46c0-ae22-6552f016554a'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:58:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1c49e0be-1442-48cd-97d9-a517d4af44ef tempest-VolumesTransfersTest-521630690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1c49e0be-1442-48cd-97d9-a517d4af44ef tempest-VolumesTransfersTest-521630690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:19 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-1c49e0be-1442-48cd-97d9-a517d4af44ef tempest-VolumesTransfersTest-521630690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:58:19 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-1c49e0be-1442-48cd-97d9-a517d4af44ef tempest-VolumesTransfersTest-521630690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:58:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1c49e0be-1442-48cd-97d9-a517d4af44ef tempest-VolumesTransfersTest-521630690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1c49e0be-1442-48cd-97d9-a517d4af44ef tempest-VolumesTransfersTest-521630690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:19 devstack sudo[99560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:58:19 devstack sudo[99560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:19 devstack sudo[99558]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5624cc02-09fa-45d4-b186-9ab4f7a11f93 tempest-AttachVolumeTestJSON-687994885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-7be431fa-65ec-4c16-beec-12e92b54be73" returned: 0 in 0.599s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5624cc02-09fa-45d4-b186-9ab4f7a11f93 tempest-AttachVolumeTestJSON-687994885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-7be431fa-65ec-4c16-beec-12e92b54be73 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:19 devstack sudo[99566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-7be431fa-65ec-4c16-beec-12e92b54be73 Jul 30 16:58:19 devstack sudo[99566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:19 devstack sudo[99560]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1c49e0be-1442-48cd-97d9-a517d4af44ef tempest-VolumesTransfersTest-521630690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.629s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:19 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-1c49e0be-1442-48cd-97d9-a517d4af44ef tempest-VolumesTransfersTest-521630690 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:58:19 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-1c49e0be-1442-48cd-97d9-a517d4af44ef tempest-VolumesTransfersTest-521630690 None] Deleted volume successfully. Jul 30 16:58:19 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-1c49e0be-1442-48cd-97d9-a517d4af44ef tempest-VolumesTransfersTest-521630690 None] Lock "cinder-127faa23-67b3-4a3e-8960-6c4c9a2c717a-delete_volume" released by "delete_volume" :: held 1.927s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:19 devstack sudo[99566]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5624cc02-09fa-45d4-b186-9ab4f7a11f93 tempest-AttachVolumeTestJSON-687994885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-7be431fa-65ec-4c16-beec-12e92b54be73" returned: 0 in 0.435s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:19 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-5624cc02-09fa-45d4-b186-9ab4f7a11f93 tempest-AttachVolumeTestJSON-687994885 None] Lock "cinder-quobyte-7be431fa-65ec-4c16-beec-12e92b54be73" released by "delete_volume" :: held 1.112s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:19 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-f60c597c-6bf3-48da-981a-33cdd02ffaf1 tempest-VolumesTransfersTest-908610306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:58:20 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f60c597c-6bf3-48da-981a-33cdd02ffaf1 tempest-VolumesTransfersTest-908610306 None] Flow 'volume_create_manager' (171540f8-5d90-43d2-88cb-66c7d4a966d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:58:20 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f60c597c-6bf3-48da-981a-33cdd02ffaf1 tempest-VolumesTransfersTest-908610306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3164d92-f06f-4a3f-8657-0e348e2e5bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:20 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-5624cc02-09fa-45d4-b186-9ab4f7a11f93 tempest-AttachVolumeTestJSON-687994885 None] Created reservations ['5c85a8f4-325c-49ec-aa93-c58bf3c38821', '3f6c41c0-6581-4259-b299-83b85a087244', 'dcfd5ffc-05b3-410f-b1ce-13b32e430ecf', 'c80ba218-53bc-492d-bcb0-fe45c8e3201a'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:58:20 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f60c597c-6bf3-48da-981a-33cdd02ffaf1 tempest-VolumesTransfersTest-908610306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3164d92-f06f-4a3f-8657-0e348e2e5bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:58:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1959522165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82707416-f91c-43d5-aef9-df77a8b7f0e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3dfca2481b24e7e9c77a30f0e43cff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:58:20Z,use_quota=True,user_id='672664ab421a4b13b85f4420e4bc9d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:20 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f60c597c-6bf3-48da-981a-33cdd02ffaf1 tempest-VolumesTransfersTest-908610306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a064e778-25df-423d-bf64-a745514ca0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:20 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f60c597c-6bf3-48da-981a-33cdd02ffaf1 tempest-VolumesTransfersTest-908610306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a064e778-25df-423d-bf64-a745514ca0ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:20 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f60c597c-6bf3-48da-981a-33cdd02ffaf1 tempest-VolumesTransfersTest-908610306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c47e27c1-57d2-4b95-8205-4fa21efa18fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:20 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f60c597c-6bf3-48da-981a-33cdd02ffaf1 tempest-VolumesTransfersTest-908610306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c47e27c1-57d2-4b95-8205-4fa21efa18fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82707416-f91c-43d5-aef9-df77a8b7f0e3', 'volume_name': 'volume-82707416-f91c-43d5-aef9-df77a8b7f0e3', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:20 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f60c597c-6bf3-48da-981a-33cdd02ffaf1 tempest-VolumesTransfersTest-908610306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d5fa2c3-13d9-43dd-adce-d9ee955eaef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:20 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f60c597c-6bf3-48da-981a-33cdd02ffaf1 tempest-VolumesTransfersTest-908610306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d5fa2c3-13d9-43dd-adce-d9ee955eaef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:20 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f60c597c-6bf3-48da-981a-33cdd02ffaf1 tempest-VolumesTransfersTest-908610306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fb3ea19-4a16-4862-893c-4fb6e635afaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:20 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-f60c597c-6bf3-48da-981a-33cdd02ffaf1 tempest-VolumesTransfersTest-908610306 None] Volume 82707416-f91c-43d5-aef9-df77a8b7f0e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82707416-f91c-43d5-aef9-df77a8b7f0e3', 'volume_size': 1} Jul 30 16:58:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f60c597c-6bf3-48da-981a-33cdd02ffaf1 tempest-VolumesTransfersTest-908610306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f60c597c-6bf3-48da-981a-33cdd02ffaf1 tempest-VolumesTransfersTest-908610306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:20 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f60c597c-6bf3-48da-981a-33cdd02ffaf1 tempest-VolumesTransfersTest-908610306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:58:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1959522165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82707416-f91c-43d5-aef9-df77a8b7f0e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3dfca2481b24e7e9c77a30f0e43cff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:58:20Z,use_quota=True,user_id='672664ab421a4b13b85f4420e4bc9d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:58:20 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-f60c597c-6bf3-48da-981a-33cdd02ffaf1 tempest-VolumesTransfersTest-908610306 None] Creating volume 82707416-f91c-43d5-aef9-df77a8b7f0e3 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:58:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f60c597c-6bf3-48da-981a-33cdd02ffaf1 tempest-VolumesTransfersTest-908610306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f60c597c-6bf3-48da-981a-33cdd02ffaf1 tempest-VolumesTransfersTest-908610306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:20 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f60c597c-6bf3-48da-981a-33cdd02ffaf1 tempest-VolumesTransfersTest-908610306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:58:20 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f60c597c-6bf3-48da-981a-33cdd02ffaf1 tempest-VolumesTransfersTest-908610306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:58:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f60c597c-6bf3-48da-981a-33cdd02ffaf1 tempest-VolumesTransfersTest-908610306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:20 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f60c597c-6bf3-48da-981a-33cdd02ffaf1 tempest-VolumesTransfersTest-908610306 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:58:20 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-f60c597c-6bf3-48da-981a-33cdd02ffaf1 tempest-VolumesTransfersTest-908610306 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:58:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f60c597c-6bf3-48da-981a-33cdd02ffaf1 tempest-VolumesTransfersTest-908610306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-82707416-f91c-43d5-aef9-df77a8b7f0e3 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:20 devstack sudo[99570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-82707416-f91c-43d5-aef9-df77a8b7f0e3 1073741824 Jul 30 16:58:20 devstack sudo[99570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5624cc02-09fa-45d4-b186-9ab4f7a11f93 tempest-AttachVolumeTestJSON-687994885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5624cc02-09fa-45d4-b186-9ab4f7a11f93 tempest-AttachVolumeTestJSON-687994885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:20 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-5624cc02-09fa-45d4-b186-9ab4f7a11f93 tempest-AttachVolumeTestJSON-687994885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:58:20 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-5624cc02-09fa-45d4-b186-9ab4f7a11f93 tempest-AttachVolumeTestJSON-687994885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:58:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5624cc02-09fa-45d4-b186-9ab4f7a11f93 tempest-AttachVolumeTestJSON-687994885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5624cc02-09fa-45d4-b186-9ab4f7a11f93 tempest-AttachVolumeTestJSON-687994885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:20 devstack sudo[99572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:58:20 devstack sudo[99572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:20 devstack sudo[99572]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5624cc02-09fa-45d4-b186-9ab4f7a11f93 tempest-AttachVolumeTestJSON-687994885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.350s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:20 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-5624cc02-09fa-45d4-b186-9ab4f7a11f93 tempest-AttachVolumeTestJSON-687994885 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:58:20 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-5624cc02-09fa-45d4-b186-9ab4f7a11f93 tempest-AttachVolumeTestJSON-687994885 None] Deleted volume successfully. Jul 30 16:58:20 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-5624cc02-09fa-45d4-b186-9ab4f7a11f93 tempest-AttachVolumeTestJSON-687994885 None] Lock "cinder-7be431fa-65ec-4c16-beec-12e92b54be73-delete_volume" released by "delete_volume" :: held 1.959s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:20 devstack sudo[99570]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f60c597c-6bf3-48da-981a-33cdd02ffaf1 tempest-VolumesTransfersTest-908610306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-82707416-f91c-43d5-aef9-df77a8b7f0e3 1073741824" returned: 0 in 0.741s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f60c597c-6bf3-48da-981a-33cdd02ffaf1 tempest-VolumesTransfersTest-908610306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-82707416-f91c-43d5-aef9-df77a8b7f0e3 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:20 devstack sudo[99579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-82707416-f91c-43d5-aef9-df77a8b7f0e3 Jul 30 16:58:20 devstack sudo[99579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:21 devstack sudo[99579]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f60c597c-6bf3-48da-981a-33cdd02ffaf1 tempest-VolumesTransfersTest-908610306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-82707416-f91c-43d5-aef9-df77a8b7f0e3" returned: 0 in 0.353s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:21 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f60c597c-6bf3-48da-981a-33cdd02ffaf1 tempest-VolumesTransfersTest-908610306 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:58:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f60c597c-6bf3-48da-981a-33cdd02ffaf1 tempest-VolumesTransfersTest-908610306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f60c597c-6bf3-48da-981a-33cdd02ffaf1 tempest-VolumesTransfersTest-908610306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fb3ea19-4a16-4862-893c-4fb6e635afaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82707416-f91c-43d5-aef9-df77a8b7f0e3', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f60c597c-6bf3-48da-981a-33cdd02ffaf1 tempest-VolumesTransfersTest-908610306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58940049-22b4-4011-9cad-7e1413e51fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:21 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-f60c597c-6bf3-48da-981a-33cdd02ffaf1 tempest-VolumesTransfersTest-908610306 None] Volume volume-82707416-f91c-43d5-aef9-df77a8b7f0e3 (82707416-f91c-43d5-aef9-df77a8b7f0e3): created successfully Jul 30 16:58:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f60c597c-6bf3-48da-981a-33cdd02ffaf1 tempest-VolumesTransfersTest-908610306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58940049-22b4-4011-9cad-7e1413e51fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f60c597c-6bf3-48da-981a-33cdd02ffaf1 tempest-VolumesTransfersTest-908610306 None] Flow 'volume_create_manager' (171540f8-5d90-43d2-88cb-66c7d4a966d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:58:21 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-f60c597c-6bf3-48da-981a-33cdd02ffaf1 tempest-VolumesTransfersTest-908610306 None] Created volume successfully. Jul 30 16:58:22 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-598370af-09ad-490b-abc8-c17b5cb9f3b0 tempest-VolumesTransfersTest-521630690 None] Acquiring lock "cinder-82707416-f91c-43d5-aef9-df77a8b7f0e3-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:22 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-598370af-09ad-490b-abc8-c17b5cb9f3b0 tempest-VolumesTransfersTest-521630690 None] Lock "cinder-82707416-f91c-43d5-aef9-df77a8b7f0e3-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:22 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-598370af-09ad-490b-abc8-c17b5cb9f3b0 tempest-VolumesTransfersTest-521630690 None] Acquiring lock "cinder-quobyte-82707416-f91c-43d5-aef9-df77a8b7f0e3" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:22 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-598370af-09ad-490b-abc8-c17b5cb9f3b0 tempest-VolumesTransfersTest-521630690 None] Lock "cinder-quobyte-82707416-f91c-43d5-aef9-df77a8b7f0e3" acquired by "delete_volume" :: waited 0.033s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:22 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[408b4a64-1901-4490-9772-ca8c9293b745]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-598370af-09ad-490b-abc8-c17b5cb9f3b0 tempest-VolumesTransfersTest-521630690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-82707416-f91c-43d5-aef9-df77a8b7f0e3 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:22 devstack sudo[99584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-82707416-f91c-43d5-aef9-df77a8b7f0e3 Jul 30 16:58:22 devstack sudo[99584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:23 devstack sudo[99584]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-598370af-09ad-490b-abc8-c17b5cb9f3b0 tempest-VolumesTransfersTest-521630690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-82707416-f91c-43d5-aef9-df77a8b7f0e3" returned: 0 in 0.438s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-598370af-09ad-490b-abc8-c17b5cb9f3b0 tempest-VolumesTransfersTest-521630690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-82707416-f91c-43d5-aef9-df77a8b7f0e3 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:23 devstack sudo[99592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-82707416-f91c-43d5-aef9-df77a8b7f0e3 Jul 30 16:58:23 devstack sudo[99592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:23 devstack sudo[99592]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-598370af-09ad-490b-abc8-c17b5cb9f3b0 tempest-VolumesTransfersTest-521630690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-82707416-f91c-43d5-aef9-df77a8b7f0e3" returned: 0 in 0.366s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:23 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-598370af-09ad-490b-abc8-c17b5cb9f3b0 tempest-VolumesTransfersTest-521630690 None] Lock "cinder-quobyte-82707416-f91c-43d5-aef9-df77a8b7f0e3" released by "delete_volume" :: held 0.879s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:23 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-598370af-09ad-490b-abc8-c17b5cb9f3b0 tempest-VolumesTransfersTest-521630690 None] Created reservations ['b8a5792d-5806-44e3-b751-6c539064d77f', 'd177a7e4-ed7f-418b-8a1f-3b30dcc136ea', '59c13f8e-84d4-4266-a2e2-eb5000137273', '8231e1f5-3100-4001-987e-36017ea77238'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:58:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-598370af-09ad-490b-abc8-c17b5cb9f3b0 tempest-VolumesTransfersTest-521630690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-598370af-09ad-490b-abc8-c17b5cb9f3b0 tempest-VolumesTransfersTest-521630690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:23 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-598370af-09ad-490b-abc8-c17b5cb9f3b0 tempest-VolumesTransfersTest-521630690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:58:23 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-598370af-09ad-490b-abc8-c17b5cb9f3b0 tempest-VolumesTransfersTest-521630690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:58:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-598370af-09ad-490b-abc8-c17b5cb9f3b0 tempest-VolumesTransfersTest-521630690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-598370af-09ad-490b-abc8-c17b5cb9f3b0 tempest-VolumesTransfersTest-521630690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:23 devstack sudo[99595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:58:23 devstack sudo[99595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:24 devstack sudo[99595]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-598370af-09ad-490b-abc8-c17b5cb9f3b0 tempest-VolumesTransfersTest-521630690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.509s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:24 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-598370af-09ad-490b-abc8-c17b5cb9f3b0 tempest-VolumesTransfersTest-521630690 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:58:24 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-598370af-09ad-490b-abc8-c17b5cb9f3b0 tempest-VolumesTransfersTest-521630690 None] Deleted volume successfully. Jul 30 16:58:24 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-598370af-09ad-490b-abc8-c17b5cb9f3b0 tempest-VolumesTransfersTest-521630690 None] Lock "cinder-82707416-f91c-43d5-aef9-df77a8b7f0e3-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:33 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:SELECT=95,cinder:UPDATE=110,cinder:INSERT=26,cinder:DELETE=9 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:58:34 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:SELECT=88,cinder:UPDATE=113,cinder:DELETE=10,cinder:INSERT=23 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:58:34 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0847018-dbb2-49aa-8a65-4ae934489d15 tempest-VolumesTransfersV355Test-903581380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:58:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c0847018-dbb2-49aa-8a65-4ae934489d15 tempest-VolumesTransfersV355Test-903581380 None] Flow 'volume_create_manager' (1fe907ca-a5d8-432b-89d3-29636959bf6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:58:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c0847018-dbb2-49aa-8a65-4ae934489d15 tempest-VolumesTransfersV355Test-903581380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0641d94-ec73-4b9a-b572-568b8044249f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c0847018-dbb2-49aa-8a65-4ae934489d15 tempest-VolumesTransfersV355Test-903581380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0641d94-ec73-4b9a-b572-568b8044249f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:58:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1104076025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37cbf739-d01e-4143-b242-3319691780aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf29e8b8491c4dbe9c3a4dbe1599855d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:58:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:58:35Z,use_quota=True,user_id='53f879bc8176473fa47c110bafce3174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c0847018-dbb2-49aa-8a65-4ae934489d15 tempest-VolumesTransfersV355Test-903581380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1105575-4c56-41bd-8427-d9d1b8859cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c0847018-dbb2-49aa-8a65-4ae934489d15 tempest-VolumesTransfersV355Test-903581380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1105575-4c56-41bd-8427-d9d1b8859cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c0847018-dbb2-49aa-8a65-4ae934489d15 tempest-VolumesTransfersV355Test-903581380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (072cfb1d-90a1-485c-8916-6f55b526da6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c0847018-dbb2-49aa-8a65-4ae934489d15 tempest-VolumesTransfersV355Test-903581380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (072cfb1d-90a1-485c-8916-6f55b526da6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37cbf739-d01e-4143-b242-3319691780aa', 'volume_name': 'volume-37cbf739-d01e-4143-b242-3319691780aa', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c0847018-dbb2-49aa-8a65-4ae934489d15 tempest-VolumesTransfersV355Test-903581380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9769561e-bd06-4a1e-a72e-33bd78b0b207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c0847018-dbb2-49aa-8a65-4ae934489d15 tempest-VolumesTransfersV355Test-903581380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9769561e-bd06-4a1e-a72e-33bd78b0b207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c0847018-dbb2-49aa-8a65-4ae934489d15 tempest-VolumesTransfersV355Test-903581380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45ee4954-8e5a-4f06-8608-8a263ddafbcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:34 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-c0847018-dbb2-49aa-8a65-4ae934489d15 tempest-VolumesTransfersV355Test-903581380 None] Volume 37cbf739-d01e-4143-b242-3319691780aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37cbf739-d01e-4143-b242-3319691780aa', 'volume_size': 1} Jul 30 16:58:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c0847018-dbb2-49aa-8a65-4ae934489d15 tempest-VolumesTransfersV355Test-903581380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c0847018-dbb2-49aa-8a65-4ae934489d15 tempest-VolumesTransfersV355Test-903581380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:34 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-c0847018-dbb2-49aa-8a65-4ae934489d15 tempest-VolumesTransfersV355Test-903581380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:58:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1104076025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37cbf739-d01e-4143-b242-3319691780aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf29e8b8491c4dbe9c3a4dbe1599855d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:58:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:58:35Z,use_quota=True,user_id='53f879bc8176473fa47c110bafce3174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:58:34 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-c0847018-dbb2-49aa-8a65-4ae934489d15 tempest-VolumesTransfersV355Test-903581380 None] Creating volume 37cbf739-d01e-4143-b242-3319691780aa {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:58:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c0847018-dbb2-49aa-8a65-4ae934489d15 tempest-VolumesTransfersV355Test-903581380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c0847018-dbb2-49aa-8a65-4ae934489d15 tempest-VolumesTransfersV355Test-903581380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:34 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-c0847018-dbb2-49aa-8a65-4ae934489d15 tempest-VolumesTransfersV355Test-903581380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:58:34 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-c0847018-dbb2-49aa-8a65-4ae934489d15 tempest-VolumesTransfersV355Test-903581380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:58:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c0847018-dbb2-49aa-8a65-4ae934489d15 tempest-VolumesTransfersV355Test-903581380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:34 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-c0847018-dbb2-49aa-8a65-4ae934489d15 tempest-VolumesTransfersV355Test-903581380 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:58:34 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-c0847018-dbb2-49aa-8a65-4ae934489d15 tempest-VolumesTransfersV355Test-903581380 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:58:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c0847018-dbb2-49aa-8a65-4ae934489d15 tempest-VolumesTransfersV355Test-903581380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-37cbf739-d01e-4143-b242-3319691780aa 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:34 devstack sudo[99613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-37cbf739-d01e-4143-b242-3319691780aa 1073741824 Jul 30 16:58:34 devstack sudo[99613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:35 devstack sudo[99613]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c0847018-dbb2-49aa-8a65-4ae934489d15 tempest-VolumesTransfersV355Test-903581380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-37cbf739-d01e-4143-b242-3319691780aa 1073741824" returned: 0 in 0.550s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c0847018-dbb2-49aa-8a65-4ae934489d15 tempest-VolumesTransfersV355Test-903581380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-37cbf739-d01e-4143-b242-3319691780aa {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:35 devstack sudo[99619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-37cbf739-d01e-4143-b242-3319691780aa Jul 30 16:58:35 devstack sudo[99619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:35 devstack sudo[99619]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c0847018-dbb2-49aa-8a65-4ae934489d15 tempest-VolumesTransfersV355Test-903581380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-37cbf739-d01e-4143-b242-3319691780aa" returned: 0 in 0.374s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:35 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-c0847018-dbb2-49aa-8a65-4ae934489d15 tempest-VolumesTransfersV355Test-903581380 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:58:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c0847018-dbb2-49aa-8a65-4ae934489d15 tempest-VolumesTransfersV355Test-903581380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c0847018-dbb2-49aa-8a65-4ae934489d15 tempest-VolumesTransfersV355Test-903581380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45ee4954-8e5a-4f06-8608-8a263ddafbcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37cbf739-d01e-4143-b242-3319691780aa', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c0847018-dbb2-49aa-8a65-4ae934489d15 tempest-VolumesTransfersV355Test-903581380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea160299-93e1-488c-b284-641d9e61bc84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:35 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-c0847018-dbb2-49aa-8a65-4ae934489d15 tempest-VolumesTransfersV355Test-903581380 None] Volume volume-37cbf739-d01e-4143-b242-3319691780aa (37cbf739-d01e-4143-b242-3319691780aa): created successfully Jul 30 16:58:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c0847018-dbb2-49aa-8a65-4ae934489d15 tempest-VolumesTransfersV355Test-903581380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea160299-93e1-488c-b284-641d9e61bc84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c0847018-dbb2-49aa-8a65-4ae934489d15 tempest-VolumesTransfersV355Test-903581380 None] Flow 'volume_create_manager' (1fe907ca-a5d8-432b-89d3-29636959bf6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:58:35 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-c0847018-dbb2-49aa-8a65-4ae934489d15 tempest-VolumesTransfersV355Test-903581380 None] Created volume successfully. Jul 30 16:58:37 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ea341da7-ca14-4dee-b363-bb18a9d18f9f tempest-BackendsCapabilitiesAdminTestsJSON-955431394 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6732902526855, 'free_capacity_gb': 1775.6732902526855, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88591) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 30 16:58:37 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a4ad7101-8086-47aa-8c54-57b01ea08523 tempest-BackendsCapabilitiesAdminTestsJSON-955431394 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6732902526855, 'free_capacity_gb': 1775.6732902526855, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88591) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 30 16:58:37 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-973db2b3-cb51-48b1-ae21-17f0cb94cf83 tempest-VolumesTransfersV355Test-788749406 None] Transfer volume completed successfully. Jul 30 16:58:38 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-dd6a7be7-cada-4a98-b44a-048bfa1a74a2 tempest-VolumesTransfersV355Test-807750869 None] Acquiring lock "cinder-37cbf739-d01e-4143-b242-3319691780aa-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:38 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-dd6a7be7-cada-4a98-b44a-048bfa1a74a2 tempest-VolumesTransfersV355Test-807750869 None] Lock "cinder-37cbf739-d01e-4143-b242-3319691780aa-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:38 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-dd6a7be7-cada-4a98-b44a-048bfa1a74a2 tempest-VolumesTransfersV355Test-807750869 None] Acquiring lock "cinder-quobyte-37cbf739-d01e-4143-b242-3319691780aa" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:38 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-dd6a7be7-cada-4a98-b44a-048bfa1a74a2 tempest-VolumesTransfersV355Test-807750869 None] Lock "cinder-quobyte-37cbf739-d01e-4143-b242-3319691780aa" acquired by "delete_volume" :: waited 0.031s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:38 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac221e3f-5a3c-4ba4-a1ac-f54b354f559e]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dd6a7be7-cada-4a98-b44a-048bfa1a74a2 tempest-VolumesTransfersV355Test-807750869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-37cbf739-d01e-4143-b242-3319691780aa {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:38 devstack sudo[99622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-37cbf739-d01e-4143-b242-3319691780aa Jul 30 16:58:38 devstack sudo[99622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:39 devstack sudo[99622]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dd6a7be7-cada-4a98-b44a-048bfa1a74a2 tempest-VolumesTransfersV355Test-807750869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-37cbf739-d01e-4143-b242-3319691780aa" returned: 0 in 0.433s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dd6a7be7-cada-4a98-b44a-048bfa1a74a2 tempest-VolumesTransfersV355Test-807750869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-37cbf739-d01e-4143-b242-3319691780aa {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:39 devstack sudo[99627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-37cbf739-d01e-4143-b242-3319691780aa Jul 30 16:58:39 devstack sudo[99627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:39 devstack sudo[99627]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dd6a7be7-cada-4a98-b44a-048bfa1a74a2 tempest-VolumesTransfersV355Test-807750869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-37cbf739-d01e-4143-b242-3319691780aa" returned: 0 in 0.328s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:39 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-dd6a7be7-cada-4a98-b44a-048bfa1a74a2 tempest-VolumesTransfersV355Test-807750869 None] Lock "cinder-quobyte-37cbf739-d01e-4143-b242-3319691780aa" released by "delete_volume" :: held 0.817s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:39 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-dd6a7be7-cada-4a98-b44a-048bfa1a74a2 tempest-VolumesTransfersV355Test-807750869 None] Created reservations ['e65e1da8-30f4-4e3d-ac6e-28b9acb3ee94', 'df039bea-34ea-4561-8d37-b6a19a33fd04', '57785278-b81b-45c5-844f-e77b766150e5', 'ef1120fa-7c2a-404c-8a2b-53bbcb76b5d8'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:58:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-dd6a7be7-cada-4a98-b44a-048bfa1a74a2 tempest-VolumesTransfersV355Test-807750869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-dd6a7be7-cada-4a98-b44a-048bfa1a74a2 tempest-VolumesTransfersV355Test-807750869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:39 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-dd6a7be7-cada-4a98-b44a-048bfa1a74a2 tempest-VolumesTransfersV355Test-807750869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:58:39 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-dd6a7be7-cada-4a98-b44a-048bfa1a74a2 tempest-VolumesTransfersV355Test-807750869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:58:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-dd6a7be7-cada-4a98-b44a-048bfa1a74a2 tempest-VolumesTransfersV355Test-807750869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dd6a7be7-cada-4a98-b44a-048bfa1a74a2 tempest-VolumesTransfersV355Test-807750869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:39 devstack sudo[99630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:58:39 devstack sudo[99630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:39 devstack sudo[99630]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dd6a7be7-cada-4a98-b44a-048bfa1a74a2 tempest-VolumesTransfersV355Test-807750869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.348s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:39 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-dd6a7be7-cada-4a98-b44a-048bfa1a74a2 tempest-VolumesTransfersV355Test-807750869 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:58:39 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-dd6a7be7-cada-4a98-b44a-048bfa1a74a2 tempest-VolumesTransfersV355Test-807750869 None] Deleted volume successfully. Jul 30 16:58:39 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-dd6a7be7-cada-4a98-b44a-048bfa1a74a2 tempest-VolumesTransfersV355Test-807750869 None] Lock "cinder-37cbf739-d01e-4143-b242-3319691780aa-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:40 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-33a2b4ad-d4fc-4672-b511-1e5383a9c13c tempest-VolumesTransfersV355Test-903581380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:58:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-33a2b4ad-d4fc-4672-b511-1e5383a9c13c tempest-VolumesTransfersV355Test-903581380 None] Flow 'volume_create_manager' (1dcacdfd-a87e-4f63-9d55-aee98b8a5e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:58:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-33a2b4ad-d4fc-4672-b511-1e5383a9c13c tempest-VolumesTransfersV355Test-903581380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (174e0ef5-06f6-4e8b-9cf7-0f6f92f82227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-33a2b4ad-d4fc-4672-b511-1e5383a9c13c tempest-VolumesTransfersV355Test-903581380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (174e0ef5-06f6-4e8b-9cf7-0f6f92f82227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-307968604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e57c0ea-604c-4416-88b1-0315a4e23391,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf29e8b8491c4dbe9c3a4dbe1599855d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:58:40Z,use_quota=True,user_id='53f879bc8176473fa47c110bafce3174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-33a2b4ad-d4fc-4672-b511-1e5383a9c13c tempest-VolumesTransfersV355Test-903581380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fda90713-9996-4631-ab6a-c2fdba72f77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-33a2b4ad-d4fc-4672-b511-1e5383a9c13c tempest-VolumesTransfersV355Test-903581380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fda90713-9996-4631-ab6a-c2fdba72f77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-33a2b4ad-d4fc-4672-b511-1e5383a9c13c tempest-VolumesTransfersV355Test-903581380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eb535f0-97c6-4bcb-a80f-7a9a63561828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-33a2b4ad-d4fc-4672-b511-1e5383a9c13c tempest-VolumesTransfersV355Test-903581380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eb535f0-97c6-4bcb-a80f-7a9a63561828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e57c0ea-604c-4416-88b1-0315a4e23391', 'volume_name': 'volume-9e57c0ea-604c-4416-88b1-0315a4e23391', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-33a2b4ad-d4fc-4672-b511-1e5383a9c13c tempest-VolumesTransfersV355Test-903581380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c4cf02b-e7fc-48cc-a3c0-446151eaf4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-33a2b4ad-d4fc-4672-b511-1e5383a9c13c tempest-VolumesTransfersV355Test-903581380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c4cf02b-e7fc-48cc-a3c0-446151eaf4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-33a2b4ad-d4fc-4672-b511-1e5383a9c13c tempest-VolumesTransfersV355Test-903581380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8f039b1-e699-4be6-ad31-802ed53baaf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:40 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-33a2b4ad-d4fc-4672-b511-1e5383a9c13c tempest-VolumesTransfersV355Test-903581380 None] Volume 9e57c0ea-604c-4416-88b1-0315a4e23391: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e57c0ea-604c-4416-88b1-0315a4e23391', 'volume_size': 1} Jul 30 16:58:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-33a2b4ad-d4fc-4672-b511-1e5383a9c13c tempest-VolumesTransfersV355Test-903581380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-33a2b4ad-d4fc-4672-b511-1e5383a9c13c tempest-VolumesTransfersV355Test-903581380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:40 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-33a2b4ad-d4fc-4672-b511-1e5383a9c13c tempest-VolumesTransfersV355Test-903581380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-307968604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e57c0ea-604c-4416-88b1-0315a4e23391,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf29e8b8491c4dbe9c3a4dbe1599855d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:58:40Z,use_quota=True,user_id='53f879bc8176473fa47c110bafce3174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:58:40 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-33a2b4ad-d4fc-4672-b511-1e5383a9c13c tempest-VolumesTransfersV355Test-903581380 None] Creating volume 9e57c0ea-604c-4416-88b1-0315a4e23391 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:58:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-33a2b4ad-d4fc-4672-b511-1e5383a9c13c tempest-VolumesTransfersV355Test-903581380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-33a2b4ad-d4fc-4672-b511-1e5383a9c13c tempest-VolumesTransfersV355Test-903581380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:40 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-33a2b4ad-d4fc-4672-b511-1e5383a9c13c tempest-VolumesTransfersV355Test-903581380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:58:40 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-33a2b4ad-d4fc-4672-b511-1e5383a9c13c tempest-VolumesTransfersV355Test-903581380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:58:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-33a2b4ad-d4fc-4672-b511-1e5383a9c13c tempest-VolumesTransfersV355Test-903581380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:40 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-33a2b4ad-d4fc-4672-b511-1e5383a9c13c tempest-VolumesTransfersV355Test-903581380 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:58:40 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-33a2b4ad-d4fc-4672-b511-1e5383a9c13c tempest-VolumesTransfersV355Test-903581380 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:58:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-33a2b4ad-d4fc-4672-b511-1e5383a9c13c tempest-VolumesTransfersV355Test-903581380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9e57c0ea-604c-4416-88b1-0315a4e23391 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:40 devstack sudo[99633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9e57c0ea-604c-4416-88b1-0315a4e23391 1073741824 Jul 30 16:58:40 devstack sudo[99633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:41 devstack sudo[99633]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-33a2b4ad-d4fc-4672-b511-1e5383a9c13c tempest-VolumesTransfersV355Test-903581380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9e57c0ea-604c-4416-88b1-0315a4e23391 1073741824" returned: 0 in 0.650s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-33a2b4ad-d4fc-4672-b511-1e5383a9c13c tempest-VolumesTransfersV355Test-903581380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9e57c0ea-604c-4416-88b1-0315a4e23391 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:41 devstack sudo[99640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9e57c0ea-604c-4416-88b1-0315a4e23391 Jul 30 16:58:41 devstack sudo[99640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:41 devstack sudo[99640]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-33a2b4ad-d4fc-4672-b511-1e5383a9c13c tempest-VolumesTransfersV355Test-903581380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9e57c0ea-604c-4416-88b1-0315a4e23391" returned: 0 in 0.331s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:41 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-33a2b4ad-d4fc-4672-b511-1e5383a9c13c tempest-VolumesTransfersV355Test-903581380 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:58:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-33a2b4ad-d4fc-4672-b511-1e5383a9c13c tempest-VolumesTransfersV355Test-903581380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:41 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-33a2b4ad-d4fc-4672-b511-1e5383a9c13c tempest-VolumesTransfersV355Test-903581380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8f039b1-e699-4be6-ad31-802ed53baaf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e57c0ea-604c-4416-88b1-0315a4e23391', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:41 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-33a2b4ad-d4fc-4672-b511-1e5383a9c13c tempest-VolumesTransfersV355Test-903581380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7843cf3-8e64-40ac-992d-82726b13b54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:41 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-33a2b4ad-d4fc-4672-b511-1e5383a9c13c tempest-VolumesTransfersV355Test-903581380 None] Volume volume-9e57c0ea-604c-4416-88b1-0315a4e23391 (9e57c0ea-604c-4416-88b1-0315a4e23391): created successfully Jul 30 16:58:41 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-33a2b4ad-d4fc-4672-b511-1e5383a9c13c tempest-VolumesTransfersV355Test-903581380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7843cf3-8e64-40ac-992d-82726b13b54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:41 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-33a2b4ad-d4fc-4672-b511-1e5383a9c13c tempest-VolumesTransfersV355Test-903581380 None] Flow 'volume_create_manager' (1dcacdfd-a87e-4f63-9d55-aee98b8a5e0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:58:41 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-33a2b4ad-d4fc-4672-b511-1e5383a9c13c tempest-VolumesTransfersV355Test-903581380 None] Created volume successfully. Jul 30 16:58:42 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-2e8d424f-723f-4bef-9db7-7c7a66fa2fdd tempest-VolumesTransfersV355Test-807750869 None] Acquiring lock "cinder-9e57c0ea-604c-4416-88b1-0315a4e23391-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:42 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-2e8d424f-723f-4bef-9db7-7c7a66fa2fdd tempest-VolumesTransfersV355Test-807750869 None] Lock "cinder-9e57c0ea-604c-4416-88b1-0315a4e23391-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:43 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-2e8d424f-723f-4bef-9db7-7c7a66fa2fdd tempest-VolumesTransfersV355Test-807750869 None] Acquiring lock "cinder-quobyte-9e57c0ea-604c-4416-88b1-0315a4e23391" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:43 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-2e8d424f-723f-4bef-9db7-7c7a66fa2fdd tempest-VolumesTransfersV355Test-807750869 None] Lock "cinder-quobyte-9e57c0ea-604c-4416-88b1-0315a4e23391" acquired by "delete_volume" :: waited 0.019s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:43 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf3e04b-c88a-4ec1-b600-9315017a2ca4]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2e8d424f-723f-4bef-9db7-7c7a66fa2fdd tempest-VolumesTransfersV355Test-807750869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9e57c0ea-604c-4416-88b1-0315a4e23391 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:43 devstack sudo[99644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9e57c0ea-604c-4416-88b1-0315a4e23391 Jul 30 16:58:43 devstack sudo[99644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:43 devstack sudo[99644]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2e8d424f-723f-4bef-9db7-7c7a66fa2fdd tempest-VolumesTransfersV355Test-807750869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9e57c0ea-604c-4416-88b1-0315a4e23391" returned: 0 in 0.488s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2e8d424f-723f-4bef-9db7-7c7a66fa2fdd tempest-VolumesTransfersV355Test-807750869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9e57c0ea-604c-4416-88b1-0315a4e23391 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:43 devstack sudo[99649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9e57c0ea-604c-4416-88b1-0315a4e23391 Jul 30 16:58:43 devstack sudo[99649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:43 devstack sudo[99649]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2e8d424f-723f-4bef-9db7-7c7a66fa2fdd tempest-VolumesTransfersV355Test-807750869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9e57c0ea-604c-4416-88b1-0315a4e23391" returned: 0 in 0.287s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:43 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-2e8d424f-723f-4bef-9db7-7c7a66fa2fdd tempest-VolumesTransfersV355Test-807750869 None] Lock "cinder-quobyte-9e57c0ea-604c-4416-88b1-0315a4e23391" released by "delete_volume" :: held 0.838s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:43 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-2e8d424f-723f-4bef-9db7-7c7a66fa2fdd tempest-VolumesTransfersV355Test-807750869 None] Created reservations ['ff47d96b-351b-48de-a39c-60f8b95cdb54', 'c85197dc-b187-4b26-bfba-9eaa286ca462', '7aa4c4ef-1c5b-4ce5-8dbf-eed7154c33d6', '0e2b8af2-25bb-4316-b4c8-d88d82b3d062'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:58:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2e8d424f-723f-4bef-9db7-7c7a66fa2fdd tempest-VolumesTransfersV355Test-807750869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2e8d424f-723f-4bef-9db7-7c7a66fa2fdd tempest-VolumesTransfersV355Test-807750869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:44 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-2e8d424f-723f-4bef-9db7-7c7a66fa2fdd tempest-VolumesTransfersV355Test-807750869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:58:44 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-2e8d424f-723f-4bef-9db7-7c7a66fa2fdd tempest-VolumesTransfersV355Test-807750869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:58:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2e8d424f-723f-4bef-9db7-7c7a66fa2fdd tempest-VolumesTransfersV355Test-807750869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2e8d424f-723f-4bef-9db7-7c7a66fa2fdd tempest-VolumesTransfersV355Test-807750869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:44 devstack sudo[99652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:58:44 devstack sudo[99652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:44 devstack sudo[99652]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2e8d424f-723f-4bef-9db7-7c7a66fa2fdd tempest-VolumesTransfersV355Test-807750869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.491s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:44 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-2e8d424f-723f-4bef-9db7-7c7a66fa2fdd tempest-VolumesTransfersV355Test-807750869 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:58:44 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-2e8d424f-723f-4bef-9db7-7c7a66fa2fdd tempest-VolumesTransfersV355Test-807750869 None] Deleted volume successfully. Jul 30 16:58:44 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-2e8d424f-723f-4bef-9db7-7c7a66fa2fdd tempest-VolumesTransfersV355Test-807750869 None] Lock "cinder-9e57c0ea-604c-4416-88b1-0315a4e23391-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:49 devstack cinder-volume[88591]: INFO cinder.volume.manager [req-e9a15eca-7a5a-4dd0-9401-604e7f23569c req-2f06d667-5145-4bff-9e90-239e30fde2b7 tempest-TestShelveInstance-1545066493 None] Terminate volume connection completed successfully. Jul 30 16:58:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-e9a15eca-7a5a-4dd0-9401-604e7f23569c req-2f06d667-5145-4bff-9e90-239e30fde2b7 tempest-TestShelveInstance-1545066493 None] Deleting attachment 911e90c5-afed-42bd-bfca-ae20473b4ab0. {{(pid=88591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:58:50 devstack cinder-volume[88591]: DEBUG cinder.coordination [req-e9a15eca-7a5a-4dd0-9401-604e7f23569c req-5a534d58-c189-459a-be17-a64aefdc8b99 tempest-TestShelveInstance-1545066493 None] Acquiring lock "cinder-2b3d2393-bff2-40db-9ac4-c5b5e5b9dc96-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:50 devstack cinder-volume[88591]: DEBUG cinder.coordination [req-e9a15eca-7a5a-4dd0-9401-604e7f23569c req-5a534d58-c189-459a-be17-a64aefdc8b99 tempest-TestShelveInstance-1545066493 None] Lock "cinder-2b3d2393-bff2-40db-9ac4-c5b5e5b9dc96-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:50 devstack cinder-volume[88591]: DEBUG cinder.coordination [req-e9a15eca-7a5a-4dd0-9401-604e7f23569c req-5a534d58-c189-459a-be17-a64aefdc8b99 tempest-TestShelveInstance-1545066493 None] Acquiring lock "cinder-quobyte-2b3d2393-bff2-40db-9ac4-c5b5e5b9dc96" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:58:50 devstack cinder-volume[88591]: DEBUG cinder.coordination [req-e9a15eca-7a5a-4dd0-9401-604e7f23569c req-5a534d58-c189-459a-be17-a64aefdc8b99 tempest-TestShelveInstance-1545066493 None] Lock "cinder-quobyte-2b3d2393-bff2-40db-9ac4-c5b5e5b9dc96" acquired by "delete_volume" :: waited 0.030s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:58:50 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d1d5ab-f47c-4ae8-8bf8-33bcec5af8ed]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [req-e9a15eca-7a5a-4dd0-9401-604e7f23569c req-5a534d58-c189-459a-be17-a64aefdc8b99 tempest-TestShelveInstance-1545066493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2b3d2393-bff2-40db-9ac4-c5b5e5b9dc96 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:50 devstack sudo[99731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2b3d2393-bff2-40db-9ac4-c5b5e5b9dc96 Jul 30 16:58:50 devstack sudo[99731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:50 devstack sudo[99731]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [req-e9a15eca-7a5a-4dd0-9401-604e7f23569c req-5a534d58-c189-459a-be17-a64aefdc8b99 tempest-TestShelveInstance-1545066493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2b3d2393-bff2-40db-9ac4-c5b5e5b9dc96" returned: 0 in 0.738s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [req-e9a15eca-7a5a-4dd0-9401-604e7f23569c req-5a534d58-c189-459a-be17-a64aefdc8b99 tempest-TestShelveInstance-1545066493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2b3d2393-bff2-40db-9ac4-c5b5e5b9dc96 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:51 devstack sudo[99736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2b3d2393-bff2-40db-9ac4-c5b5e5b9dc96 Jul 30 16:58:51 devstack sudo[99736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:51 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-5844542f-b1f7-4f5e-ac4c-e2e2af8b8582 tempest-TestInstancesWithCinderVolumes-358578746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:58:51 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5844542f-b1f7-4f5e-ac4c-e2e2af8b8582 tempest-TestInstancesWithCinderVolumes-358578746 None] Flow 'volume_create_manager' (71e2c633-cd5e-4d46-a358-8ad17ad5951e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:58:51 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5844542f-b1f7-4f5e-ac4c-e2e2af8b8582 tempest-TestInstancesWithCinderVolumes-358578746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a3b4373-31f0-4a9a-ba76-120e53893839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:51 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5844542f-b1f7-4f5e-ac4c-e2e2af8b8582 tempest-TestInstancesWithCinderVolumes-358578746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a3b4373-31f0-4a9a-ba76-120e53893839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:58:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-769980061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69637c2a-4072-40b8-b2f4-0eb86371bb28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54c75587db8d4d3f9b903d59b1883bf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:58:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:58:51Z,use_quota=True,user_id='bd8ab2655b7c43779927aa6db42e42bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0912de8f-b006-4699-b73b-b18f8a6e1d42),volume_type_id=0912de8f-b006-4699-b73b-b18f8a6e1d42)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:51 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5844542f-b1f7-4f5e-ac4c-e2e2af8b8582 tempest-TestInstancesWithCinderVolumes-358578746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a726b59-ea13-4aee-bbfd-3e15f4ad4e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:51 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5844542f-b1f7-4f5e-ac4c-e2e2af8b8582 tempest-TestInstancesWithCinderVolumes-358578746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a726b59-ea13-4aee-bbfd-3e15f4ad4e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:51 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5844542f-b1f7-4f5e-ac4c-e2e2af8b8582 tempest-TestInstancesWithCinderVolumes-358578746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0fe16c4-f686-4afb-98d6-7462abbbd4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:51 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5844542f-b1f7-4f5e-ac4c-e2e2af8b8582 tempest-TestInstancesWithCinderVolumes-358578746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0fe16c4-f686-4afb-98d6-7462abbbd4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69637c2a-4072-40b8-b2f4-0eb86371bb28', 'volume_name': 'volume-69637c2a-4072-40b8-b2f4-0eb86371bb28', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:51 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5844542f-b1f7-4f5e-ac4c-e2e2af8b8582 tempest-TestInstancesWithCinderVolumes-358578746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5611c625-7404-445d-af5b-4de2f24eed76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:51 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5844542f-b1f7-4f5e-ac4c-e2e2af8b8582 tempest-TestInstancesWithCinderVolumes-358578746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5611c625-7404-445d-af5b-4de2f24eed76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:51 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5844542f-b1f7-4f5e-ac4c-e2e2af8b8582 tempest-TestInstancesWithCinderVolumes-358578746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f17e3a6-05f9-4d83-bdc2-29773fbdaa8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:51 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-5844542f-b1f7-4f5e-ac4c-e2e2af8b8582 tempest-TestInstancesWithCinderVolumes-358578746 None] Volume 69637c2a-4072-40b8-b2f4-0eb86371bb28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69637c2a-4072-40b8-b2f4-0eb86371bb28', 'volume_size': 1} Jul 30 16:58:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5844542f-b1f7-4f5e-ac4c-e2e2af8b8582 tempest-TestInstancesWithCinderVolumes-358578746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5844542f-b1f7-4f5e-ac4c-e2e2af8b8582 tempest-TestInstancesWithCinderVolumes-358578746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:51 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-5844542f-b1f7-4f5e-ac4c-e2e2af8b8582 tempest-TestInstancesWithCinderVolumes-358578746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:58:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-769980061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69637c2a-4072-40b8-b2f4-0eb86371bb28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54c75587db8d4d3f9b903d59b1883bf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:58:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:58:51Z,use_quota=True,user_id='bd8ab2655b7c43779927aa6db42e42bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0912de8f-b006-4699-b73b-b18f8a6e1d42),volume_type_id=0912de8f-b006-4699-b73b-b18f8a6e1d42)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:58:51 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-5844542f-b1f7-4f5e-ac4c-e2e2af8b8582 tempest-TestInstancesWithCinderVolumes-358578746 None] Creating volume 69637c2a-4072-40b8-b2f4-0eb86371bb28 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:58:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5844542f-b1f7-4f5e-ac4c-e2e2af8b8582 tempest-TestInstancesWithCinderVolumes-358578746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5844542f-b1f7-4f5e-ac4c-e2e2af8b8582 tempest-TestInstancesWithCinderVolumes-358578746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:51 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-5844542f-b1f7-4f5e-ac4c-e2e2af8b8582 tempest-TestInstancesWithCinderVolumes-358578746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:58:51 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-5844542f-b1f7-4f5e-ac4c-e2e2af8b8582 tempest-TestInstancesWithCinderVolumes-358578746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:58:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5844542f-b1f7-4f5e-ac4c-e2e2af8b8582 tempest-TestInstancesWithCinderVolumes-358578746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:51 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-5844542f-b1f7-4f5e-ac4c-e2e2af8b8582 tempest-TestInstancesWithCinderVolumes-358578746 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:58:51 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-5844542f-b1f7-4f5e-ac4c-e2e2af8b8582 tempest-TestInstancesWithCinderVolumes-358578746 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:58:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5844542f-b1f7-4f5e-ac4c-e2e2af8b8582 tempest-TestInstancesWithCinderVolumes-358578746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-69637c2a-4072-40b8-b2f4-0eb86371bb28 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:51 devstack sudo[99738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-69637c2a-4072-40b8-b2f4-0eb86371bb28 1073741824 Jul 30 16:58:51 devstack sudo[99738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:51 devstack sudo[99736]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [req-e9a15eca-7a5a-4dd0-9401-604e7f23569c req-5a534d58-c189-459a-be17-a64aefdc8b99 tempest-TestShelveInstance-1545066493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2b3d2393-bff2-40db-9ac4-c5b5e5b9dc96" returned: 0 in 0.516s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:51 devstack cinder-volume[88591]: DEBUG cinder.coordination [req-e9a15eca-7a5a-4dd0-9401-604e7f23569c req-5a534d58-c189-459a-be17-a64aefdc8b99 tempest-TestShelveInstance-1545066493 None] Lock "cinder-quobyte-2b3d2393-bff2-40db-9ac4-c5b5e5b9dc96" released by "delete_volume" :: held 1.322s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:51 devstack cinder-volume[88591]: DEBUG cinder.quota [req-e9a15eca-7a5a-4dd0-9401-604e7f23569c req-5a534d58-c189-459a-be17-a64aefdc8b99 tempest-TestShelveInstance-1545066493 None] Created reservations ['baabd169-883a-4c4f-aa86-5e5233e6dd3d', 'c79e4782-96b2-4e9e-bf36-c048c75e7f98', '5edd0c8b-94ef-45ee-9155-9344a796f021', '12ef434d-7612-4c5e-9856-1dec5e2173fb'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:58:51 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-48d4e188-0e1d-45a9-8f92-7428bd01d2ae tempest-TestInstancesWithCinderVolumes-358578746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:58:51 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-48d4e188-0e1d-45a9-8f92-7428bd01d2ae tempest-TestInstancesWithCinderVolumes-358578746 None] Flow 'volume_create_manager' (0f3da15f-bf96-4dd2-8008-0cb8d8f887f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:58:51 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-48d4e188-0e1d-45a9-8f92-7428bd01d2ae tempest-TestInstancesWithCinderVolumes-358578746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d863d6ae-94c4-4a54-ba5c-3281b88497c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-e9a15eca-7a5a-4dd0-9401-604e7f23569c req-5a534d58-c189-459a-be17-a64aefdc8b99 tempest-TestShelveInstance-1545066493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-e9a15eca-7a5a-4dd0-9401-604e7f23569c req-5a534d58-c189-459a-be17-a64aefdc8b99 tempest-TestShelveInstance-1545066493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:51 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [req-e9a15eca-7a5a-4dd0-9401-604e7f23569c req-5a534d58-c189-459a-be17-a64aefdc8b99 tempest-TestShelveInstance-1545066493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:58:52 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [req-e9a15eca-7a5a-4dd0-9401-604e7f23569c req-5a534d58-c189-459a-be17-a64aefdc8b99 tempest-TestShelveInstance-1545066493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:58:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-e9a15eca-7a5a-4dd0-9401-604e7f23569c req-5a534d58-c189-459a-be17-a64aefdc8b99 tempest-TestShelveInstance-1545066493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [req-e9a15eca-7a5a-4dd0-9401-604e7f23569c req-5a534d58-c189-459a-be17-a64aefdc8b99 tempest-TestShelveInstance-1545066493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:52 devstack sudo[99746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:58:52 devstack sudo[99746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-48d4e188-0e1d-45a9-8f92-7428bd01d2ae tempest-TestInstancesWithCinderVolumes-358578746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d863d6ae-94c4-4a54-ba5c-3281b88497c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:58:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-481905028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14efd33c-0eef-4e29-8d37-ebb314a03f58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54c75587db8d4d3f9b903d59b1883bf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:58:52Z,use_quota=True,user_id='bd8ab2655b7c43779927aa6db42e42bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9eb47674-d957-45da-9c68-21430c0b4e84),volume_type_id=9eb47674-d957-45da-9c68-21430c0b4e84)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-48d4e188-0e1d-45a9-8f92-7428bd01d2ae tempest-TestInstancesWithCinderVolumes-358578746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a946161-bd82-49fb-8adb-39ad7502caaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-48d4e188-0e1d-45a9-8f92-7428bd01d2ae tempest-TestInstancesWithCinderVolumes-358578746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a946161-bd82-49fb-8adb-39ad7502caaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-48d4e188-0e1d-45a9-8f92-7428bd01d2ae tempest-TestInstancesWithCinderVolumes-358578746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2d6ac1c-6e11-418a-9dbd-2ec3df3c4f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-48d4e188-0e1d-45a9-8f92-7428bd01d2ae tempest-TestInstancesWithCinderVolumes-358578746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2d6ac1c-6e11-418a-9dbd-2ec3df3c4f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14efd33c-0eef-4e29-8d37-ebb314a03f58', 'volume_name': 'volume-14efd33c-0eef-4e29-8d37-ebb314a03f58', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-48d4e188-0e1d-45a9-8f92-7428bd01d2ae tempest-TestInstancesWithCinderVolumes-358578746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fc0baab-08e4-4fe7-89fa-76890907ea57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-48d4e188-0e1d-45a9-8f92-7428bd01d2ae tempest-TestInstancesWithCinderVolumes-358578746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fc0baab-08e4-4fe7-89fa-76890907ea57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-48d4e188-0e1d-45a9-8f92-7428bd01d2ae tempest-TestInstancesWithCinderVolumes-358578746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (461d5a33-0779-42aa-afcd-4c981933fb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:52 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-48d4e188-0e1d-45a9-8f92-7428bd01d2ae tempest-TestInstancesWithCinderVolumes-358578746 None] Volume 14efd33c-0eef-4e29-8d37-ebb314a03f58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14efd33c-0eef-4e29-8d37-ebb314a03f58', 'volume_size': 1} Jul 30 16:58:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-48d4e188-0e1d-45a9-8f92-7428bd01d2ae tempest-TestInstancesWithCinderVolumes-358578746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:52 devstack sudo[99738]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5844542f-b1f7-4f5e-ac4c-e2e2af8b8582 tempest-TestInstancesWithCinderVolumes-358578746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-69637c2a-4072-40b8-b2f4-0eb86371bb28 1073741824" returned: 0 in 0.968s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5844542f-b1f7-4f5e-ac4c-e2e2af8b8582 tempest-TestInstancesWithCinderVolumes-358578746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-69637c2a-4072-40b8-b2f4-0eb86371bb28 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:52 devstack sudo[99748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-69637c2a-4072-40b8-b2f4-0eb86371bb28 Jul 30 16:58:52 devstack sudo[99748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:52 devstack sudo[99746]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [req-e9a15eca-7a5a-4dd0-9401-604e7f23569c req-5a534d58-c189-459a-be17-a64aefdc8b99 tempest-TestShelveInstance-1545066493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.409s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:52 devstack cinder-volume[88591]: DEBUG cinder.manager [req-e9a15eca-7a5a-4dd0-9401-604e7f23569c req-5a534d58-c189-459a-be17-a64aefdc8b99 tempest-TestShelveInstance-1545066493 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:58:52 devstack cinder-volume[88591]: INFO cinder.volume.manager [req-e9a15eca-7a5a-4dd0-9401-604e7f23569c req-5a534d58-c189-459a-be17-a64aefdc8b99 tempest-TestShelveInstance-1545066493 None] Deleted volume successfully. Jul 30 16:58:52 devstack cinder-volume[88591]: DEBUG cinder.coordination [req-e9a15eca-7a5a-4dd0-9401-604e7f23569c req-5a534d58-c189-459a-be17-a64aefdc8b99 tempest-TestShelveInstance-1545066493 None] Lock "cinder-2b3d2393-bff2-40db-9ac4-c5b5e5b9dc96-delete_volume" released by "delete_volume" :: held 2.393s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:58:52 devstack sudo[99748]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5844542f-b1f7-4f5e-ac4c-e2e2af8b8582 tempest-TestInstancesWithCinderVolumes-358578746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-69637c2a-4072-40b8-b2f4-0eb86371bb28" returned: 0 in 0.335s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:52 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-5844542f-b1f7-4f5e-ac4c-e2e2af8b8582 tempest-TestInstancesWithCinderVolumes-358578746 None] <== create_volume: return (1382ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:58:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5844542f-b1f7-4f5e-ac4c-e2e2af8b8582 tempest-TestInstancesWithCinderVolumes-358578746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.384s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-48d4e188-0e1d-45a9-8f92-7428bd01d2ae tempest-TestInstancesWithCinderVolumes-358578746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.439s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:52 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-48d4e188-0e1d-45a9-8f92-7428bd01d2ae tempest-TestInstancesWithCinderVolumes-358578746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:58:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-481905028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14efd33c-0eef-4e29-8d37-ebb314a03f58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54c75587db8d4d3f9b903d59b1883bf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:58:52Z,use_quota=True,user_id='bd8ab2655b7c43779927aa6db42e42bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9eb47674-d957-45da-9c68-21430c0b4e84),volume_type_id=9eb47674-d957-45da-9c68-21430c0b4e84)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:58:52 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-48d4e188-0e1d-45a9-8f92-7428bd01d2ae tempest-TestInstancesWithCinderVolumes-358578746 None] Creating volume 14efd33c-0eef-4e29-8d37-ebb314a03f58 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:58:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-48d4e188-0e1d-45a9-8f92-7428bd01d2ae tempest-TestInstancesWithCinderVolumes-358578746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:58:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-48d4e188-0e1d-45a9-8f92-7428bd01d2ae tempest-TestInstancesWithCinderVolumes-358578746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:58:52 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-48d4e188-0e1d-45a9-8f92-7428bd01d2ae tempest-TestInstancesWithCinderVolumes-358578746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:58:52 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-48d4e188-0e1d-45a9-8f92-7428bd01d2ae tempest-TestInstancesWithCinderVolumes-358578746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:58:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-48d4e188-0e1d-45a9-8f92-7428bd01d2ae tempest-TestInstancesWithCinderVolumes-358578746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:52 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-48d4e188-0e1d-45a9-8f92-7428bd01d2ae tempest-TestInstancesWithCinderVolumes-358578746 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:58:52 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-48d4e188-0e1d-45a9-8f92-7428bd01d2ae tempest-TestInstancesWithCinderVolumes-358578746 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:58:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-48d4e188-0e1d-45a9-8f92-7428bd01d2ae tempest-TestInstancesWithCinderVolumes-358578746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-14efd33c-0eef-4e29-8d37-ebb314a03f58 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:52 devstack sudo[99752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-14efd33c-0eef-4e29-8d37-ebb314a03f58 1073741824 Jul 30 16:58:52 devstack sudo[99752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5844542f-b1f7-4f5e-ac4c-e2e2af8b8582 tempest-TestInstancesWithCinderVolumes-358578746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f17e3a6-05f9-4d83-bdc2-29773fbdaa8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69637c2a-4072-40b8-b2f4-0eb86371bb28', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5844542f-b1f7-4f5e-ac4c-e2e2af8b8582 tempest-TestInstancesWithCinderVolumes-358578746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9cd78af-e7c0-4225-a92f-8abafe1bef04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:52 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-5844542f-b1f7-4f5e-ac4c-e2e2af8b8582 tempest-TestInstancesWithCinderVolumes-358578746 None] Volume volume-69637c2a-4072-40b8-b2f4-0eb86371bb28 (69637c2a-4072-40b8-b2f4-0eb86371bb28): created successfully Jul 30 16:58:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5844542f-b1f7-4f5e-ac4c-e2e2af8b8582 tempest-TestInstancesWithCinderVolumes-358578746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9cd78af-e7c0-4225-a92f-8abafe1bef04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5844542f-b1f7-4f5e-ac4c-e2e2af8b8582 tempest-TestInstancesWithCinderVolumes-358578746 None] Flow 'volume_create_manager' (71e2c633-cd5e-4d46-a358-8ad17ad5951e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:58:52 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-5844542f-b1f7-4f5e-ac4c-e2e2af8b8582 tempest-TestInstancesWithCinderVolumes-358578746 None] Created volume successfully. Jul 30 16:58:53 devstack sudo[99752]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-48d4e188-0e1d-45a9-8f92-7428bd01d2ae tempest-TestInstancesWithCinderVolumes-358578746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-14efd33c-0eef-4e29-8d37-ebb314a03f58 1073741824" returned: 0 in 0.725s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-48d4e188-0e1d-45a9-8f92-7428bd01d2ae tempest-TestInstancesWithCinderVolumes-358578746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-14efd33c-0eef-4e29-8d37-ebb314a03f58 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:53 devstack sudo[99757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-14efd33c-0eef-4e29-8d37-ebb314a03f58 Jul 30 16:58:53 devstack sudo[99757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:53 devstack sudo[99757]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-48d4e188-0e1d-45a9-8f92-7428bd01d2ae tempest-TestInstancesWithCinderVolumes-358578746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-14efd33c-0eef-4e29-8d37-ebb314a03f58" returned: 0 in 0.354s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:53 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-48d4e188-0e1d-45a9-8f92-7428bd01d2ae tempest-TestInstancesWithCinderVolumes-358578746 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:58:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-48d4e188-0e1d-45a9-8f92-7428bd01d2ae tempest-TestInstancesWithCinderVolumes-358578746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:58:53 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-48d4e188-0e1d-45a9-8f92-7428bd01d2ae tempest-TestInstancesWithCinderVolumes-358578746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (461d5a33-0779-42aa-afcd-4c981933fb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14efd33c-0eef-4e29-8d37-ebb314a03f58', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:53 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-48d4e188-0e1d-45a9-8f92-7428bd01d2ae tempest-TestInstancesWithCinderVolumes-358578746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8e0a44c-efbc-48be-a1f0-e0aab116b433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:53 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-48d4e188-0e1d-45a9-8f92-7428bd01d2ae tempest-TestInstancesWithCinderVolumes-358578746 None] Volume volume-14efd33c-0eef-4e29-8d37-ebb314a03f58 (14efd33c-0eef-4e29-8d37-ebb314a03f58): created successfully Jul 30 16:58:53 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-48d4e188-0e1d-45a9-8f92-7428bd01d2ae tempest-TestInstancesWithCinderVolumes-358578746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8e0a44c-efbc-48be-a1f0-e0aab116b433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:53 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-48d4e188-0e1d-45a9-8f92-7428bd01d2ae tempest-TestInstancesWithCinderVolumes-358578746 None] Flow 'volume_create_manager' (0f3da15f-bf96-4dd2-8008-0cb8d8f887f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:58:53 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-48d4e188-0e1d-45a9-8f92-7428bd01d2ae tempest-TestInstancesWithCinderVolumes-358578746 None] Created volume successfully. Jul 30 16:58:53 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:58:53 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] Flow 'volume_create_manager' (ca3d2d27-43d8-4db9-a3a4-948fa80831e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:58:53 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c580ccf6-4b38-4a27-b73a-3ddef46e5c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:54 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c580ccf6-4b38-4a27-b73a-3ddef46e5c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:58:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-595599044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2627b4e3-5b32-4ec8-a5d9-8c403228c543,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54c75587db8d4d3f9b903d59b1883bf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:58:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:58:54Z,use_quota=True,user_id='bd8ab2655b7c43779927aa6db42e42bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d65093a-01b6-4c62-ac55-085168f03ef0),volume_type_id=1d65093a-01b6-4c62-ac55-085168f03ef0)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:54 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4194314c-d092-451c-9c02-a0bfe942e68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:54 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4194314c-d092-451c-9c02-a0bfe942e68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:54 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0724297d-0593-4e0a-8150-499cd6f1103c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:54 devstack cinder-volume[88591]: DEBUG cinder.image.glance [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] Creating Keystone auth plugin from conf {{(pid=88591) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 30 16:58:54 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0724297d-0593-4e0a-8150-499cd6f1103c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2627b4e3-5b32-4ec8-a5d9-8c403228c543', 'volume_name': 'volume-2627b4e3-5b32-4ec8-a5d9-8c403228c543', 'volume_size': 1, 'image_id': 'bdbb3932-ed65-427e-a60a-b1474247fb70', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bdbb3932-ed65-427e-a60a-b1474247fb70', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--532690483', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '54c75587db8d4d3f9b903d59b1883bf8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bdbb3932-ed65-427e-a60a-b1474247fb70', 'created_at': datetime.datetime(2026, 7, 30, 14, 58, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 58, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bdbb3932-ed65-427e-a60a-b1474247fb70/file', 'properties': {}}, 'image_service': }' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:54 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d5d6aa4-fe59-4b3a-9fe8-b997f2a61c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:54 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d5d6aa4-fe59-4b3a-9fe8-b997f2a61c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:58:54 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8967e4b4-5930-492e-a583-87171402b631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:58:54 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] Volume 2627b4e3-5b32-4ec8-a5d9-8c403228c543: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2627b4e3-5b32-4ec8-a5d9-8c403228c543', 'volume_size': 1, 'image_id': 'bdbb3932-ed65-427e-a60a-b1474247fb70', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bdbb3932-ed65-427e-a60a-b1474247fb70', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--532690483', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '54c75587db8d4d3f9b903d59b1883bf8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bdbb3932-ed65-427e-a60a-b1474247fb70', 'created_at': datetime.datetime(2026, 7, 30, 14, 58, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 58, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bdbb3932-ed65-427e-a60a-b1474247fb70/file', 'properties': {}}, 'image_service': } Jul 30 16:58:54 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] Trying to clone 2627b4e3-5b32-4ec8-a5d9-8c403228c543 from image bdbb3932-ed65-427e-a60a-b1474247fb70 at location (None, [{'url': 'file:///opt/stack/data/glance/images/bdbb3932-ed65-427e-a60a-b1474247fb70', 'metadata': {}}]). {{(pid=88591) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 30 16:58:59 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bdbb3932-ed65-427e-a60a-b1474247fb70_j75mf1rgdevstack@QuobyteHD, size 20.69 MB, duration 4.55 sec {{(pid=88591) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 30 16:58:59 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] Image download 20.69 MB at 4.55 MB/s Jul 30 16:58:59 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a867f73c-42cf-44e6-8971-c4c315857de8]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbb3932-ed65-427e-a60a-b1474247fb70_j75mf1rgdevstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:59 devstack sudo[99761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbb3932-ed65-427e-a60a-b1474247fb70_j75mf1rgdevstack@QuobyteHD Jul 30 16:58:59 devstack sudo[99761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:58:59 devstack sudo[99761]: pam_unix(sudo:session): session closed for user root Jul 30 16:58:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbb3932-ed65-427e-a60a-b1474247fb70_j75mf1rgdevstack@QuobyteHD" returned: 0 in 0.426s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:58:59 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] Temporary image bdbb3932-ed65-427e-a60a-b1474247fb70 is fetched for user bd8ab2655b7c43779927aa6db42e42bd. {{(pid=88591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 30 16:58:59 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3807f2e-10d8-4d13-b9b2-8fe4919069b5]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:58:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbb3932-ed65-427e-a60a-b1474247fb70_j75mf1rgdevstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:58:59 devstack sudo[99767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbb3932-ed65-427e-a60a-b1474247fb70_j75mf1rgdevstack@QuobyteHD Jul 30 16:58:59 devstack sudo[99767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:00 devstack sudo[99767]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbb3932-ed65-427e-a60a-b1474247fb70_j75mf1rgdevstack@QuobyteHD" returned: 0 in 0.404s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:00 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:58:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-595599044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2627b4e3-5b32-4ec8-a5d9-8c403228c543,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54c75587db8d4d3f9b903d59b1883bf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:58:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:58:54Z,use_quota=True,user_id='bd8ab2655b7c43779927aa6db42e42bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d65093a-01b6-4c62-ac55-085168f03ef0),volume_type_id=1d65093a-01b6-4c62-ac55-085168f03ef0)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:59:00 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] Creating volume 2627b4e3-5b32-4ec8-a5d9-8c403228c543 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:59:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:00 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:59:00 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:59:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:00 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:59:00 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:59:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2627b4e3-5b32-4ec8-a5d9-8c403228c543 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:00 devstack sudo[99772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2627b4e3-5b32-4ec8-a5d9-8c403228c543 1073741824 Jul 30 16:59:00 devstack sudo[99772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:00 devstack sudo[99772]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2627b4e3-5b32-4ec8-a5d9-8c403228c543 1073741824" returned: 0 in 0.530s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2627b4e3-5b32-4ec8-a5d9-8c403228c543 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:00 devstack sudo[99777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2627b4e3-5b32-4ec8-a5d9-8c403228c543 Jul 30 16:59:00 devstack sudo[99777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:01 devstack sudo[99777]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2627b4e3-5b32-4ec8-a5d9-8c403228c543" returned: 0 in 0.272s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:01 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:59:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:01 devstack cinder-volume[88591]: DEBUG cinder.volume.volume_utils [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] Attempting download of bdbb3932-ed65-427e-a60a-b1474247fb70 ((None, [{'url': 'file:///opt/stack/data/glance/images/bdbb3932-ed65-427e-a60a-b1474247fb70', 'metadata': {}}])) to volume 2627b4e3-5b32-4ec8-a5d9-8c403228c543. {{(pid=88591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 30 16:59:01 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[230e828f-bced-49c0-9c5d-d1c1d61b7c37]: (4, 'raw') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:59:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bdbb3932-ed65-427e-a60a-b1474247fb70_zp0e5nar {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:01 devstack sudo[99780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bdbb3932-ed65-427e-a60a-b1474247fb70_zp0e5nar Jul 30 16:59:01 devstack sudo[99780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:01 devstack sudo[99780]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bdbb3932-ed65-427e-a60a-b1474247fb70_zp0e5nar" returned: 0 in 0.471s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bdbb3932-ed65-427e-a60a-b1474247fb70_zp0e5nar {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:01 devstack sudo[99784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bdbb3932-ed65-427e-a60a-b1474247fb70_zp0e5nar Jul 30 16:59:01 devstack sudo[99784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:02 devstack sudo[99784]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bdbb3932-ed65-427e-a60a-b1474247fb70_zp0e5nar" returned: 1 in 0.471s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bdbb3932-ed65-427e-a60a-b1474247fb70_zp0e5nar' failed. Not Retrying. {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 16:59:02 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f0695c-8784-41a9-80ba-a42626e805f4]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:59:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbb3932-ed65-427e-a60a-b1474247fb70_j75mf1rgdevstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:02 devstack sudo[99790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbb3932-ed65-427e-a60a-b1474247fb70_j75mf1rgdevstack@QuobyteHD Jul 30 16:59:02 devstack sudo[99790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:02 devstack sudo[99790]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bdbb3932-ed65-427e-a60a-b1474247fb70_j75mf1rgdevstack@QuobyteHD" returned: 0 in 0.533s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:02 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] bdbb3932-ed65-427e-a60a-b1474247fb70 was qcow2, converting to qcow2 {{(pid=88591) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 30 16:59:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bdbb3932-ed65-427e-a60a-b1474247fb70_j75mf1rgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2627b4e3-5b32-4ec8-a5d9-8c403228c543 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:02 devstack sudo[99796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bdbb3932-ed65-427e-a60a-b1474247fb70_j75mf1rgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2627b4e3-5b32-4ec8-a5d9-8c403228c543 Jul 30 16:59:02 devstack sudo[99796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:05 devstack sudo[99796]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bdbb3932-ed65-427e-a60a-b1474247fb70_j75mf1rgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2627b4e3-5b32-4ec8-a5d9-8c403228c543" returned: 0 in 2.571s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:05 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bdbb3932-ed65-427e-a60a-b1474247fb70_j75mf1rgdevstack@QuobyteHD, size 112.00 MB, duration 2.57 sec, destination /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2627b4e3-5b32-4ec8-a5d9-8c403228c543 {{(pid=88591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:59:05 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] Converted 112.00 MB image at 43.54 MB/s Jul 30 16:59:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2627b4e3-5b32-4ec8-a5d9-8c403228c543 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:05 devstack sudo[99804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2627b4e3-5b32-4ec8-a5d9-8c403228c543 1G Jul 30 16:59:05 devstack sudo[99804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:05 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-91a3c7fa-1d9d-4135-bbdd-70fd0cba6942 tempest-VolumesListAdminTestJSON-1298618000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:59:05 devstack sudo[99804]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:05 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-91a3c7fa-1d9d-4135-bbdd-70fd0cba6942 tempest-VolumesListAdminTestJSON-1298618000 None] Flow 'volume_create_manager' (e83e4568-521b-4326-ab8b-11624e67681a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:59:05 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-91a3c7fa-1d9d-4135-bbdd-70fd0cba6942 tempest-VolumesListAdminTestJSON-1298618000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b94a8a7-1efb-4b9b-a31a-e759c0b28d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2627b4e3-5b32-4ec8-a5d9-8c403228c543 1G" returned: 0 in 0.425s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:05 devstack cinder-volume[88591]: DEBUG cinder.volume.volume_utils [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] Downloaded image bdbb3932-ed65-427e-a60a-b1474247fb70 ((None, [{'url': 'file:///opt/stack/data/glance/images/bdbb3932-ed65-427e-a60a-b1474247fb70', 'metadata': {}}])) to volume 2627b4e3-5b32-4ec8-a5d9-8c403228c543 successfully. {{(pid=88591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 30 16:59:05 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] Temporary image bdbb3932-ed65-427e-a60a-b1474247fb70 for user bd8ab2655b7c43779927aa6db42e42bd is deleted. {{(pid=88591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 30 16:59:05 devstack cinder-volume[88591]: DEBUG cinder.volume.volume_utils [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] Marking volume 2627b4e3-5b32-4ec8-a5d9-8c403228c543 as bootable. {{(pid=88591) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 30 16:59:05 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-91a3c7fa-1d9d-4135-bbdd-70fd0cba6942 tempest-VolumesListAdminTestJSON-1298618000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b94a8a7-1efb-4b9b-a31a-e759c0b28d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:59:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-44337240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb699bbd-958c-4ac6-9569-13f1dba39ac3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c84f11076c1d45a88829e5aaf854e32f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:59:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:59:06Z,use_quota=True,user_id='8236fce28fb640fea6b32d6608077805',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:05 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-91a3c7fa-1d9d-4135-bbdd-70fd0cba6942 tempest-VolumesListAdminTestJSON-1298618000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec9ebe94-87c3-429d-81d2-6b1968c6fba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:05 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-91a3c7fa-1d9d-4135-bbdd-70fd0cba6942 tempest-VolumesListAdminTestJSON-1298618000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec9ebe94-87c3-429d-81d2-6b1968c6fba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:05 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-91a3c7fa-1d9d-4135-bbdd-70fd0cba6942 tempest-VolumesListAdminTestJSON-1298618000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66a028f3-a07a-4c31-83dc-ab91a4fcf51f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:05 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-91a3c7fa-1d9d-4135-bbdd-70fd0cba6942 tempest-VolumesListAdminTestJSON-1298618000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66a028f3-a07a-4c31-83dc-ab91a4fcf51f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb699bbd-958c-4ac6-9569-13f1dba39ac3', 'volume_name': 'volume-bb699bbd-958c-4ac6-9569-13f1dba39ac3', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:05 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-91a3c7fa-1d9d-4135-bbdd-70fd0cba6942 tempest-VolumesListAdminTestJSON-1298618000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ff539d1-ffde-4dfa-8032-913774108733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:05 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-91a3c7fa-1d9d-4135-bbdd-70fd0cba6942 tempest-VolumesListAdminTestJSON-1298618000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ff539d1-ffde-4dfa-8032-913774108733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:05 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-91a3c7fa-1d9d-4135-bbdd-70fd0cba6942 tempest-VolumesListAdminTestJSON-1298618000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (800e0ea3-cbe0-401a-b7a2-0d0d56f4324c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:05 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-91a3c7fa-1d9d-4135-bbdd-70fd0cba6942 tempest-VolumesListAdminTestJSON-1298618000 None] Volume bb699bbd-958c-4ac6-9569-13f1dba39ac3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb699bbd-958c-4ac6-9569-13f1dba39ac3', 'volume_size': 1} Jul 30 16:59:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-91a3c7fa-1d9d-4135-bbdd-70fd0cba6942 tempest-VolumesListAdminTestJSON-1298618000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-91a3c7fa-1d9d-4135-bbdd-70fd0cba6942 tempest-VolumesListAdminTestJSON-1298618000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:05 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-91a3c7fa-1d9d-4135-bbdd-70fd0cba6942 tempest-VolumesListAdminTestJSON-1298618000 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:59:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-44337240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb699bbd-958c-4ac6-9569-13f1dba39ac3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c84f11076c1d45a88829e5aaf854e32f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:59:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:59:06Z,use_quota=True,user_id='8236fce28fb640fea6b32d6608077805',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:59:05 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-91a3c7fa-1d9d-4135-bbdd-70fd0cba6942 tempest-VolumesListAdminTestJSON-1298618000 None] Creating volume bb699bbd-958c-4ac6-9569-13f1dba39ac3 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:59:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-91a3c7fa-1d9d-4135-bbdd-70fd0cba6942 tempest-VolumesListAdminTestJSON-1298618000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-91a3c7fa-1d9d-4135-bbdd-70fd0cba6942 tempest-VolumesListAdminTestJSON-1298618000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:05 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-91a3c7fa-1d9d-4135-bbdd-70fd0cba6942 tempest-VolumesListAdminTestJSON-1298618000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:59:05 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-91a3c7fa-1d9d-4135-bbdd-70fd0cba6942 tempest-VolumesListAdminTestJSON-1298618000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:59:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-91a3c7fa-1d9d-4135-bbdd-70fd0cba6942 tempest-VolumesListAdminTestJSON-1298618000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:05 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-91a3c7fa-1d9d-4135-bbdd-70fd0cba6942 tempest-VolumesListAdminTestJSON-1298618000 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:59:05 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-91a3c7fa-1d9d-4135-bbdd-70fd0cba6942 tempest-VolumesListAdminTestJSON-1298618000 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:59:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-91a3c7fa-1d9d-4135-bbdd-70fd0cba6942 tempest-VolumesListAdminTestJSON-1298618000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bb699bbd-958c-4ac6-9569-13f1dba39ac3 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:05 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] Copying metadata from image bdbb3932-ed65-427e-a60a-b1474247fb70 to 2627b4e3-5b32-4ec8-a5d9-8c403228c543. {{(pid=88591) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 30 16:59:05 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] Creating volume glance metadata for volume 2627b4e3-5b32-4ec8-a5d9-8c403228c543 backed by image bdbb3932-ed65-427e-a60a-b1474247fb70 with: {'image_id': 'bdbb3932-ed65-427e-a60a-b1474247fb70', 'image_name': 'tempest-scenario-img--532690483', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88591) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 30 16:59:05 devstack sudo[99811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bb699bbd-958c-4ac6-9569-13f1dba39ac3 1073741824 Jul 30 16:59:05 devstack sudo[99811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:05 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8967e4b4-5930-492e-a583-87171402b631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2627b4e3-5b32-4ec8-a5d9-8c403228c543', 'volume_size': 1, 'image_id': 'bdbb3932-ed65-427e-a60a-b1474247fb70', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bdbb3932-ed65-427e-a60a-b1474247fb70', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--532690483', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '54c75587db8d4d3f9b903d59b1883bf8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bdbb3932-ed65-427e-a60a-b1474247fb70', 'created_at': datetime.datetime(2026, 7, 30, 14, 58, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 58, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bdbb3932-ed65-427e-a60a-b1474247fb70/file', 'properties': {}}, 'image_service': }' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:05 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9e68d7c-1ef2-4787-ba1b-6932e8e80091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:05 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] Volume volume-2627b4e3-5b32-4ec8-a5d9-8c403228c543 (2627b4e3-5b32-4ec8-a5d9-8c403228c543): created successfully Jul 30 16:59:05 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9e68d7c-1ef2-4787-ba1b-6932e8e80091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:05 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] Flow 'volume_create_manager' (ca3d2d27-43d8-4db9-a3a4-948fa80831e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:59:05 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-af9e1175-4906-4e2c-a8e7-573c3ed293c0 tempest-TestInstancesWithCinderVolumes-358578746 None] Created volume successfully. Jul 30 16:59:06 devstack sudo[99811]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-91a3c7fa-1d9d-4135-bbdd-70fd0cba6942 tempest-VolumesListAdminTestJSON-1298618000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bb699bbd-958c-4ac6-9569-13f1dba39ac3 1073741824" returned: 0 in 0.575s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-91a3c7fa-1d9d-4135-bbdd-70fd0cba6942 tempest-VolumesListAdminTestJSON-1298618000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bb699bbd-958c-4ac6-9569-13f1dba39ac3 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:06 devstack sudo[99816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bb699bbd-958c-4ac6-9569-13f1dba39ac3 Jul 30 16:59:06 devstack sudo[99816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:06 devstack sudo[99816]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-91a3c7fa-1d9d-4135-bbdd-70fd0cba6942 tempest-VolumesListAdminTestJSON-1298618000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bb699bbd-958c-4ac6-9569-13f1dba39ac3" returned: 0 in 0.470s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:06 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-91a3c7fa-1d9d-4135-bbdd-70fd0cba6942 tempest-VolumesListAdminTestJSON-1298618000 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:59:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-91a3c7fa-1d9d-4135-bbdd-70fd0cba6942 tempest-VolumesListAdminTestJSON-1298618000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:06 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-91a3c7fa-1d9d-4135-bbdd-70fd0cba6942 tempest-VolumesListAdminTestJSON-1298618000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (800e0ea3-cbe0-401a-b7a2-0d0d56f4324c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb699bbd-958c-4ac6-9569-13f1dba39ac3', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:06 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-91a3c7fa-1d9d-4135-bbdd-70fd0cba6942 tempest-VolumesListAdminTestJSON-1298618000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f70ab072-2d23-4139-8ac8-c6f99ae0dc0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:06 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-91a3c7fa-1d9d-4135-bbdd-70fd0cba6942 tempest-VolumesListAdminTestJSON-1298618000 None] Volume volume-bb699bbd-958c-4ac6-9569-13f1dba39ac3 (bb699bbd-958c-4ac6-9569-13f1dba39ac3): created successfully Jul 30 16:59:06 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-91a3c7fa-1d9d-4135-bbdd-70fd0cba6942 tempest-VolumesListAdminTestJSON-1298618000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f70ab072-2d23-4139-8ac8-c6f99ae0dc0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:06 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-91a3c7fa-1d9d-4135-bbdd-70fd0cba6942 tempest-VolumesListAdminTestJSON-1298618000 None] Flow 'volume_create_manager' (e83e4568-521b-4326-ab8b-11624e67681a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:59:06 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-91a3c7fa-1d9d-4135-bbdd-70fd0cba6942 tempest-VolumesListAdminTestJSON-1298618000 None] Created volume successfully. Jul 30 16:59:08 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a9c1220-aef2-4617-8680-38895a34b445 tempest-VolumesListAdminTestJSON-1298618000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:59:08 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2a9c1220-aef2-4617-8680-38895a34b445 tempest-VolumesListAdminTestJSON-1298618000 None] Flow 'volume_create_manager' (9958ca71-6f72-45a0-b852-7c2fc915d792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:59:08 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2a9c1220-aef2-4617-8680-38895a34b445 tempest-VolumesListAdminTestJSON-1298618000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e48fc5-1e93-49ce-ae74-4ad7b2307448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:09 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2a9c1220-aef2-4617-8680-38895a34b445 tempest-VolumesListAdminTestJSON-1298618000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e48fc5-1e93-49ce-ae74-4ad7b2307448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1501555261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a87e0bfc-fd8c-4d2c-905b-349cae054de2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c84f11076c1d45a88829e5aaf854e32f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:59:09Z,use_quota=True,user_id='8236fce28fb640fea6b32d6608077805',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:09 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2a9c1220-aef2-4617-8680-38895a34b445 tempest-VolumesListAdminTestJSON-1298618000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f19a4cd-e427-40a2-a784-99f1c5579fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:09 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2a9c1220-aef2-4617-8680-38895a34b445 tempest-VolumesListAdminTestJSON-1298618000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f19a4cd-e427-40a2-a784-99f1c5579fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:09 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2a9c1220-aef2-4617-8680-38895a34b445 tempest-VolumesListAdminTestJSON-1298618000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (471900ae-ea2b-4075-8a5a-bfa566e20a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:09 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2a9c1220-aef2-4617-8680-38895a34b445 tempest-VolumesListAdminTestJSON-1298618000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (471900ae-ea2b-4075-8a5a-bfa566e20a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a87e0bfc-fd8c-4d2c-905b-349cae054de2', 'volume_name': 'volume-a87e0bfc-fd8c-4d2c-905b-349cae054de2', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:09 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2a9c1220-aef2-4617-8680-38895a34b445 tempest-VolumesListAdminTestJSON-1298618000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (688602b3-03d2-4487-a936-db45310a343b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:09 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2a9c1220-aef2-4617-8680-38895a34b445 tempest-VolumesListAdminTestJSON-1298618000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (688602b3-03d2-4487-a936-db45310a343b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:09 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2a9c1220-aef2-4617-8680-38895a34b445 tempest-VolumesListAdminTestJSON-1298618000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e6c82ff-bbe2-447d-9830-aa804574efbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:09 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-2a9c1220-aef2-4617-8680-38895a34b445 tempest-VolumesListAdminTestJSON-1298618000 None] Volume a87e0bfc-fd8c-4d2c-905b-349cae054de2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a87e0bfc-fd8c-4d2c-905b-349cae054de2', 'volume_size': 1} Jul 30 16:59:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2a9c1220-aef2-4617-8680-38895a34b445 tempest-VolumesListAdminTestJSON-1298618000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2a9c1220-aef2-4617-8680-38895a34b445 tempest-VolumesListAdminTestJSON-1298618000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:09 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-2a9c1220-aef2-4617-8680-38895a34b445 tempest-VolumesListAdminTestJSON-1298618000 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1501555261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a87e0bfc-fd8c-4d2c-905b-349cae054de2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c84f11076c1d45a88829e5aaf854e32f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:59:09Z,use_quota=True,user_id='8236fce28fb640fea6b32d6608077805',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:59:09 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-2a9c1220-aef2-4617-8680-38895a34b445 tempest-VolumesListAdminTestJSON-1298618000 None] Creating volume a87e0bfc-fd8c-4d2c-905b-349cae054de2 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:59:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2a9c1220-aef2-4617-8680-38895a34b445 tempest-VolumesListAdminTestJSON-1298618000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2a9c1220-aef2-4617-8680-38895a34b445 tempest-VolumesListAdminTestJSON-1298618000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:09 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-2a9c1220-aef2-4617-8680-38895a34b445 tempest-VolumesListAdminTestJSON-1298618000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:59:09 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-2a9c1220-aef2-4617-8680-38895a34b445 tempest-VolumesListAdminTestJSON-1298618000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:59:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2a9c1220-aef2-4617-8680-38895a34b445 tempest-VolumesListAdminTestJSON-1298618000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:09 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-2a9c1220-aef2-4617-8680-38895a34b445 tempest-VolumesListAdminTestJSON-1298618000 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:59:09 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-2a9c1220-aef2-4617-8680-38895a34b445 tempest-VolumesListAdminTestJSON-1298618000 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:59:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2a9c1220-aef2-4617-8680-38895a34b445 tempest-VolumesListAdminTestJSON-1298618000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a87e0bfc-fd8c-4d2c-905b-349cae054de2 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:09 devstack sudo[99824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a87e0bfc-fd8c-4d2c-905b-349cae054de2 1073741824 Jul 30 16:59:09 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:09 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2f4a382-896b-4770-8df1-354b412076c9 tempest-VolumesActionsTest-1280755332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:59:09 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d2f4a382-896b-4770-8df1-354b412076c9 tempest-VolumesActionsTest-1280755332 None] Flow 'volume_create_manager' (3d4ca1f7-88bc-4f7c-a334-2d039c30fca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:59:09 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d2f4a382-896b-4770-8df1-354b412076c9 tempest-VolumesActionsTest-1280755332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b86770ae-c416-45ca-b5e8-41a1eb4861aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:09 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d2f4a382-896b-4770-8df1-354b412076c9 tempest-VolumesActionsTest-1280755332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b86770ae-c416-45ca-b5e8-41a1eb4861aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1787633825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f980cd79-ba0b-4a43-9339-e87a7849137f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34abb9ab1bed48f98205ce987042183b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:59:09Z,use_quota=True,user_id='18bd51d3624948dcb178291e3d57dc33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:09 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d2f4a382-896b-4770-8df1-354b412076c9 tempest-VolumesActionsTest-1280755332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c4f32b4-e9eb-436f-b523-21794828958d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:09 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d2f4a382-896b-4770-8df1-354b412076c9 tempest-VolumesActionsTest-1280755332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c4f32b4-e9eb-436f-b523-21794828958d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:09 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d2f4a382-896b-4770-8df1-354b412076c9 tempest-VolumesActionsTest-1280755332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aec6cb13-cddf-4a7a-992a-69c13a2c704c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:09 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d2f4a382-896b-4770-8df1-354b412076c9 tempest-VolumesActionsTest-1280755332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aec6cb13-cddf-4a7a-992a-69c13a2c704c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f980cd79-ba0b-4a43-9339-e87a7849137f', 'volume_name': 'volume-f980cd79-ba0b-4a43-9339-e87a7849137f', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:09 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d2f4a382-896b-4770-8df1-354b412076c9 tempest-VolumesActionsTest-1280755332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (698d52ca-db92-4feb-912d-c9299ad7fb35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:09 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d2f4a382-896b-4770-8df1-354b412076c9 tempest-VolumesActionsTest-1280755332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (698d52ca-db92-4feb-912d-c9299ad7fb35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:09 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d2f4a382-896b-4770-8df1-354b412076c9 tempest-VolumesActionsTest-1280755332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eb2faa7-2f39-453b-8a1d-0cadbefad413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:09 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-d2f4a382-896b-4770-8df1-354b412076c9 tempest-VolumesActionsTest-1280755332 None] Volume f980cd79-ba0b-4a43-9339-e87a7849137f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f980cd79-ba0b-4a43-9339-e87a7849137f', 'volume_size': 1} Jul 30 16:59:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d2f4a382-896b-4770-8df1-354b412076c9 tempest-VolumesActionsTest-1280755332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:09 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2a9c1220-aef2-4617-8680-38895a34b445 tempest-VolumesListAdminTestJSON-1298618000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a87e0bfc-fd8c-4d2c-905b-349cae054de2 1073741824" returned: 0 in 0.604s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2a9c1220-aef2-4617-8680-38895a34b445 tempest-VolumesListAdminTestJSON-1298618000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a87e0bfc-fd8c-4d2c-905b-349cae054de2 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:09 devstack sudo[99830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a87e0bfc-fd8c-4d2c-905b-349cae054de2 Jul 30 16:59:09 devstack sudo[99830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:10 devstack sudo[99830]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2a9c1220-aef2-4617-8680-38895a34b445 tempest-VolumesListAdminTestJSON-1298618000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a87e0bfc-fd8c-4d2c-905b-349cae054de2" returned: 0 in 0.404s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:10 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-2a9c1220-aef2-4617-8680-38895a34b445 tempest-VolumesListAdminTestJSON-1298618000 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:59:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2a9c1220-aef2-4617-8680-38895a34b445 tempest-VolumesListAdminTestJSON-1298618000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d2f4a382-896b-4770-8df1-354b412076c9 tempest-VolumesActionsTest-1280755332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.907s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:10 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d2f4a382-896b-4770-8df1-354b412076c9 tempest-VolumesActionsTest-1280755332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1787633825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f980cd79-ba0b-4a43-9339-e87a7849137f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34abb9ab1bed48f98205ce987042183b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:59:09Z,use_quota=True,user_id='18bd51d3624948dcb178291e3d57dc33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:59:10 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-d2f4a382-896b-4770-8df1-354b412076c9 tempest-VolumesActionsTest-1280755332 None] Creating volume f980cd79-ba0b-4a43-9339-e87a7849137f {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:59:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d2f4a382-896b-4770-8df1-354b412076c9 tempest-VolumesActionsTest-1280755332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d2f4a382-896b-4770-8df1-354b412076c9 tempest-VolumesActionsTest-1280755332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:10 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d2f4a382-896b-4770-8df1-354b412076c9 tempest-VolumesActionsTest-1280755332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:59:10 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d2f4a382-896b-4770-8df1-354b412076c9 tempest-VolumesActionsTest-1280755332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:59:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d2f4a382-896b-4770-8df1-354b412076c9 tempest-VolumesActionsTest-1280755332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:10 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d2f4a382-896b-4770-8df1-354b412076c9 tempest-VolumesActionsTest-1280755332 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:59:10 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-d2f4a382-896b-4770-8df1-354b412076c9 tempest-VolumesActionsTest-1280755332 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:59:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d2f4a382-896b-4770-8df1-354b412076c9 tempest-VolumesActionsTest-1280755332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f980cd79-ba0b-4a43-9339-e87a7849137f 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:10 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2a9c1220-aef2-4617-8680-38895a34b445 tempest-VolumesListAdminTestJSON-1298618000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e6c82ff-bbe2-447d-9830-aa804574efbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a87e0bfc-fd8c-4d2c-905b-349cae054de2', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:10 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2a9c1220-aef2-4617-8680-38895a34b445 tempest-VolumesListAdminTestJSON-1298618000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05fd911b-5395-4618-9a89-a7d1cd8b41b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:10 devstack sudo[99841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f980cd79-ba0b-4a43-9339-e87a7849137f 1073741824 Jul 30 16:59:10 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-2a9c1220-aef2-4617-8680-38895a34b445 tempest-VolumesListAdminTestJSON-1298618000 None] Volume volume-a87e0bfc-fd8c-4d2c-905b-349cae054de2 (a87e0bfc-fd8c-4d2c-905b-349cae054de2): created successfully Jul 30 16:59:10 devstack sudo[99841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:10 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2a9c1220-aef2-4617-8680-38895a34b445 tempest-VolumesListAdminTestJSON-1298618000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05fd911b-5395-4618-9a89-a7d1cd8b41b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:10 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2a9c1220-aef2-4617-8680-38895a34b445 tempest-VolumesListAdminTestJSON-1298618000 None] Flow 'volume_create_manager' (9958ca71-6f72-45a0-b852-7c2fc915d792) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:59:10 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-2a9c1220-aef2-4617-8680-38895a34b445 tempest-VolumesListAdminTestJSON-1298618000 None] Created volume successfully. Jul 30 16:59:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-aa2ad97f-5240-4b13-94dd-f40edba24cb8 req-ef222e2f-bdfb-44ff-8892-2a97247ac667 tempest-TestInstancesWithCinderVolumes-358578746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:10 devstack sudo[99841]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d2f4a382-896b-4770-8df1-354b412076c9 tempest-VolumesActionsTest-1280755332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f980cd79-ba0b-4a43-9339-e87a7849137f 1073741824" returned: 0 in 0.643s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d2f4a382-896b-4770-8df1-354b412076c9 tempest-VolumesActionsTest-1280755332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f980cd79-ba0b-4a43-9339-e87a7849137f {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:10 devstack sudo[99848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f980cd79-ba0b-4a43-9339-e87a7849137f Jul 30 16:59:10 devstack sudo[99848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:11 devstack sudo[99848]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d2f4a382-896b-4770-8df1-354b412076c9 tempest-VolumesActionsTest-1280755332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f980cd79-ba0b-4a43-9339-e87a7849137f" returned: 0 in 0.321s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:11 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d2f4a382-896b-4770-8df1-354b412076c9 tempest-VolumesActionsTest-1280755332 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:59:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d2f4a382-896b-4770-8df1-354b412076c9 tempest-VolumesActionsTest-1280755332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-aa2ad97f-5240-4b13-94dd-f40edba24cb8 req-ef222e2f-bdfb-44ff-8892-2a97247ac667 tempest-TestInstancesWithCinderVolumes-358578746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.820s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:11 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d2f4a382-896b-4770-8df1-354b412076c9 tempest-VolumesActionsTest-1280755332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eb2faa7-2f39-453b-8a1d-0cadbefad413) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f980cd79-ba0b-4a43-9339-e87a7849137f', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:11 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d2f4a382-896b-4770-8df1-354b412076c9 tempest-VolumesActionsTest-1280755332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (317e45d2-6f26-45d7-8f0e-8ac8db6f609b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-aa2ad97f-5240-4b13-94dd-f40edba24cb8 req-ef222e2f-bdfb-44ff-8892-2a97247ac667 tempest-TestInstancesWithCinderVolumes-358578746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.045s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:11 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-d2f4a382-896b-4770-8df1-354b412076c9 tempest-VolumesActionsTest-1280755332 None] Volume volume-f980cd79-ba0b-4a43-9339-e87a7849137f (f980cd79-ba0b-4a43-9339-e87a7849137f): created successfully Jul 30 16:59:11 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d2f4a382-896b-4770-8df1-354b412076c9 tempest-VolumesActionsTest-1280755332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (317e45d2-6f26-45d7-8f0e-8ac8db6f609b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:11 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d2f4a382-896b-4770-8df1-354b412076c9 tempest-VolumesActionsTest-1280755332 None] Flow 'volume_create_manager' (3d4ca1f7-88bc-4f7c-a334-2d039c30fca9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:59:11 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-d2f4a382-896b-4770-8df1-354b412076c9 tempest-VolumesActionsTest-1280755332 None] Created volume successfully. Jul 30 16:59:11 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-aa2ad97f-5240-4b13-94dd-f40edba24cb8 req-ef222e2f-bdfb-44ff-8892-2a97247ac667 tempest-TestInstancesWithCinderVolumes-358578746 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202', 'name': 'volume-2627b4e3-5b32-4ec8-a5d9-8c403228c543', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fc1c2fcd-5681-410f-bd28-c863b6c31a73', 'enforce_multipath': True} {{(pid=88591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:59:11 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b177758-81f9-4f87-b52c-28993fbe0a3c tempest-VolumesListAdminTestJSON-1298618000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:59:11 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7b177758-81f9-4f87-b52c-28993fbe0a3c tempest-VolumesListAdminTestJSON-1298618000 None] Flow 'volume_create_manager' (9e014d6b-1ef1-47ad-8e06-f4baeaaf54b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:59:11 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7b177758-81f9-4f87-b52c-28993fbe0a3c tempest-VolumesListAdminTestJSON-1298618000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50736fa9-8c7f-40d5-a8f7-67f9c899d7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:11 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7b177758-81f9-4f87-b52c-28993fbe0a3c tempest-VolumesListAdminTestJSON-1298618000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50736fa9-8c7f-40d5-a8f7-67f9c899d7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-615733450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=219cb771-f58e-4ce4-8ff7-711097cc588f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c84f11076c1d45a88829e5aaf854e32f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:59:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:59:11Z,use_quota=True,user_id='8236fce28fb640fea6b32d6608077805',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:11 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7b177758-81f9-4f87-b52c-28993fbe0a3c tempest-VolumesListAdminTestJSON-1298618000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24c4cdf7-2412-4bca-9a2e-299136831a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:11 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7b177758-81f9-4f87-b52c-28993fbe0a3c tempest-VolumesListAdminTestJSON-1298618000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24c4cdf7-2412-4bca-9a2e-299136831a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:11 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7b177758-81f9-4f87-b52c-28993fbe0a3c tempest-VolumesListAdminTestJSON-1298618000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34430ddc-3dab-4040-9e44-e755d4fb3f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:11 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7b177758-81f9-4f87-b52c-28993fbe0a3c tempest-VolumesListAdminTestJSON-1298618000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34430ddc-3dab-4040-9e44-e755d4fb3f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '219cb771-f58e-4ce4-8ff7-711097cc588f', 'volume_name': 'volume-219cb771-f58e-4ce4-8ff7-711097cc588f', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:11 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7b177758-81f9-4f87-b52c-28993fbe0a3c tempest-VolumesListAdminTestJSON-1298618000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94f96f00-5870-4560-b913-c60090bdf9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:11 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7b177758-81f9-4f87-b52c-28993fbe0a3c tempest-VolumesListAdminTestJSON-1298618000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94f96f00-5870-4560-b913-c60090bdf9ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:11 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7b177758-81f9-4f87-b52c-28993fbe0a3c tempest-VolumesListAdminTestJSON-1298618000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b02e6145-9871-4b4b-a205-286282c7bdc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:11 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-7b177758-81f9-4f87-b52c-28993fbe0a3c tempest-VolumesListAdminTestJSON-1298618000 None] Volume 219cb771-f58e-4ce4-8ff7-711097cc588f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-219cb771-f58e-4ce4-8ff7-711097cc588f', 'volume_size': 1} Jul 30 16:59:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7b177758-81f9-4f87-b52c-28993fbe0a3c tempest-VolumesListAdminTestJSON-1298618000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7b177758-81f9-4f87-b52c-28993fbe0a3c tempest-VolumesListAdminTestJSON-1298618000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:11 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7b177758-81f9-4f87-b52c-28993fbe0a3c tempest-VolumesListAdminTestJSON-1298618000 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-615733450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=219cb771-f58e-4ce4-8ff7-711097cc588f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c84f11076c1d45a88829e5aaf854e32f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:59:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:59:11Z,use_quota=True,user_id='8236fce28fb640fea6b32d6608077805',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:59:11 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-7b177758-81f9-4f87-b52c-28993fbe0a3c tempest-VolumesListAdminTestJSON-1298618000 None] Creating volume 219cb771-f58e-4ce4-8ff7-711097cc588f {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:59:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7b177758-81f9-4f87-b52c-28993fbe0a3c tempest-VolumesListAdminTestJSON-1298618000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7b177758-81f9-4f87-b52c-28993fbe0a3c tempest-VolumesListAdminTestJSON-1298618000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:11 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7b177758-81f9-4f87-b52c-28993fbe0a3c tempest-VolumesListAdminTestJSON-1298618000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:59:11 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7b177758-81f9-4f87-b52c-28993fbe0a3c tempest-VolumesListAdminTestJSON-1298618000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:59:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7b177758-81f9-4f87-b52c-28993fbe0a3c tempest-VolumesListAdminTestJSON-1298618000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:11 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7b177758-81f9-4f87-b52c-28993fbe0a3c tempest-VolumesListAdminTestJSON-1298618000 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:59:11 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-7b177758-81f9-4f87-b52c-28993fbe0a3c tempest-VolumesListAdminTestJSON-1298618000 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:59:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7b177758-81f9-4f87-b52c-28993fbe0a3c tempest-VolumesListAdminTestJSON-1298618000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-219cb771-f58e-4ce4-8ff7-711097cc588f 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:11 devstack cinder-volume[88591]: INFO cinder.volume.manager [req-aa2ad97f-5240-4b13-94dd-f40edba24cb8 req-ef222e2f-bdfb-44ff-8892-2a97247ac667 tempest-TestInstancesWithCinderVolumes-358578746 None] attachment_update completed successfully. Jul 30 16:59:11 devstack sudo[99851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-219cb771-f58e-4ce4-8ff7-711097cc588f 1073741824 Jul 30 16:59:11 devstack sudo[99851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:12 devstack sudo[99851]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7b177758-81f9-4f87-b52c-28993fbe0a3c tempest-VolumesListAdminTestJSON-1298618000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-219cb771-f58e-4ce4-8ff7-711097cc588f 1073741824" returned: 0 in 0.746s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:12 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-22dfab57-2f58-46d5-83ef-a698b217bcc4 tempest-CreateVolumesFromSnapshotTest-680474775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:59:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-22dfab57-2f58-46d5-83ef-a698b217bcc4 tempest-CreateVolumesFromSnapshotTest-680474775 None] Flow 'volume_create_manager' (883f474c-95a3-40f5-8c0e-b61aa9d381c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:59:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-22dfab57-2f58-46d5-83ef-a698b217bcc4 tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb5b13f5-397a-4f61-9992-45ba7d58e739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7b177758-81f9-4f87-b52c-28993fbe0a3c tempest-VolumesListAdminTestJSON-1298618000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-219cb771-f58e-4ce4-8ff7-711097cc588f {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:12 devstack sudo[99859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-219cb771-f58e-4ce4-8ff7-711097cc588f Jul 30 16:59:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-22dfab57-2f58-46d5-83ef-a698b217bcc4 tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb5b13f5-397a-4f61-9992-45ba7d58e739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:59:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-901560102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49698b31-940b-4c00-a4bd-2b8ed9fe778d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='239cc45a4d0a43fbad63a079f0226941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:59:12Z,use_quota=True,user_id='a313a837d71b434685b99ff185a11499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:12 devstack sudo[99859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-22dfab57-2f58-46d5-83ef-a698b217bcc4 tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (876c27cc-a244-44a0-9f24-776d457979a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-22dfab57-2f58-46d5-83ef-a698b217bcc4 tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (876c27cc-a244-44a0-9f24-776d457979a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-22dfab57-2f58-46d5-83ef-a698b217bcc4 tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2e1a642-509f-4154-aa0b-8740472f3e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-22dfab57-2f58-46d5-83ef-a698b217bcc4 tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2e1a642-509f-4154-aa0b-8740472f3e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49698b31-940b-4c00-a4bd-2b8ed9fe778d', 'volume_name': 'volume-49698b31-940b-4c00-a4bd-2b8ed9fe778d', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-22dfab57-2f58-46d5-83ef-a698b217bcc4 tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (644b8459-ee94-4826-bb88-58e2d66854c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-22dfab57-2f58-46d5-83ef-a698b217bcc4 tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (644b8459-ee94-4826-bb88-58e2d66854c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-22dfab57-2f58-46d5-83ef-a698b217bcc4 tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e2481cd-6621-4a31-9041-10d57d204bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:12 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-22dfab57-2f58-46d5-83ef-a698b217bcc4 tempest-CreateVolumesFromSnapshotTest-680474775 None] Volume 49698b31-940b-4c00-a4bd-2b8ed9fe778d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49698b31-940b-4c00-a4bd-2b8ed9fe778d', 'volume_size': 1} Jul 30 16:59:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-22dfab57-2f58-46d5-83ef-a698b217bcc4 tempest-CreateVolumesFromSnapshotTest-680474775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:12 devstack cinder-volume[88591]: DEBUG oslo_service.periodic_task [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:59:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:59:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:59:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:12 devstack sudo[99863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:59:12 devstack sudo[99863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:12 devstack sudo[99859]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7b177758-81f9-4f87-b52c-28993fbe0a3c tempest-VolumesListAdminTestJSON-1298618000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-219cb771-f58e-4ce4-8ff7-711097cc588f" returned: 0 in 0.296s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7b177758-81f9-4f87-b52c-28993fbe0a3c tempest-VolumesListAdminTestJSON-1298618000 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:59:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7b177758-81f9-4f87-b52c-28993fbe0a3c tempest-VolumesListAdminTestJSON-1298618000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-22dfab57-2f58-46d5-83ef-a698b217bcc4 tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.229s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-22dfab57-2f58-46d5-83ef-a698b217bcc4 tempest-CreateVolumesFromSnapshotTest-680474775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:59:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-901560102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49698b31-940b-4c00-a4bd-2b8ed9fe778d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='239cc45a4d0a43fbad63a079f0226941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:59:12Z,use_quota=True,user_id='a313a837d71b434685b99ff185a11499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:59:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-22dfab57-2f58-46d5-83ef-a698b217bcc4 tempest-CreateVolumesFromSnapshotTest-680474775 None] Creating volume 49698b31-940b-4c00-a4bd-2b8ed9fe778d {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:59:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-22dfab57-2f58-46d5-83ef-a698b217bcc4 tempest-CreateVolumesFromSnapshotTest-680474775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-22dfab57-2f58-46d5-83ef-a698b217bcc4 tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-22dfab57-2f58-46d5-83ef-a698b217bcc4 tempest-CreateVolumesFromSnapshotTest-680474775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:59:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-22dfab57-2f58-46d5-83ef-a698b217bcc4 tempest-CreateVolumesFromSnapshotTest-680474775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:59:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-22dfab57-2f58-46d5-83ef-a698b217bcc4 tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-22dfab57-2f58-46d5-83ef-a698b217bcc4 tempest-CreateVolumesFromSnapshotTest-680474775 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:59:12 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-22dfab57-2f58-46d5-83ef-a698b217bcc4 tempest-CreateVolumesFromSnapshotTest-680474775 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:59:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-22dfab57-2f58-46d5-83ef-a698b217bcc4 tempest-CreateVolumesFromSnapshotTest-680474775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-49698b31-940b-4c00-a4bd-2b8ed9fe778d 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7b177758-81f9-4f87-b52c-28993fbe0a3c tempest-VolumesListAdminTestJSON-1298618000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b02e6145-9871-4b4b-a205-286282c7bdc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-219cb771-f58e-4ce4-8ff7-711097cc588f', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7b177758-81f9-4f87-b52c-28993fbe0a3c tempest-VolumesListAdminTestJSON-1298618000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f2aacd4-d268-4108-9332-58b628568526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:12 devstack sudo[99865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-49698b31-940b-4c00-a4bd-2b8ed9fe778d 1073741824 Jul 30 16:59:12 devstack sudo[99865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:12 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-7b177758-81f9-4f87-b52c-28993fbe0a3c tempest-VolumesListAdminTestJSON-1298618000 None] Volume volume-219cb771-f58e-4ce4-8ff7-711097cc588f (219cb771-f58e-4ce4-8ff7-711097cc588f): created successfully Jul 30 16:59:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7b177758-81f9-4f87-b52c-28993fbe0a3c tempest-VolumesListAdminTestJSON-1298618000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f2aacd4-d268-4108-9332-58b628568526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7b177758-81f9-4f87-b52c-28993fbe0a3c tempest-VolumesListAdminTestJSON-1298618000 None] Flow 'volume_create_manager' (9e014d6b-1ef1-47ad-8e06-f4baeaaf54b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:59:12 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-7b177758-81f9-4f87-b52c-28993fbe0a3c tempest-VolumesListAdminTestJSON-1298618000 None] Created volume successfully. Jul 30 16:59:12 devstack sudo[99863]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.378s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:12 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:59:12 devstack cinder-volume[88591]: DEBUG oslo_service.periodic_task [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running periodic task VolumeManager._thread_info {{(pid=88591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:59:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] thread count: 28 {{(pid=88591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:59:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] thread info: [<_MainThread(MainThread, started 140677178003584)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:59:13 devstack sudo[99865]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-22dfab57-2f58-46d5-83ef-a698b217bcc4 tempest-CreateVolumesFromSnapshotTest-680474775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-49698b31-940b-4c00-a4bd-2b8ed9fe778d 1073741824" returned: 0 in 0.701s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-22dfab57-2f58-46d5-83ef-a698b217bcc4 tempest-CreateVolumesFromSnapshotTest-680474775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-49698b31-940b-4c00-a4bd-2b8ed9fe778d {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:13 devstack sudo[99920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-49698b31-940b-4c00-a4bd-2b8ed9fe778d Jul 30 16:59:13 devstack sudo[99920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:13 devstack sudo[99920]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-22dfab57-2f58-46d5-83ef-a698b217bcc4 tempest-CreateVolumesFromSnapshotTest-680474775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-49698b31-940b-4c00-a4bd-2b8ed9fe778d" returned: 0 in 0.407s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:13 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-22dfab57-2f58-46d5-83ef-a698b217bcc4 tempest-CreateVolumesFromSnapshotTest-680474775 None] <== create_volume: return (1167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:59:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-22dfab57-2f58-46d5-83ef-a698b217bcc4 tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-22dfab57-2f58-46d5-83ef-a698b217bcc4 tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e2481cd-6621-4a31-9041-10d57d204bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49698b31-940b-4c00-a4bd-2b8ed9fe778d', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-22dfab57-2f58-46d5-83ef-a698b217bcc4 tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68b69296-dcdd-4aca-805e-3102e26469c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:13 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-22dfab57-2f58-46d5-83ef-a698b217bcc4 tempest-CreateVolumesFromSnapshotTest-680474775 None] Volume volume-49698b31-940b-4c00-a4bd-2b8ed9fe778d (49698b31-940b-4c00-a4bd-2b8ed9fe778d): created successfully Jul 30 16:59:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-22dfab57-2f58-46d5-83ef-a698b217bcc4 tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68b69296-dcdd-4aca-805e-3102e26469c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-22dfab57-2f58-46d5-83ef-a698b217bcc4 tempest-CreateVolumesFromSnapshotTest-680474775 None] Flow 'volume_create_manager' (883f474c-95a3-40f5-8c0e-b61aa9d381c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:59:13 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-22dfab57-2f58-46d5-83ef-a698b217bcc4 tempest-CreateVolumesFromSnapshotTest-680474775 None] Created volume successfully. Jul 30 16:59:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-91e2a171-1637-4d98-84ff-76a0fe7820d7 tempest-CreateVolumesFromSnapshotTest-680474775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-91e2a171-1637-4d98-84ff-76a0fe7820d7 tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:15 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-91e2a171-1637-4d98-84ff-76a0fe7820d7 tempest-CreateVolumesFromSnapshotTest-680474775 None] Creating offline snapshot 6472c758-b270-4e68-8271-bc7e62557c8b of volume 49698b31-940b-4c00-a4bd-2b8ed9fe778d {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:59:15 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5f875d-f248-4763-a4db-327400b69b11]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:59:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-91e2a171-1637-4d98-84ff-76a0fe7820d7 tempest-CreateVolumesFromSnapshotTest-680474775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-49698b31-940b-4c00-a4bd-2b8ed9fe778d {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:15 devstack sudo[100311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-49698b31-940b-4c00-a4bd-2b8ed9fe778d Jul 30 16:59:15 devstack sudo[100311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-91e2a171-1637-4d98-84ff-76a0fe7820d7 tempest-CreateVolumesFromSnapshotTest-680474775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-49698b31-940b-4c00-a4bd-2b8ed9fe778d" returned: 0 in 0.552s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:15 devstack sudo[100311]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-91e2a171-1637-4d98-84ff-76a0fe7820d7 tempest-CreateVolumesFromSnapshotTest-680474775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-49698b31-940b-4c00-a4bd-2b8ed9fe778d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-49698b31-940b-4c00-a4bd-2b8ed9fe778d.6472c758-b270-4e68-8271-bc7e62557c8b 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:15 devstack sudo[100326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-49698b31-940b-4c00-a4bd-2b8ed9fe778d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-49698b31-940b-4c00-a4bd-2b8ed9fe778d.6472c758-b270-4e68-8271-bc7e62557c8b 1G Jul 30 16:59:15 devstack sudo[100326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:15 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4069e26-e793-41f4-965e-6b838e18b8ee tempest-VolumesListAdminTestJSON-1764916613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:59:15 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a4069e26-e793-41f4-965e-6b838e18b8ee tempest-VolumesListAdminTestJSON-1764916613 None] Flow 'volume_create_manager' (417aaadc-dc38-452b-ad83-dbeaa7567800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:59:15 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a4069e26-e793-41f4-965e-6b838e18b8ee tempest-VolumesListAdminTestJSON-1764916613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2358785c-d658-4119-a658-9501a5133ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:15 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a4069e26-e793-41f4-965e-6b838e18b8ee tempest-VolumesListAdminTestJSON-1764916613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2358785c-d658-4119-a658-9501a5133ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:59:15Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b38e6901-b05b-41fc-a009-7248b021ee0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d609fc71b304418b6adb0b3bee78a91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:59:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:59:16Z,use_quota=True,user_id='fd5a68225edc4ea9959598a3cfee62c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:15 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a4069e26-e793-41f4-965e-6b838e18b8ee tempest-VolumesListAdminTestJSON-1764916613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85e5abb8-38bd-483a-933f-76fdd5e8a3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:15 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a4069e26-e793-41f4-965e-6b838e18b8ee tempest-VolumesListAdminTestJSON-1764916613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85e5abb8-38bd-483a-933f-76fdd5e8a3bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:15 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a4069e26-e793-41f4-965e-6b838e18b8ee tempest-VolumesListAdminTestJSON-1764916613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22c3bbc0-20b9-4b75-96aa-e2b0149683bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:15 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a4069e26-e793-41f4-965e-6b838e18b8ee tempest-VolumesListAdminTestJSON-1764916613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22c3bbc0-20b9-4b75-96aa-e2b0149683bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b38e6901-b05b-41fc-a009-7248b021ee0f', 'volume_name': 'volume-b38e6901-b05b-41fc-a009-7248b021ee0f', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:15 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a4069e26-e793-41f4-965e-6b838e18b8ee tempest-VolumesListAdminTestJSON-1764916613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d048d855-297a-47eb-b0de-808726d1844c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:15 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a4069e26-e793-41f4-965e-6b838e18b8ee tempest-VolumesListAdminTestJSON-1764916613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d048d855-297a-47eb-b0de-808726d1844c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:15 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a4069e26-e793-41f4-965e-6b838e18b8ee tempest-VolumesListAdminTestJSON-1764916613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbd1a515-1ff8-4759-8933-bb187903556f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:15 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-a4069e26-e793-41f4-965e-6b838e18b8ee tempest-VolumesListAdminTestJSON-1764916613 None] Volume b38e6901-b05b-41fc-a009-7248b021ee0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b38e6901-b05b-41fc-a009-7248b021ee0f', 'volume_size': 1} Jul 30 16:59:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a4069e26-e793-41f4-965e-6b838e18b8ee tempest-VolumesListAdminTestJSON-1764916613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:16 devstack sudo[100326]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:16 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-91e2a171-1637-4d98-84ff-76a0fe7820d7 tempest-CreateVolumesFromSnapshotTest-680474775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-49698b31-940b-4c00-a4bd-2b8ed9fe778d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-49698b31-940b-4c00-a4bd-2b8ed9fe778d.6472c758-b270-4e68-8271-bc7e62557c8b 1G" returned: 0 in 0.602s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:16 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-91e2a171-1637-4d98-84ff-76a0fe7820d7 tempest-CreateVolumesFromSnapshotTest-680474775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49698b31-940b-4c00-a4bd-2b8ed9fe778d -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-49698b31-940b-4c00-a4bd-2b8ed9fe778d.6472c758-b270-4e68-8271-bc7e62557c8b {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:16 devstack sudo[100360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49698b31-940b-4c00-a4bd-2b8ed9fe778d -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-49698b31-940b-4c00-a4bd-2b8ed9fe778d.6472c758-b270-4e68-8271-bc7e62557c8b Jul 30 16:59:16 devstack sudo[100360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:16 devstack sudo[100360]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:16 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-91e2a171-1637-4d98-84ff-76a0fe7820d7 tempest-CreateVolumesFromSnapshotTest-680474775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49698b31-940b-4c00-a4bd-2b8ed9fe778d -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-49698b31-940b-4c00-a4bd-2b8ed9fe778d.6472c758-b270-4e68-8271-bc7e62557c8b" returned: 0 in 0.518s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:16 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-91e2a171-1637-4d98-84ff-76a0fe7820d7 tempest-CreateVolumesFromSnapshotTest-680474775 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-49698b31-940b-4c00-a4bd-2b8ed9fe778d.6472c758-b270-4e68-8271-bc7e62557c8b is being set with open permissions: ugo+rw Jul 30 16:59:16 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-91e2a171-1637-4d98-84ff-76a0fe7820d7 tempest-CreateVolumesFromSnapshotTest-680474775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-49698b31-940b-4c00-a4bd-2b8ed9fe778d.6472c758-b270-4e68-8271-bc7e62557c8b {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:16 devstack sudo[100372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-49698b31-940b-4c00-a4bd-2b8ed9fe778d.6472c758-b270-4e68-8271-bc7e62557c8b Jul 30 16:59:16 devstack sudo[100372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:17 devstack sudo[100372]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-91e2a171-1637-4d98-84ff-76a0fe7820d7 tempest-CreateVolumesFromSnapshotTest-680474775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-49698b31-940b-4c00-a4bd-2b8ed9fe778d.6472c758-b270-4e68-8271-bc7e62557c8b" returned: 0 in 0.321s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-91e2a171-1637-4d98-84ff-76a0fe7820d7 tempest-CreateVolumesFromSnapshotTest-680474775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-49698b31-940b-4c00-a4bd-2b8ed9fe778d.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:17 devstack sudo[100375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-49698b31-940b-4c00-a4bd-2b8ed9fe778d.info Jul 30 16:59:17 devstack sudo[100375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:17 devstack sudo[100375]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-91e2a171-1637-4d98-84ff-76a0fe7820d7 tempest-CreateVolumesFromSnapshotTest-680474775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-49698b31-940b-4c00-a4bd-2b8ed9fe778d.info" returned: 0 in 0.343s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:17 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-91e2a171-1637-4d98-84ff-76a0fe7820d7 tempest-CreateVolumesFromSnapshotTest-680474775 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-49698b31-940b-4c00-a4bd-2b8ed9fe778d.info is being set with open permissions: ugo+rw Jul 30 16:59:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-91e2a171-1637-4d98-84ff-76a0fe7820d7 tempest-CreateVolumesFromSnapshotTest-680474775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-49698b31-940b-4c00-a4bd-2b8ed9fe778d.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:17 devstack sudo[100380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-49698b31-940b-4c00-a4bd-2b8ed9fe778d.info Jul 30 16:59:17 devstack sudo[100380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:17 devstack sudo[100380]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-91e2a171-1637-4d98-84ff-76a0fe7820d7 tempest-CreateVolumesFromSnapshotTest-680474775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-49698b31-940b-4c00-a4bd-2b8ed9fe778d.info" returned: 0 in 0.412s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-91e2a171-1637-4d98-84ff-76a0fe7820d7 tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.951s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a4069e26-e793-41f4-965e-6b838e18b8ee tempest-VolumesListAdminTestJSON-1764916613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.942s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:17 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a4069e26-e793-41f4-965e-6b838e18b8ee tempest-VolumesListAdminTestJSON-1764916613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:59:15Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b38e6901-b05b-41fc-a009-7248b021ee0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d609fc71b304418b6adb0b3bee78a91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:59:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:59:16Z,use_quota=True,user_id='fd5a68225edc4ea9959598a3cfee62c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:59:17 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-a4069e26-e793-41f4-965e-6b838e18b8ee tempest-VolumesListAdminTestJSON-1764916613 None] Creating volume b38e6901-b05b-41fc-a009-7248b021ee0f {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:59:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a4069e26-e793-41f4-965e-6b838e18b8ee tempest-VolumesListAdminTestJSON-1764916613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a4069e26-e793-41f4-965e-6b838e18b8ee tempest-VolumesListAdminTestJSON-1764916613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:17 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a4069e26-e793-41f4-965e-6b838e18b8ee tempest-VolumesListAdminTestJSON-1764916613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:59:17 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a4069e26-e793-41f4-965e-6b838e18b8ee tempest-VolumesListAdminTestJSON-1764916613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:59:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a4069e26-e793-41f4-965e-6b838e18b8ee tempest-VolumesListAdminTestJSON-1764916613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:17 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a4069e26-e793-41f4-965e-6b838e18b8ee tempest-VolumesListAdminTestJSON-1764916613 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:59:17 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-a4069e26-e793-41f4-965e-6b838e18b8ee tempest-VolumesListAdminTestJSON-1764916613 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:59:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a4069e26-e793-41f4-965e-6b838e18b8ee tempest-VolumesListAdminTestJSON-1764916613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b38e6901-b05b-41fc-a009-7248b021ee0f 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:18 devstack sudo[100383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b38e6901-b05b-41fc-a009-7248b021ee0f 1073741824 Jul 30 16:59:18 devstack sudo[100383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:18 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-91e2a171-1637-4d98-84ff-76a0fe7820d7 tempest-CreateVolumesFromSnapshotTest-680474775 None] Create snapshot completed successfully Jul 30 16:59:18 devstack sudo[100383]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a4069e26-e793-41f4-965e-6b838e18b8ee tempest-VolumesListAdminTestJSON-1764916613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b38e6901-b05b-41fc-a009-7248b021ee0f 1073741824" returned: 0 in 0.667s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a4069e26-e793-41f4-965e-6b838e18b8ee tempest-VolumesListAdminTestJSON-1764916613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b38e6901-b05b-41fc-a009-7248b021ee0f {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:18 devstack sudo[100390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b38e6901-b05b-41fc-a009-7248b021ee0f Jul 30 16:59:18 devstack sudo[100390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:19 devstack sudo[100390]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a4069e26-e793-41f4-965e-6b838e18b8ee tempest-VolumesListAdminTestJSON-1764916613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b38e6901-b05b-41fc-a009-7248b021ee0f" returned: 0 in 0.609s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:19 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a4069e26-e793-41f4-965e-6b838e18b8ee tempest-VolumesListAdminTestJSON-1764916613 None] <== create_volume: return (1363ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:59:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a4069e26-e793-41f4-965e-6b838e18b8ee tempest-VolumesListAdminTestJSON-1764916613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.367s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:19 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a4069e26-e793-41f4-965e-6b838e18b8ee tempest-VolumesListAdminTestJSON-1764916613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbd1a515-1ff8-4759-8933-bb187903556f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b38e6901-b05b-41fc-a009-7248b021ee0f', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:19 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a4069e26-e793-41f4-965e-6b838e18b8ee tempest-VolumesListAdminTestJSON-1764916613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84e7aee8-02cc-4551-981a-e653488bd3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:19 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-a4069e26-e793-41f4-965e-6b838e18b8ee tempest-VolumesListAdminTestJSON-1764916613 None] Volume volume-b38e6901-b05b-41fc-a009-7248b021ee0f (b38e6901-b05b-41fc-a009-7248b021ee0f): created successfully Jul 30 16:59:19 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a4069e26-e793-41f4-965e-6b838e18b8ee tempest-VolumesListAdminTestJSON-1764916613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84e7aee8-02cc-4551-981a-e653488bd3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:19 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a4069e26-e793-41f4-965e-6b838e18b8ee tempest-VolumesListAdminTestJSON-1764916613 None] Flow 'volume_create_manager' (417aaadc-dc38-452b-ad83-dbeaa7567800) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:59:19 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-a4069e26-e793-41f4-965e-6b838e18b8ee tempest-VolumesListAdminTestJSON-1764916613 None] Created volume successfully. Jul 30 16:59:20 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d30865b3-4cbe-45c1-be84-cfb8ec77baeb tempest-VolumesListAdminTestJSON-1764916613 None] Acquiring lock "cinder-b38e6901-b05b-41fc-a009-7248b021ee0f-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:59:20 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d30865b3-4cbe-45c1-be84-cfb8ec77baeb tempest-VolumesListAdminTestJSON-1764916613 None] Lock "cinder-b38e6901-b05b-41fc-a009-7248b021ee0f-delete_volume" acquired by "delete_volume" :: waited 0.135s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:59:20 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7fca6bbf-4804-4e10-9f6a-38ee1c6defe6 tempest-VolumesListAdminTestJSON-1298618000 None] Acquiring lock "cinder-219cb771-f58e-4ce4-8ff7-711097cc588f-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:59:21 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d30865b3-4cbe-45c1-be84-cfb8ec77baeb tempest-VolumesListAdminTestJSON-1764916613 None] Acquiring lock "cinder-quobyte-b38e6901-b05b-41fc-a009-7248b021ee0f" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:59:21 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcd4ecbc-d2e1-4859-bb47-889b09d3b2e7 tempest-CreateVolumesFromSnapshotTest-680474775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:59:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-dcd4ecbc-d2e1-4859-bb47-889b09d3b2e7 tempest-CreateVolumesFromSnapshotTest-680474775 None] Flow 'volume_create_manager' (4b0b32db-3440-42be-8433-50f962aa2776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:59:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-dcd4ecbc-d2e1-4859-bb47-889b09d3b2e7 tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78361485-c081-476a-87cf-733ac7756581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:21 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7fca6bbf-4804-4e10-9f6a-38ee1c6defe6 tempest-VolumesListAdminTestJSON-1298618000 None] Lock "cinder-219cb771-f58e-4ce4-8ff7-711097cc588f-delete_volume" acquired by "delete_volume" :: waited 0.226s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:59:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-dcd4ecbc-d2e1-4859-bb47-889b09d3b2e7 tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78361485-c081-476a-87cf-733ac7756581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1010238211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=191646c7-c03f-48c1-b780-e89186368032,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='239cc45a4d0a43fbad63a079f0226941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:59:21Z,use_quota=True,user_id='a313a837d71b434685b99ff185a11499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-dcd4ecbc-d2e1-4859-bb47-889b09d3b2e7 tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccba5f78-9d3e-4605-8a64-9b178a7bdf49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-dcd4ecbc-d2e1-4859-bb47-889b09d3b2e7 tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccba5f78-9d3e-4605-8a64-9b178a7bdf49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-dcd4ecbc-d2e1-4859-bb47-889b09d3b2e7 tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f07b75c-ec5a-4b33-953d-a7e951ad79a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-dcd4ecbc-d2e1-4859-bb47-889b09d3b2e7 tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f07b75c-ec5a-4b33-953d-a7e951ad79a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '191646c7-c03f-48c1-b780-e89186368032', 'volume_name': 'volume-191646c7-c03f-48c1-b780-e89186368032', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-dcd4ecbc-d2e1-4859-bb47-889b09d3b2e7 tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40a99161-8576-4076-8fed-59c7f1ce0be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-dcd4ecbc-d2e1-4859-bb47-889b09d3b2e7 tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40a99161-8576-4076-8fed-59c7f1ce0be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-dcd4ecbc-d2e1-4859-bb47-889b09d3b2e7 tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (781ce521-bf00-490e-9088-cae2565b5436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:21 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-dcd4ecbc-d2e1-4859-bb47-889b09d3b2e7 tempest-CreateVolumesFromSnapshotTest-680474775 None] Volume 191646c7-c03f-48c1-b780-e89186368032: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-191646c7-c03f-48c1-b780-e89186368032', 'volume_size': 1} Jul 30 16:59:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-dcd4ecbc-d2e1-4859-bb47-889b09d3b2e7 tempest-CreateVolumesFromSnapshotTest-680474775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-dcd4ecbc-d2e1-4859-bb47-889b09d3b2e7 tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:21 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-dcd4ecbc-d2e1-4859-bb47-889b09d3b2e7 tempest-CreateVolumesFromSnapshotTest-680474775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1010238211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=191646c7-c03f-48c1-b780-e89186368032,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='239cc45a4d0a43fbad63a079f0226941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:59:21Z,use_quota=True,user_id='a313a837d71b434685b99ff185a11499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:59:21 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-dcd4ecbc-d2e1-4859-bb47-889b09d3b2e7 tempest-CreateVolumesFromSnapshotTest-680474775 None] Creating volume 191646c7-c03f-48c1-b780-e89186368032 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:59:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-dcd4ecbc-d2e1-4859-bb47-889b09d3b2e7 tempest-CreateVolumesFromSnapshotTest-680474775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-dcd4ecbc-d2e1-4859-bb47-889b09d3b2e7 tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:21 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-dcd4ecbc-d2e1-4859-bb47-889b09d3b2e7 tempest-CreateVolumesFromSnapshotTest-680474775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:59:21 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-dcd4ecbc-d2e1-4859-bb47-889b09d3b2e7 tempest-CreateVolumesFromSnapshotTest-680474775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:59:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-dcd4ecbc-d2e1-4859-bb47-889b09d3b2e7 tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:21 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-dcd4ecbc-d2e1-4859-bb47-889b09d3b2e7 tempest-CreateVolumesFromSnapshotTest-680474775 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:59:21 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-dcd4ecbc-d2e1-4859-bb47-889b09d3b2e7 tempest-CreateVolumesFromSnapshotTest-680474775 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:59:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dcd4ecbc-d2e1-4859-bb47-889b09d3b2e7 tempest-CreateVolumesFromSnapshotTest-680474775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-191646c7-c03f-48c1-b780-e89186368032 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:21 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d30865b3-4cbe-45c1-be84-cfb8ec77baeb tempest-VolumesListAdminTestJSON-1764916613 None] Lock "cinder-quobyte-b38e6901-b05b-41fc-a009-7248b021ee0f" acquired by "delete_volume" :: waited 0.369s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:59:21 devstack sudo[100452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-191646c7-c03f-48c1-b780-e89186368032 1073741824 Jul 30 16:59:21 devstack sudo[100452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:21 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9e7451-f1d4-47e0-a9c2-089312cb535b]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:59:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d30865b3-4cbe-45c1-be84-cfb8ec77baeb tempest-VolumesListAdminTestJSON-1764916613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b38e6901-b05b-41fc-a009-7248b021ee0f {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:21 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7fca6bbf-4804-4e10-9f6a-38ee1c6defe6 tempest-VolumesListAdminTestJSON-1298618000 None] Acquiring lock "cinder-quobyte-219cb771-f58e-4ce4-8ff7-711097cc588f" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:59:21 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7fca6bbf-4804-4e10-9f6a-38ee1c6defe6 tempest-VolumesListAdminTestJSON-1298618000 None] Lock "cinder-quobyte-219cb771-f58e-4ce4-8ff7-711097cc588f" acquired by "delete_volume" :: waited 0.054s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:59:21 devstack sudo[100457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b38e6901-b05b-41fc-a009-7248b021ee0f Jul 30 16:59:21 devstack sudo[100457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:21 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab83b84-953a-4ba3-9111-effd1f520143]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:59:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7fca6bbf-4804-4e10-9f6a-38ee1c6defe6 tempest-VolumesListAdminTestJSON-1298618000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-219cb771-f58e-4ce4-8ff7-711097cc588f {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:22 devstack sudo[100464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-219cb771-f58e-4ce4-8ff7-711097cc588f Jul 30 16:59:22 devstack sudo[100464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:22 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-114d8f24-f99d-4a91-8285-8341c6aa65de tempest-CreateVolumesFromSnapshotTest-680474775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:59:22 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-114d8f24-f99d-4a91-8285-8341c6aa65de tempest-CreateVolumesFromSnapshotTest-680474775 None] Flow 'volume_create_manager' (540c88b9-f6fa-4730-98a5-069dcc52ad12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:59:22 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-114d8f24-f99d-4a91-8285-8341c6aa65de tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (748bd1b3-7489-403d-adbe-48191d4daa9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:22 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-114d8f24-f99d-4a91-8285-8341c6aa65de tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (748bd1b3-7489-403d-adbe-48191d4daa9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-279319350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=843deb5e-0e25-4d17-954c-bfe9ef1c1627,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='239cc45a4d0a43fbad63a079f0226941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:59:22Z,use_quota=True,user_id='a313a837d71b434685b99ff185a11499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:22 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-114d8f24-f99d-4a91-8285-8341c6aa65de tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0913030f-2e60-4ee3-9eb4-20e136d04193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:22 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-114d8f24-f99d-4a91-8285-8341c6aa65de tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0913030f-2e60-4ee3-9eb4-20e136d04193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:22 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-114d8f24-f99d-4a91-8285-8341c6aa65de tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0b7dd58-5640-4887-b437-a3144b20b93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:22 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-114d8f24-f99d-4a91-8285-8341c6aa65de tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0b7dd58-5640-4887-b437-a3144b20b93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '843deb5e-0e25-4d17-954c-bfe9ef1c1627', 'volume_name': 'volume-843deb5e-0e25-4d17-954c-bfe9ef1c1627', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:22 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-114d8f24-f99d-4a91-8285-8341c6aa65de tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e77eb7ae-e9fd-4c0e-b135-5f341703f0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:22 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-114d8f24-f99d-4a91-8285-8341c6aa65de tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e77eb7ae-e9fd-4c0e-b135-5f341703f0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:22 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-114d8f24-f99d-4a91-8285-8341c6aa65de tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f410ea43-f22b-4c06-b950-4ce83e7abbd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:22 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-114d8f24-f99d-4a91-8285-8341c6aa65de tempest-CreateVolumesFromSnapshotTest-680474775 None] Volume 843deb5e-0e25-4d17-954c-bfe9ef1c1627: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-843deb5e-0e25-4d17-954c-bfe9ef1c1627', 'volume_size': 1} Jul 30 16:59:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-114d8f24-f99d-4a91-8285-8341c6aa65de tempest-CreateVolumesFromSnapshotTest-680474775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:23 devstack sudo[100452]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dcd4ecbc-d2e1-4859-bb47-889b09d3b2e7 tempest-CreateVolumesFromSnapshotTest-680474775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-191646c7-c03f-48c1-b780-e89186368032 1073741824" returned: 0 in 1.650s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:23 devstack sudo[100457]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d30865b3-4cbe-45c1-be84-cfb8ec77baeb tempest-VolumesListAdminTestJSON-1764916613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b38e6901-b05b-41fc-a009-7248b021ee0f" returned: 0 in 1.558s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d30865b3-4cbe-45c1-be84-cfb8ec77baeb tempest-VolumesListAdminTestJSON-1764916613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b38e6901-b05b-41fc-a009-7248b021ee0f {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:23 devstack sudo[100486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b38e6901-b05b-41fc-a009-7248b021ee0f Jul 30 16:59:23 devstack sudo[100486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dcd4ecbc-d2e1-4859-bb47-889b09d3b2e7 tempest-CreateVolumesFromSnapshotTest-680474775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-191646c7-c03f-48c1-b780-e89186368032 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:23 devstack sudo[100464]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:23 devstack sudo[100488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-191646c7-c03f-48c1-b780-e89186368032 Jul 30 16:59:23 devstack sudo[100488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7fca6bbf-4804-4e10-9f6a-38ee1c6defe6 tempest-VolumesListAdminTestJSON-1298618000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-219cb771-f58e-4ce4-8ff7-711097cc588f" returned: 0 in 1.704s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7fca6bbf-4804-4e10-9f6a-38ee1c6defe6 tempest-VolumesListAdminTestJSON-1298618000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-219cb771-f58e-4ce4-8ff7-711097cc588f {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:23 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-a68e81bc-0c12-4347-93c6-e631e7d69dda tempest-CreateVolumesFromSnapshotTest-680474775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:59:23 devstack sudo[100491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-219cb771-f58e-4ce4-8ff7-711097cc588f Jul 30 16:59:23 devstack sudo[100491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:23 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a68e81bc-0c12-4347-93c6-e631e7d69dda tempest-CreateVolumesFromSnapshotTest-680474775 None] Flow 'volume_create_manager' (be07d7f1-dde7-424e-82a9-57d6010344bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:59:23 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a68e81bc-0c12-4347-93c6-e631e7d69dda tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f2a3eab-8557-4f05-a9c3-61b2878a3d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:23 devstack sudo[100486]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:23 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a68e81bc-0c12-4347-93c6-e631e7d69dda tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f2a3eab-8557-4f05-a9c3-61b2878a3d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-916182487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dcb3a63-7ad8-4bfb-bd6d-d9ed01e8140f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='239cc45a4d0a43fbad63a079f0226941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:59:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:59:23Z,use_quota=True,user_id='a313a837d71b434685b99ff185a11499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:23 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a68e81bc-0c12-4347-93c6-e631e7d69dda tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d9db957-1502-41a6-9696-3d2ede56d6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:23 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a68e81bc-0c12-4347-93c6-e631e7d69dda tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d9db957-1502-41a6-9696-3d2ede56d6d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:23 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a68e81bc-0c12-4347-93c6-e631e7d69dda tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8443499b-9819-4107-9a84-29201a253302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a68e81bc-0c12-4347-93c6-e631e7d69dda tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8443499b-9819-4107-9a84-29201a253302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dcb3a63-7ad8-4bfb-bd6d-d9ed01e8140f', 'volume_name': 'volume-4dcb3a63-7ad8-4bfb-bd6d-d9ed01e8140f', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a68e81bc-0c12-4347-93c6-e631e7d69dda tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c705944-b5d2-479d-8fe3-da4f81b45ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a68e81bc-0c12-4347-93c6-e631e7d69dda tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c705944-b5d2-479d-8fe3-da4f81b45ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:24 devstack sudo[100491]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a68e81bc-0c12-4347-93c6-e631e7d69dda tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c50b8801-e9cb-4c32-8fbf-d32feaea3e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:24 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-a68e81bc-0c12-4347-93c6-e631e7d69dda tempest-CreateVolumesFromSnapshotTest-680474775 None] Volume 4dcb3a63-7ad8-4bfb-bd6d-d9ed01e8140f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dcb3a63-7ad8-4bfb-bd6d-d9ed01e8140f', 'volume_size': 1} Jul 30 16:59:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a68e81bc-0c12-4347-93c6-e631e7d69dda tempest-CreateVolumesFromSnapshotTest-680474775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7fca6bbf-4804-4e10-9f6a-38ee1c6defe6 tempest-VolumesListAdminTestJSON-1298618000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-219cb771-f58e-4ce4-8ff7-711097cc588f" returned: 0 in 0.679s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d30865b3-4cbe-45c1-be84-cfb8ec77baeb tempest-VolumesListAdminTestJSON-1764916613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b38e6901-b05b-41fc-a009-7248b021ee0f" returned: 0 in 1.078s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:24 devstack sudo[100488]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:24 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7fca6bbf-4804-4e10-9f6a-38ee1c6defe6 tempest-VolumesListAdminTestJSON-1298618000 None] Lock "cinder-quobyte-219cb771-f58e-4ce4-8ff7-711097cc588f" released by "delete_volume" :: held 2.556s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:24 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d30865b3-4cbe-45c1-be84-cfb8ec77baeb tempest-VolumesListAdminTestJSON-1764916613 None] Lock "cinder-quobyte-b38e6901-b05b-41fc-a009-7248b021ee0f" released by "delete_volume" :: held 2.881s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dcd4ecbc-d2e1-4859-bb47-889b09d3b2e7 tempest-CreateVolumesFromSnapshotTest-680474775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-191646c7-c03f-48c1-b780-e89186368032" returned: 0 in 1.074s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:24 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-dcd4ecbc-d2e1-4859-bb47-889b09d3b2e7 tempest-CreateVolumesFromSnapshotTest-680474775 None] <== create_volume: return (2967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:59:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-dcd4ecbc-d2e1-4859-bb47-889b09d3b2e7 tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.974s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-114d8f24-f99d-4a91-8285-8341c6aa65de tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.948s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:24 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-114d8f24-f99d-4a91-8285-8341c6aa65de tempest-CreateVolumesFromSnapshotTest-680474775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-279319350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=843deb5e-0e25-4d17-954c-bfe9ef1c1627,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='239cc45a4d0a43fbad63a079f0226941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:59:22Z,use_quota=True,user_id='a313a837d71b434685b99ff185a11499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:59:24 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-114d8f24-f99d-4a91-8285-8341c6aa65de tempest-CreateVolumesFromSnapshotTest-680474775 None] Creating volume 843deb5e-0e25-4d17-954c-bfe9ef1c1627 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:59:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-114d8f24-f99d-4a91-8285-8341c6aa65de tempest-CreateVolumesFromSnapshotTest-680474775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-114d8f24-f99d-4a91-8285-8341c6aa65de tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:24 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-114d8f24-f99d-4a91-8285-8341c6aa65de tempest-CreateVolumesFromSnapshotTest-680474775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:59:24 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-114d8f24-f99d-4a91-8285-8341c6aa65de tempest-CreateVolumesFromSnapshotTest-680474775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:59:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-114d8f24-f99d-4a91-8285-8341c6aa65de tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:24 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-114d8f24-f99d-4a91-8285-8341c6aa65de tempest-CreateVolumesFromSnapshotTest-680474775 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:59:24 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-114d8f24-f99d-4a91-8285-8341c6aa65de tempest-CreateVolumesFromSnapshotTest-680474775 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:59:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-114d8f24-f99d-4a91-8285-8341c6aa65de tempest-CreateVolumesFromSnapshotTest-680474775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-843deb5e-0e25-4d17-954c-bfe9ef1c1627 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:24 devstack sudo[100500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-843deb5e-0e25-4d17-954c-bfe9ef1c1627 1073741824 Jul 30 16:59:24 devstack sudo[100500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-dcd4ecbc-d2e1-4859-bb47-889b09d3b2e7 tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (781ce521-bf00-490e-9088-cae2565b5436) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-191646c7-c03f-48c1-b780-e89186368032', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-dcd4ecbc-d2e1-4859-bb47-889b09d3b2e7 tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9eae4fc-df09-40aa-ab30-2c6a554e8bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:25 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-dcd4ecbc-d2e1-4859-bb47-889b09d3b2e7 tempest-CreateVolumesFromSnapshotTest-680474775 None] Volume volume-191646c7-c03f-48c1-b780-e89186368032 (191646c7-c03f-48c1-b780-e89186368032): created successfully Jul 30 16:59:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-dcd4ecbc-d2e1-4859-bb47-889b09d3b2e7 tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9eae4fc-df09-40aa-ab30-2c6a554e8bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-dcd4ecbc-d2e1-4859-bb47-889b09d3b2e7 tempest-CreateVolumesFromSnapshotTest-680474775 None] Flow 'volume_create_manager' (4b0b32db-3440-42be-8433-50f962aa2776) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:59:25 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-7fca6bbf-4804-4e10-9f6a-38ee1c6defe6 tempest-VolumesListAdminTestJSON-1298618000 None] Created reservations ['86edab90-e6b7-4793-919c-45f3c06e0223', 'eeb5d0c5-e02c-4c0b-a0fc-ee8fb69dbea4', 'b050403b-8269-4da1-921a-9678fe221781', '868ec8bb-6e64-4b0f-92cc-b4cfe13a25e0'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:59:25 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-dcd4ecbc-d2e1-4859-bb47-889b09d3b2e7 tempest-CreateVolumesFromSnapshotTest-680474775 None] Created volume successfully. Jul 30 16:59:25 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-d30865b3-4cbe-45c1-be84-cfb8ec77baeb tempest-VolumesListAdminTestJSON-1764916613 None] Created reservations ['c1b8bbd3-4df7-4aab-9050-3ddd07010b0e', 'fa650c41-5048-4e5e-970d-3fbf3e346d14', '34ebe642-bbd2-4d94-b5e2-d196b6c3967b', '69c796ca-5f39-4715-907f-78b4dc1983a2'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:59:25 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5a6d9d0-bc6d-4c33-92bb-fdb213ba1aa6 tempest-CreateVolumesFromSnapshotTest-680474775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:59:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-e5a6d9d0-bc6d-4c33-92bb-fdb213ba1aa6 tempest-CreateVolumesFromSnapshotTest-680474775 None] Flow 'volume_create_manager' (8bc8a799-69f8-4d8d-80a5-77edb12ab409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:59:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-e5a6d9d0-bc6d-4c33-92bb-fdb213ba1aa6 tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c45618c7-0c45-45f5-b528-ca41a807f8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-e5a6d9d0-bc6d-4c33-92bb-fdb213ba1aa6 tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c45618c7-0c45-45f5-b528-ca41a807f8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:59:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1724797031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ee8ea5c-c177-4884-b89b-276f8194ddab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='239cc45a4d0a43fbad63a079f0226941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:59:25Z,use_quota=True,user_id='a313a837d71b434685b99ff185a11499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-e5a6d9d0-bc6d-4c33-92bb-fdb213ba1aa6 tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f76f0c5-52a5-4199-b294-a746b83fd4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-e5a6d9d0-bc6d-4c33-92bb-fdb213ba1aa6 tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f76f0c5-52a5-4199-b294-a746b83fd4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-e5a6d9d0-bc6d-4c33-92bb-fdb213ba1aa6 tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f75b4403-3fb9-4318-b85f-6a60778a0a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-e5a6d9d0-bc6d-4c33-92bb-fdb213ba1aa6 tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f75b4403-3fb9-4318-b85f-6a60778a0a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ee8ea5c-c177-4884-b89b-276f8194ddab', 'volume_name': 'volume-4ee8ea5c-c177-4884-b89b-276f8194ddab', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-e5a6d9d0-bc6d-4c33-92bb-fdb213ba1aa6 tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c4a203d-d881-444d-ae7d-1880bbd2050a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-e5a6d9d0-bc6d-4c33-92bb-fdb213ba1aa6 tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c4a203d-d881-444d-ae7d-1880bbd2050a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-e5a6d9d0-bc6d-4c33-92bb-fdb213ba1aa6 tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d31a991c-cfd5-4ac9-a69c-c33756e839ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:25 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-e5a6d9d0-bc6d-4c33-92bb-fdb213ba1aa6 tempest-CreateVolumesFromSnapshotTest-680474775 None] Volume 4ee8ea5c-c177-4884-b89b-276f8194ddab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ee8ea5c-c177-4884-b89b-276f8194ddab', 'volume_size': 1} Jul 30 16:59:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-e5a6d9d0-bc6d-4c33-92bb-fdb213ba1aa6 tempest-CreateVolumesFromSnapshotTest-680474775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7fca6bbf-4804-4e10-9f6a-38ee1c6defe6 tempest-VolumesListAdminTestJSON-1298618000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7fca6bbf-4804-4e10-9f6a-38ee1c6defe6 tempest-VolumesListAdminTestJSON-1298618000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:26 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7fca6bbf-4804-4e10-9f6a-38ee1c6defe6 tempest-VolumesListAdminTestJSON-1298618000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:59:26 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7fca6bbf-4804-4e10-9f6a-38ee1c6defe6 tempest-VolumesListAdminTestJSON-1298618000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:59:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7fca6bbf-4804-4e10-9f6a-38ee1c6defe6 tempest-VolumesListAdminTestJSON-1298618000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7fca6bbf-4804-4e10-9f6a-38ee1c6defe6 tempest-VolumesListAdminTestJSON-1298618000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:26 devstack sudo[100507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:59:26 devstack sudo[100507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d30865b3-4cbe-45c1-be84-cfb8ec77baeb tempest-VolumesListAdminTestJSON-1764916613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d30865b3-4cbe-45c1-be84-cfb8ec77baeb tempest-VolumesListAdminTestJSON-1764916613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:26 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d30865b3-4cbe-45c1-be84-cfb8ec77baeb tempest-VolumesListAdminTestJSON-1764916613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:59:26 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d30865b3-4cbe-45c1-be84-cfb8ec77baeb tempest-VolumesListAdminTestJSON-1764916613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:59:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d30865b3-4cbe-45c1-be84-cfb8ec77baeb tempest-VolumesListAdminTestJSON-1764916613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d30865b3-4cbe-45c1-be84-cfb8ec77baeb tempest-VolumesListAdminTestJSON-1764916613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:26 devstack sudo[100509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:59:26 devstack sudo[100509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:26 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-963a3587-6ca8-4c65-9fc2-e9c816d47601 tempest-CreateVolumesFromSnapshotTest-680474775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:59:26 devstack sudo[100500]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-963a3587-6ca8-4c65-9fc2-e9c816d47601 tempest-CreateVolumesFromSnapshotTest-680474775 None] Flow 'volume_create_manager' (6bd38b76-1c6f-4f94-a0fc-98e278acaf1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:59:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-963a3587-6ca8-4c65-9fc2-e9c816d47601 tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d82faa99-68ac-49fd-acba-b136a9a276f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-114d8f24-f99d-4a91-8285-8341c6aa65de tempest-CreateVolumesFromSnapshotTest-680474775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-843deb5e-0e25-4d17-954c-bfe9ef1c1627 1073741824" returned: 0 in 1.810s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:26 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-71f91be2-af32-4c54-86ea-e8aec90113cc tempest-VolumesListAdminTestJSON-1298618000 None] Acquiring lock "cinder-a87e0bfc-fd8c-4d2c-905b-349cae054de2-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:59:26 devstack sudo[100507]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-963a3587-6ca8-4c65-9fc2-e9c816d47601 tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d82faa99-68ac-49fd-acba-b136a9a276f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1360485955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69c435ad-70da-4107-b517-98c84cdb5743,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='239cc45a4d0a43fbad63a079f0226941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:59:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:59:26Z,use_quota=True,user_id='a313a837d71b434685b99ff185a11499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-963a3587-6ca8-4c65-9fc2-e9c816d47601 tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8f2e7f0-6edf-40ea-8257-f17303a1e6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-963a3587-6ca8-4c65-9fc2-e9c816d47601 tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8f2e7f0-6edf-40ea-8257-f17303a1e6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-963a3587-6ca8-4c65-9fc2-e9c816d47601 tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0422901f-690e-437b-9eab-d1b04b2f0780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-963a3587-6ca8-4c65-9fc2-e9c816d47601 tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0422901f-690e-437b-9eab-d1b04b2f0780) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69c435ad-70da-4107-b517-98c84cdb5743', 'volume_name': 'volume-69c435ad-70da-4107-b517-98c84cdb5743', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-963a3587-6ca8-4c65-9fc2-e9c816d47601 tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f128f072-d451-4fb6-8df1-3263ed761b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-963a3587-6ca8-4c65-9fc2-e9c816d47601 tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f128f072-d451-4fb6-8df1-3263ed761b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-963a3587-6ca8-4c65-9fc2-e9c816d47601 tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6cbdc9b-aea8-4278-859a-110e9e477cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:26 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-963a3587-6ca8-4c65-9fc2-e9c816d47601 tempest-CreateVolumesFromSnapshotTest-680474775 None] Volume 69c435ad-70da-4107-b517-98c84cdb5743: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69c435ad-70da-4107-b517-98c84cdb5743', 'volume_size': 1} Jul 30 16:59:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-963a3587-6ca8-4c65-9fc2-e9c816d47601 tempest-CreateVolumesFromSnapshotTest-680474775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7fca6bbf-4804-4e10-9f6a-38ee1c6defe6 tempest-VolumesListAdminTestJSON-1298618000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.833s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:26 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-7fca6bbf-4804-4e10-9f6a-38ee1c6defe6 tempest-VolumesListAdminTestJSON-1298618000 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:59:26 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-71f91be2-af32-4c54-86ea-e8aec90113cc tempest-VolumesListAdminTestJSON-1298618000 None] Lock "cinder-a87e0bfc-fd8c-4d2c-905b-349cae054de2-delete_volume" acquired by "delete_volume" :: waited 0.200s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:59:26 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-7fca6bbf-4804-4e10-9f6a-38ee1c6defe6 tempest-VolumesListAdminTestJSON-1298618000 None] Deleted volume successfully. Jul 30 16:59:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-114d8f24-f99d-4a91-8285-8341c6aa65de tempest-CreateVolumesFromSnapshotTest-680474775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-843deb5e-0e25-4d17-954c-bfe9ef1c1627 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:27 devstack sudo[100514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-843deb5e-0e25-4d17-954c-bfe9ef1c1627 Jul 30 16:59:27 devstack sudo[100514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:27 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7fca6bbf-4804-4e10-9f6a-38ee1c6defe6 tempest-VolumesListAdminTestJSON-1298618000 None] Lock "cinder-219cb771-f58e-4ce4-8ff7-711097cc588f-delete_volume" released by "delete_volume" :: held 5.894s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:27 devstack sudo[100509]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d30865b3-4cbe-45c1-be84-cfb8ec77baeb tempest-VolumesListAdminTestJSON-1764916613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.892s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:27 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-d30865b3-4cbe-45c1-be84-cfb8ec77baeb tempest-VolumesListAdminTestJSON-1764916613 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:59:27 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-71f91be2-af32-4c54-86ea-e8aec90113cc tempest-VolumesListAdminTestJSON-1298618000 None] Acquiring lock "cinder-quobyte-a87e0bfc-fd8c-4d2c-905b-349cae054de2" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:59:27 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-d30865b3-4cbe-45c1-be84-cfb8ec77baeb tempest-VolumesListAdminTestJSON-1764916613 None] Deleted volume successfully. Jul 30 16:59:27 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-71f91be2-af32-4c54-86ea-e8aec90113cc tempest-VolumesListAdminTestJSON-1298618000 None] Lock "cinder-quobyte-a87e0bfc-fd8c-4d2c-905b-349cae054de2" acquired by "delete_volume" :: waited 0.049s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:59:27 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[313d799c-5bd7-42c0-9b77-b35e99af4bfa]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:59:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-71f91be2-af32-4c54-86ea-e8aec90113cc tempest-VolumesListAdminTestJSON-1298618000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a87e0bfc-fd8c-4d2c-905b-349cae054de2 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:27 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d30865b3-4cbe-45c1-be84-cfb8ec77baeb tempest-VolumesListAdminTestJSON-1764916613 None] Lock "cinder-b38e6901-b05b-41fc-a009-7248b021ee0f-delete_volume" released by "delete_volume" :: held 6.564s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:27 devstack sudo[100516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a87e0bfc-fd8c-4d2c-905b-349cae054de2 Jul 30 16:59:27 devstack sudo[100516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:27 devstack sudo[100514]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-114d8f24-f99d-4a91-8285-8341c6aa65de tempest-CreateVolumesFromSnapshotTest-680474775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-843deb5e-0e25-4d17-954c-bfe9ef1c1627" returned: 0 in 0.596s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:27 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-114d8f24-f99d-4a91-8285-8341c6aa65de tempest-CreateVolumesFromSnapshotTest-680474775 None] <== create_volume: return (2883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:59:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-114d8f24-f99d-4a91-8285-8341c6aa65de tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.890s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a68e81bc-0c12-4347-93c6-e631e7d69dda tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.447s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:27 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a68e81bc-0c12-4347-93c6-e631e7d69dda tempest-CreateVolumesFromSnapshotTest-680474775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-916182487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dcb3a63-7ad8-4bfb-bd6d-d9ed01e8140f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='239cc45a4d0a43fbad63a079f0226941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:59:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:59:23Z,use_quota=True,user_id='a313a837d71b434685b99ff185a11499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:59:27 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-a68e81bc-0c12-4347-93c6-e631e7d69dda tempest-CreateVolumesFromSnapshotTest-680474775 None] Creating volume 4dcb3a63-7ad8-4bfb-bd6d-d9ed01e8140f {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:59:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a68e81bc-0c12-4347-93c6-e631e7d69dda tempest-CreateVolumesFromSnapshotTest-680474775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a68e81bc-0c12-4347-93c6-e631e7d69dda tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:27 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a68e81bc-0c12-4347-93c6-e631e7d69dda tempest-CreateVolumesFromSnapshotTest-680474775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:59:27 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a68e81bc-0c12-4347-93c6-e631e7d69dda tempest-CreateVolumesFromSnapshotTest-680474775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:59:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a68e81bc-0c12-4347-93c6-e631e7d69dda tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:27 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a68e81bc-0c12-4347-93c6-e631e7d69dda tempest-CreateVolumesFromSnapshotTest-680474775 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:59:27 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-a68e81bc-0c12-4347-93c6-e631e7d69dda tempest-CreateVolumesFromSnapshotTest-680474775 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:59:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a68e81bc-0c12-4347-93c6-e631e7d69dda tempest-CreateVolumesFromSnapshotTest-680474775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-4dcb3a63-7ad8-4bfb-bd6d-d9ed01e8140f 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:27 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-114d8f24-f99d-4a91-8285-8341c6aa65de tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f410ea43-f22b-4c06-b950-4ce83e7abbd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-843deb5e-0e25-4d17-954c-bfe9ef1c1627', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:27 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-114d8f24-f99d-4a91-8285-8341c6aa65de tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8fefc44-d2e0-4703-84ce-7c88eb842a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:27 devstack sudo[100519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-4dcb3a63-7ad8-4bfb-bd6d-d9ed01e8140f 1073741824 Jul 30 16:59:27 devstack sudo[100519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:27 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-114d8f24-f99d-4a91-8285-8341c6aa65de tempest-CreateVolumesFromSnapshotTest-680474775 None] Volume volume-843deb5e-0e25-4d17-954c-bfe9ef1c1627 (843deb5e-0e25-4d17-954c-bfe9ef1c1627): created successfully Jul 30 16:59:27 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-114d8f24-f99d-4a91-8285-8341c6aa65de tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8fefc44-d2e0-4703-84ce-7c88eb842a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:27 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-114d8f24-f99d-4a91-8285-8341c6aa65de tempest-CreateVolumesFromSnapshotTest-680474775 None] Flow 'volume_create_manager' (540c88b9-f6fa-4730-98a5-069dcc52ad12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:59:27 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-114d8f24-f99d-4a91-8285-8341c6aa65de tempest-CreateVolumesFromSnapshotTest-680474775 None] Created volume successfully. Jul 30 16:59:28 devstack sudo[100516]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-71f91be2-af32-4c54-86ea-e8aec90113cc tempest-VolumesListAdminTestJSON-1298618000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a87e0bfc-fd8c-4d2c-905b-349cae054de2" returned: 0 in 1.090s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-71f91be2-af32-4c54-86ea-e8aec90113cc tempest-VolumesListAdminTestJSON-1298618000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a87e0bfc-fd8c-4d2c-905b-349cae054de2 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:28 devstack sudo[100526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a87e0bfc-fd8c-4d2c-905b-349cae054de2 Jul 30 16:59:28 devstack sudo[100526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:28 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-accffaf5-bc4a-4ac4-a2a8-6ecb254ee262 tempest-VolumesActionsTest-1280755332 None] Acquiring lock "cinder-f980cd79-ba0b-4a43-9339-e87a7849137f" by "attach_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:59:28 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-accffaf5-bc4a-4ac4-a2a8-6ecb254ee262 tempest-VolumesActionsTest-1280755332 None] Lock "cinder-f980cd79-ba0b-4a43-9339-e87a7849137f" acquired by "attach_volume" :: waited 0.039s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:59:28 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-accffaf5-bc4a-4ac4-a2a8-6ecb254ee262 tempest-VolumesActionsTest-1280755332 None] Attaching volume f980cd79-ba0b-4a43-9339-e87a7849137f to instance 6007f31d-3c27-419c-a1e3-15eff943e72f at mountpoint /dev/vdb on host None. Jul 30 16:59:28 devstack sudo[100519]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a68e81bc-0c12-4347-93c6-e631e7d69dda tempest-CreateVolumesFromSnapshotTest-680474775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-4dcb3a63-7ad8-4bfb-bd6d-d9ed01e8140f 1073741824" returned: 0 in 1.339s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:29 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-accffaf5-bc4a-4ac4-a2a8-6ecb254ee262 tempest-VolumesActionsTest-1280755332 None] Attach volume completed successfully. Jul 30 16:59:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a68e81bc-0c12-4347-93c6-e631e7d69dda tempest-CreateVolumesFromSnapshotTest-680474775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-4dcb3a63-7ad8-4bfb-bd6d-d9ed01e8140f {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:29 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-accffaf5-bc4a-4ac4-a2a8-6ecb254ee262 tempest-VolumesActionsTest-1280755332 None] Lock "cinder-f980cd79-ba0b-4a43-9339-e87a7849137f" released by "attach_volume" :: held 0.290s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:29 devstack sudo[100526]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-71f91be2-af32-4c54-86ea-e8aec90113cc tempest-VolumesListAdminTestJSON-1298618000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a87e0bfc-fd8c-4d2c-905b-349cae054de2" returned: 0 in 0.789s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:29 devstack sudo[100530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-4dcb3a63-7ad8-4bfb-bd6d-d9ed01e8140f Jul 30 16:59:29 devstack sudo[100530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:29 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-71f91be2-af32-4c54-86ea-e8aec90113cc tempest-VolumesListAdminTestJSON-1298618000 None] Lock "cinder-quobyte-a87e0bfc-fd8c-4d2c-905b-349cae054de2" released by "delete_volume" :: held 1.991s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:29 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-71f91be2-af32-4c54-86ea-e8aec90113cc tempest-VolumesListAdminTestJSON-1298618000 None] Created reservations ['349d34fb-b9a1-48ed-ad50-09bdf1234ee0', '60c250bb-d5d8-4d0f-a452-3ab73cd29067', '3876187a-a208-471e-b7af-b0efc5780b3e', '3948bd85-5a4f-4259-938c-b39fe476cda8'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:59:29 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ebef2508-dfa4-4f6e-8704-d2feb5e0ec86 tempest-VolumesActionsTest-1280755332 None] Acquiring lock "cinder-f980cd79-ba0b-4a43-9339-e87a7849137f-detach_volume" by "detach_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:59:29 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ebef2508-dfa4-4f6e-8704-d2feb5e0ec86 tempest-VolumesActionsTest-1280755332 None] Lock "cinder-f980cd79-ba0b-4a43-9339-e87a7849137f-detach_volume" acquired by "detach_volume" :: waited 0.068s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:59:29 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-ebef2508-dfa4-4f6e-8704-d2feb5e0ec86 tempest-VolumesActionsTest-1280755332 None] Detaching volume f980cd79-ba0b-4a43-9339-e87a7849137f from instance 6007f31d-3c27-419c-a1e3-15eff943e72f. Jul 30 16:59:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-71f91be2-af32-4c54-86ea-e8aec90113cc tempest-VolumesListAdminTestJSON-1298618000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-71f91be2-af32-4c54-86ea-e8aec90113cc tempest-VolumesListAdminTestJSON-1298618000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:29 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-71f91be2-af32-4c54-86ea-e8aec90113cc tempest-VolumesListAdminTestJSON-1298618000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:59:29 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-71f91be2-af32-4c54-86ea-e8aec90113cc tempest-VolumesListAdminTestJSON-1298618000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:59:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-71f91be2-af32-4c54-86ea-e8aec90113cc tempest-VolumesListAdminTestJSON-1298618000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-71f91be2-af32-4c54-86ea-e8aec90113cc tempest-VolumesListAdminTestJSON-1298618000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:29 devstack sudo[100532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:59:29 devstack sudo[100532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:29 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-ebef2508-dfa4-4f6e-8704-d2feb5e0ec86 tempest-VolumesActionsTest-1280755332 None] Detach volume completed successfully. Jul 30 16:59:29 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ebef2508-dfa4-4f6e-8704-d2feb5e0ec86 tempest-VolumesActionsTest-1280755332 None] Lock "cinder-f980cd79-ba0b-4a43-9339-e87a7849137f-detach_volume" released by "detach_volume" :: held 0.179s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:29 devstack sudo[100530]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a68e81bc-0c12-4347-93c6-e631e7d69dda tempest-CreateVolumesFromSnapshotTest-680474775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-4dcb3a63-7ad8-4bfb-bd6d-d9ed01e8140f" returned: 0 in 0.686s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:29 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a68e81bc-0c12-4347-93c6-e631e7d69dda tempest-CreateVolumesFromSnapshotTest-680474775 None] <== create_volume: return (2119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:59:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a68e81bc-0c12-4347-93c6-e631e7d69dda tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.123s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-e5a6d9d0-bc6d-4c33-92bb-fdb213ba1aa6 tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.796s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:29 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-e5a6d9d0-bc6d-4c33-92bb-fdb213ba1aa6 tempest-CreateVolumesFromSnapshotTest-680474775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:59:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1724797031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ee8ea5c-c177-4884-b89b-276f8194ddab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='239cc45a4d0a43fbad63a079f0226941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:59:25Z,use_quota=True,user_id='a313a837d71b434685b99ff185a11499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:59:29 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-e5a6d9d0-bc6d-4c33-92bb-fdb213ba1aa6 tempest-CreateVolumesFromSnapshotTest-680474775 None] Creating volume 4ee8ea5c-c177-4884-b89b-276f8194ddab {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:59:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-e5a6d9d0-bc6d-4c33-92bb-fdb213ba1aa6 tempest-CreateVolumesFromSnapshotTest-680474775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-e5a6d9d0-bc6d-4c33-92bb-fdb213ba1aa6 tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:29 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-e5a6d9d0-bc6d-4c33-92bb-fdb213ba1aa6 tempest-CreateVolumesFromSnapshotTest-680474775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:59:29 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-e5a6d9d0-bc6d-4c33-92bb-fdb213ba1aa6 tempest-CreateVolumesFromSnapshotTest-680474775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:59:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-e5a6d9d0-bc6d-4c33-92bb-fdb213ba1aa6 tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:29 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-e5a6d9d0-bc6d-4c33-92bb-fdb213ba1aa6 tempest-CreateVolumesFromSnapshotTest-680474775 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:59:29 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-e5a6d9d0-bc6d-4c33-92bb-fdb213ba1aa6 tempest-CreateVolumesFromSnapshotTest-680474775 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:59:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e5a6d9d0-bc6d-4c33-92bb-fdb213ba1aa6 tempest-CreateVolumesFromSnapshotTest-680474775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-4ee8ea5c-c177-4884-b89b-276f8194ddab 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:29 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a68e81bc-0c12-4347-93c6-e631e7d69dda tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c50b8801-e9cb-4c32-8fbf-d32feaea3e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dcb3a63-7ad8-4bfb-bd6d-d9ed01e8140f', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:29 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a68e81bc-0c12-4347-93c6-e631e7d69dda tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7157efd4-62aa-45e0-8afb-31550486ebe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:29 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-a68e81bc-0c12-4347-93c6-e631e7d69dda tempest-CreateVolumesFromSnapshotTest-680474775 None] Volume volume-4dcb3a63-7ad8-4bfb-bd6d-d9ed01e8140f (4dcb3a63-7ad8-4bfb-bd6d-d9ed01e8140f): created successfully Jul 30 16:59:29 devstack sudo[100535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-4ee8ea5c-c177-4884-b89b-276f8194ddab 1073741824 Jul 30 16:59:29 devstack sudo[100535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:29 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a68e81bc-0c12-4347-93c6-e631e7d69dda tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7157efd4-62aa-45e0-8afb-31550486ebe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:29 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a68e81bc-0c12-4347-93c6-e631e7d69dda tempest-CreateVolumesFromSnapshotTest-680474775 None] Flow 'volume_create_manager' (be07d7f1-dde7-424e-82a9-57d6010344bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:59:29 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-a68e81bc-0c12-4347-93c6-e631e7d69dda tempest-CreateVolumesFromSnapshotTest-680474775 None] Created volume successfully. Jul 30 16:59:30 devstack sudo[100532]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-71f91be2-af32-4c54-86ea-e8aec90113cc tempest-VolumesListAdminTestJSON-1298618000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.689s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:30 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-71f91be2-af32-4c54-86ea-e8aec90113cc tempest-VolumesListAdminTestJSON-1298618000 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:59:30 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-71f91be2-af32-4c54-86ea-e8aec90113cc tempest-VolumesListAdminTestJSON-1298618000 None] Deleted volume successfully. Jul 30 16:59:30 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-71f91be2-af32-4c54-86ea-e8aec90113cc tempest-VolumesListAdminTestJSON-1298618000 None] Lock "cinder-a87e0bfc-fd8c-4d2c-905b-349cae054de2-delete_volume" released by "delete_volume" :: held 3.370s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:30 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-81378824-6c28-4b04-aaef-a2e9c4d93c1f tempest-VolumesListAdminTestJSON-1298618000 None] Acquiring lock "cinder-bb699bbd-958c-4ac6-9569-13f1dba39ac3-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:59:30 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-81378824-6c28-4b04-aaef-a2e9c4d93c1f tempest-VolumesListAdminTestJSON-1298618000 None] Lock "cinder-bb699bbd-958c-4ac6-9569-13f1dba39ac3-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:59:30 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-81378824-6c28-4b04-aaef-a2e9c4d93c1f tempest-VolumesListAdminTestJSON-1298618000 None] Acquiring lock "cinder-quobyte-bb699bbd-958c-4ac6-9569-13f1dba39ac3" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:59:30 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-81378824-6c28-4b04-aaef-a2e9c4d93c1f tempest-VolumesListAdminTestJSON-1298618000 None] Lock "cinder-quobyte-bb699bbd-958c-4ac6-9569-13f1dba39ac3" acquired by "delete_volume" :: waited 0.025s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:59:30 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9244f7-ebed-4bbd-bd31-822bed4cce46]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:59:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-81378824-6c28-4b04-aaef-a2e9c4d93c1f tempest-VolumesListAdminTestJSON-1298618000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bb699bbd-958c-4ac6-9569-13f1dba39ac3 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:31 devstack sudo[100535]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e5a6d9d0-bc6d-4c33-92bb-fdb213ba1aa6 tempest-CreateVolumesFromSnapshotTest-680474775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-4ee8ea5c-c177-4884-b89b-276f8194ddab 1073741824" returned: 0 in 1.265s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:31 devstack sudo[100545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bb699bbd-958c-4ac6-9569-13f1dba39ac3 Jul 30 16:59:31 devstack sudo[100545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e5a6d9d0-bc6d-4c33-92bb-fdb213ba1aa6 tempest-CreateVolumesFromSnapshotTest-680474775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-4ee8ea5c-c177-4884-b89b-276f8194ddab {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:31 devstack sudo[100552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-4ee8ea5c-c177-4884-b89b-276f8194ddab Jul 30 16:59:31 devstack sudo[100552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:31 devstack sudo[100552]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e5a6d9d0-bc6d-4c33-92bb-fdb213ba1aa6 tempest-CreateVolumesFromSnapshotTest-680474775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-4ee8ea5c-c177-4884-b89b-276f8194ddab" returned: 0 in 0.597s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:31 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-e5a6d9d0-bc6d-4c33-92bb-fdb213ba1aa6 tempest-CreateVolumesFromSnapshotTest-680474775 None] <== create_volume: return (1952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:59:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-e5a6d9d0-bc6d-4c33-92bb-fdb213ba1aa6 tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.960s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-963a3587-6ca8-4c65-9fc2-e9c816d47601 tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.823s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:31 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-963a3587-6ca8-4c65-9fc2-e9c816d47601 tempest-CreateVolumesFromSnapshotTest-680474775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1360485955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69c435ad-70da-4107-b517-98c84cdb5743,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='239cc45a4d0a43fbad63a079f0226941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:59:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:59:26Z,use_quota=True,user_id='a313a837d71b434685b99ff185a11499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:59:31 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-963a3587-6ca8-4c65-9fc2-e9c816d47601 tempest-CreateVolumesFromSnapshotTest-680474775 None] Creating volume 69c435ad-70da-4107-b517-98c84cdb5743 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:59:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-963a3587-6ca8-4c65-9fc2-e9c816d47601 tempest-CreateVolumesFromSnapshotTest-680474775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-963a3587-6ca8-4c65-9fc2-e9c816d47601 tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:31 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-963a3587-6ca8-4c65-9fc2-e9c816d47601 tempest-CreateVolumesFromSnapshotTest-680474775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:59:31 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-963a3587-6ca8-4c65-9fc2-e9c816d47601 tempest-CreateVolumesFromSnapshotTest-680474775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:59:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-963a3587-6ca8-4c65-9fc2-e9c816d47601 tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:31 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-963a3587-6ca8-4c65-9fc2-e9c816d47601 tempest-CreateVolumesFromSnapshotTest-680474775 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:59:31 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-963a3587-6ca8-4c65-9fc2-e9c816d47601 tempest-CreateVolumesFromSnapshotTest-680474775 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:59:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-963a3587-6ca8-4c65-9fc2-e9c816d47601 tempest-CreateVolumesFromSnapshotTest-680474775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-69c435ad-70da-4107-b517-98c84cdb5743 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:31 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-e5a6d9d0-bc6d-4c33-92bb-fdb213ba1aa6 tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d31a991c-cfd5-4ac9-a69c-c33756e839ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ee8ea5c-c177-4884-b89b-276f8194ddab', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:31 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-e5a6d9d0-bc6d-4c33-92bb-fdb213ba1aa6 tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfb8f00c-e150-442a-bfef-ec4fdb1ede06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:31 devstack sudo[100545]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-81378824-6c28-4b04-aaef-a2e9c4d93c1f tempest-VolumesListAdminTestJSON-1298618000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bb699bbd-958c-4ac6-9569-13f1dba39ac3" returned: 0 in 0.957s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-81378824-6c28-4b04-aaef-a2e9c4d93c1f tempest-VolumesListAdminTestJSON-1298618000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bb699bbd-958c-4ac6-9569-13f1dba39ac3 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:31 devstack sudo[100574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-69c435ad-70da-4107-b517-98c84cdb5743 1073741824 Jul 30 16:59:31 devstack sudo[100574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:31 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-e5a6d9d0-bc6d-4c33-92bb-fdb213ba1aa6 tempest-CreateVolumesFromSnapshotTest-680474775 None] Volume volume-4ee8ea5c-c177-4884-b89b-276f8194ddab (4ee8ea5c-c177-4884-b89b-276f8194ddab): created successfully Jul 30 16:59:31 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-e5a6d9d0-bc6d-4c33-92bb-fdb213ba1aa6 tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfb8f00c-e150-442a-bfef-ec4fdb1ede06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:31 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-e5a6d9d0-bc6d-4c33-92bb-fdb213ba1aa6 tempest-CreateVolumesFromSnapshotTest-680474775 None] Flow 'volume_create_manager' (8bc8a799-69f8-4d8d-80a5-77edb12ab409) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:59:31 devstack sudo[100575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bb699bbd-958c-4ac6-9569-13f1dba39ac3 Jul 30 16:59:31 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:31 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-e5a6d9d0-bc6d-4c33-92bb-fdb213ba1aa6 tempest-CreateVolumesFromSnapshotTest-680474775 None] Created volume successfully. Jul 30 16:59:32 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-81378824-6c28-4b04-aaef-a2e9c4d93c1f tempest-VolumesListAdminTestJSON-1298618000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bb699bbd-958c-4ac6-9569-13f1dba39ac3" returned: 0 in 0.646s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:32 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-81378824-6c28-4b04-aaef-a2e9c4d93c1f tempest-VolumesListAdminTestJSON-1298618000 None] Lock "cinder-quobyte-bb699bbd-958c-4ac6-9569-13f1dba39ac3" released by "delete_volume" :: held 1.696s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:32 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-81378824-6c28-4b04-aaef-a2e9c4d93c1f tempest-VolumesListAdminTestJSON-1298618000 None] Created reservations ['a4dee449-d275-4396-98b0-352354bef590', 'a4c5fb48-f18b-4e41-8a59-84647f293665', 'dc45067d-ac4d-4d68-89dc-552bac54fc57', '40e10c13-7c27-414f-9552-5ebc1dfd73e2'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:59:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-81378824-6c28-4b04-aaef-a2e9c4d93c1f tempest-VolumesListAdminTestJSON-1298618000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-81378824-6c28-4b04-aaef-a2e9c4d93c1f tempest-VolumesListAdminTestJSON-1298618000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:32 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-81378824-6c28-4b04-aaef-a2e9c4d93c1f tempest-VolumesListAdminTestJSON-1298618000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:59:32 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-81378824-6c28-4b04-aaef-a2e9c4d93c1f tempest-VolumesListAdminTestJSON-1298618000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:59:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-81378824-6c28-4b04-aaef-a2e9c4d93c1f tempest-VolumesListAdminTestJSON-1298618000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-81378824-6c28-4b04-aaef-a2e9c4d93c1f tempest-VolumesListAdminTestJSON-1298618000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:32 devstack sudo[100584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:59:32 devstack sudo[100584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:32 devstack sudo[100574]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-963a3587-6ca8-4c65-9fc2-e9c816d47601 tempest-CreateVolumesFromSnapshotTest-680474775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-69c435ad-70da-4107-b517-98c84cdb5743 1073741824" returned: 0 in 1.186s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-963a3587-6ca8-4c65-9fc2-e9c816d47601 tempest-CreateVolumesFromSnapshotTest-680474775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-69c435ad-70da-4107-b517-98c84cdb5743 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:33 devstack sudo[100587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-69c435ad-70da-4107-b517-98c84cdb5743 Jul 30 16:59:33 devstack sudo[100587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:33 devstack sudo[100584]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-81378824-6c28-4b04-aaef-a2e9c4d93c1f tempest-VolumesListAdminTestJSON-1298618000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.525s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:33 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-81378824-6c28-4b04-aaef-a2e9c4d93c1f tempest-VolumesListAdminTestJSON-1298618000 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:59:33 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-81378824-6c28-4b04-aaef-a2e9c4d93c1f tempest-VolumesListAdminTestJSON-1298618000 None] Deleted volume successfully. Jul 30 16:59:33 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-81378824-6c28-4b04-aaef-a2e9c4d93c1f tempest-VolumesListAdminTestJSON-1298618000 None] Lock "cinder-bb699bbd-958c-4ac6-9569-13f1dba39ac3-delete_volume" released by "delete_volume" :: held 2.785s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:33 devstack sudo[100587]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-963a3587-6ca8-4c65-9fc2-e9c816d47601 tempest-CreateVolumesFromSnapshotTest-680474775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-69c435ad-70da-4107-b517-98c84cdb5743" returned: 0 in 0.606s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:33 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-963a3587-6ca8-4c65-9fc2-e9c816d47601 tempest-CreateVolumesFromSnapshotTest-680474775 None] <== create_volume: return (1922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:59:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-963a3587-6ca8-4c65-9fc2-e9c816d47601 tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.931s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:33 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-963a3587-6ca8-4c65-9fc2-e9c816d47601 tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6cbdc9b-aea8-4278-859a-110e9e477cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69c435ad-70da-4107-b517-98c84cdb5743', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:33 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-963a3587-6ca8-4c65-9fc2-e9c816d47601 tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (702447ac-176d-4276-b232-a2abfd9a0b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:33 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-963a3587-6ca8-4c65-9fc2-e9c816d47601 tempest-CreateVolumesFromSnapshotTest-680474775 None] Volume volume-69c435ad-70da-4107-b517-98c84cdb5743 (69c435ad-70da-4107-b517-98c84cdb5743): created successfully Jul 30 16:59:33 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-963a3587-6ca8-4c65-9fc2-e9c816d47601 tempest-CreateVolumesFromSnapshotTest-680474775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (702447ac-176d-4276-b232-a2abfd9a0b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:33 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-963a3587-6ca8-4c65-9fc2-e9c816d47601 tempest-CreateVolumesFromSnapshotTest-680474775 None] Flow 'volume_create_manager' (6bd38b76-1c6f-4f94-a0fc-98e278acaf1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:59:33 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-963a3587-6ca8-4c65-9fc2-e9c816d47601 tempest-CreateVolumesFromSnapshotTest-680474775 None] Created volume successfully. Jul 30 16:59:33 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:SELECT=95,cinder:INSERT=30,cinder:UPDATE=95,cinder:DELETE=15 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:59:34 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7543f594-2dcf-4721-82f1-141b00badbe0 tempest-CreateVolumesFromSnapshotTest-680474775 None] Acquiring lock "cinder-69c435ad-70da-4107-b517-98c84cdb5743-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:59:34 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7543f594-2dcf-4721-82f1-141b00badbe0 tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "cinder-69c435ad-70da-4107-b517-98c84cdb5743-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:59:34 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7543f594-2dcf-4721-82f1-141b00badbe0 tempest-CreateVolumesFromSnapshotTest-680474775 None] Acquiring lock "cinder-quobyte-69c435ad-70da-4107-b517-98c84cdb5743" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:59:34 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7543f594-2dcf-4721-82f1-141b00badbe0 tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "cinder-quobyte-69c435ad-70da-4107-b517-98c84cdb5743" acquired by "delete_volume" :: waited 0.031s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:59:34 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a9b558-b152-4ea7-834d-2532c9d4aac2]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:59:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7543f594-2dcf-4721-82f1-141b00badbe0 tempest-CreateVolumesFromSnapshotTest-680474775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-69c435ad-70da-4107-b517-98c84cdb5743 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:34 devstack sudo[100616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-69c435ad-70da-4107-b517-98c84cdb5743 Jul 30 16:59:34 devstack sudo[100616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:34 devstack sudo[100616]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7543f594-2dcf-4721-82f1-141b00badbe0 tempest-CreateVolumesFromSnapshotTest-680474775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-69c435ad-70da-4107-b517-98c84cdb5743" returned: 0 in 0.506s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7543f594-2dcf-4721-82f1-141b00badbe0 tempest-CreateVolumesFromSnapshotTest-680474775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-69c435ad-70da-4107-b517-98c84cdb5743 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:34 devstack sudo[100621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-69c435ad-70da-4107-b517-98c84cdb5743 Jul 30 16:59:34 devstack sudo[100621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:35 devstack sudo[100621]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7543f594-2dcf-4721-82f1-141b00badbe0 tempest-CreateVolumesFromSnapshotTest-680474775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-69c435ad-70da-4107-b517-98c84cdb5743" returned: 0 in 0.416s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:35 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7543f594-2dcf-4721-82f1-141b00badbe0 tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "cinder-quobyte-69c435ad-70da-4107-b517-98c84cdb5743" released by "delete_volume" :: held 0.994s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:35 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:SELECT=88,cinder:UPDATE=129,cinder:DELETE=9,cinder:INSERT=26 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:59:35 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-7543f594-2dcf-4721-82f1-141b00badbe0 tempest-CreateVolumesFromSnapshotTest-680474775 None] Created reservations ['bea4608a-ee43-4000-9a53-f7c4d822fb65', '7a86572f-fc4f-4cf6-a898-692238f24d1c', '4206b91f-72ee-479a-b4d4-2730a1df95a5', '380c301b-f582-4aad-8168-1cdf20142792'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:59:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7543f594-2dcf-4721-82f1-141b00badbe0 tempest-CreateVolumesFromSnapshotTest-680474775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7543f594-2dcf-4721-82f1-141b00badbe0 tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:35 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7543f594-2dcf-4721-82f1-141b00badbe0 tempest-CreateVolumesFromSnapshotTest-680474775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:59:35 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7543f594-2dcf-4721-82f1-141b00badbe0 tempest-CreateVolumesFromSnapshotTest-680474775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:59:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7543f594-2dcf-4721-82f1-141b00badbe0 tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7543f594-2dcf-4721-82f1-141b00badbe0 tempest-CreateVolumesFromSnapshotTest-680474775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:35 devstack sudo[100627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:59:35 devstack sudo[100627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:35 devstack sudo[100627]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7543f594-2dcf-4721-82f1-141b00badbe0 tempest-CreateVolumesFromSnapshotTest-680474775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.364s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:35 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-7543f594-2dcf-4721-82f1-141b00badbe0 tempest-CreateVolumesFromSnapshotTest-680474775 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:59:35 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-7543f594-2dcf-4721-82f1-141b00badbe0 tempest-CreateVolumesFromSnapshotTest-680474775 None] Deleted volume successfully. Jul 30 16:59:35 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7543f594-2dcf-4721-82f1-141b00badbe0 tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "cinder-69c435ad-70da-4107-b517-98c84cdb5743-delete_volume" released by "delete_volume" :: held 1.861s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:36 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d3abd3c2-bf9b-45e8-803f-a13b782ed073 tempest-CreateVolumesFromSnapshotTest-680474775 None] Acquiring lock "cinder-4ee8ea5c-c177-4884-b89b-276f8194ddab-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:59:36 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d3abd3c2-bf9b-45e8-803f-a13b782ed073 tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "cinder-4ee8ea5c-c177-4884-b89b-276f8194ddab-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:59:36 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d3abd3c2-bf9b-45e8-803f-a13b782ed073 tempest-CreateVolumesFromSnapshotTest-680474775 None] Acquiring lock "cinder-quobyte-4ee8ea5c-c177-4884-b89b-276f8194ddab" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:59:36 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d3abd3c2-bf9b-45e8-803f-a13b782ed073 tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "cinder-quobyte-4ee8ea5c-c177-4884-b89b-276f8194ddab" acquired by "delete_volume" :: waited 0.024s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:59:36 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e22a995-eed4-4d98-a48b-f50facf56dc8]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:59:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d3abd3c2-bf9b-45e8-803f-a13b782ed073 tempest-CreateVolumesFromSnapshotTest-680474775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-4ee8ea5c-c177-4884-b89b-276f8194ddab {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:36 devstack sudo[100633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-4ee8ea5c-c177-4884-b89b-276f8194ddab Jul 30 16:59:36 devstack sudo[100633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:37 devstack sudo[100633]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d3abd3c2-bf9b-45e8-803f-a13b782ed073 tempest-CreateVolumesFromSnapshotTest-680474775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-4ee8ea5c-c177-4884-b89b-276f8194ddab" returned: 0 in 0.637s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d3abd3c2-bf9b-45e8-803f-a13b782ed073 tempest-CreateVolumesFromSnapshotTest-680474775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-4ee8ea5c-c177-4884-b89b-276f8194ddab {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:37 devstack sudo[100639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-4ee8ea5c-c177-4884-b89b-276f8194ddab Jul 30 16:59:37 devstack sudo[100639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:37 devstack sudo[100639]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d3abd3c2-bf9b-45e8-803f-a13b782ed073 tempest-CreateVolumesFromSnapshotTest-680474775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-4ee8ea5c-c177-4884-b89b-276f8194ddab" returned: 0 in 0.454s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:37 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d3abd3c2-bf9b-45e8-803f-a13b782ed073 tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "cinder-quobyte-4ee8ea5c-c177-4884-b89b-276f8194ddab" released by "delete_volume" :: held 1.179s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:37 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-d3abd3c2-bf9b-45e8-803f-a13b782ed073 tempest-CreateVolumesFromSnapshotTest-680474775 None] Created reservations ['b0fdcea2-a409-4cb7-8bf8-50120505d105', 'ec1812fb-5d5f-4e9e-b879-1d0e737dc53f', 'c0bb171f-703b-453d-968e-209297209a80', 'b11b2821-53ec-444a-b47d-371d10b7de6c'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:59:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d3abd3c2-bf9b-45e8-803f-a13b782ed073 tempest-CreateVolumesFromSnapshotTest-680474775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d3abd3c2-bf9b-45e8-803f-a13b782ed073 tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:38 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d3abd3c2-bf9b-45e8-803f-a13b782ed073 tempest-CreateVolumesFromSnapshotTest-680474775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:59:38 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d3abd3c2-bf9b-45e8-803f-a13b782ed073 tempest-CreateVolumesFromSnapshotTest-680474775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:59:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d3abd3c2-bf9b-45e8-803f-a13b782ed073 tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d3abd3c2-bf9b-45e8-803f-a13b782ed073 tempest-CreateVolumesFromSnapshotTest-680474775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:38 devstack sudo[100662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:59:38 devstack sudo[100662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:38 devstack sudo[100662]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d3abd3c2-bf9b-45e8-803f-a13b782ed073 tempest-CreateVolumesFromSnapshotTest-680474775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.479s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:38 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-d3abd3c2-bf9b-45e8-803f-a13b782ed073 tempest-CreateVolumesFromSnapshotTest-680474775 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:59:38 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-d3abd3c2-bf9b-45e8-803f-a13b782ed073 tempest-CreateVolumesFromSnapshotTest-680474775 None] Deleted volume successfully. Jul 30 16:59:38 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d3abd3c2-bf9b-45e8-803f-a13b782ed073 tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "cinder-4ee8ea5c-c177-4884-b89b-276f8194ddab-delete_volume" released by "delete_volume" :: held 2.145s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:38 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-0032a9cc-df77-43a6-8ef0-399d8e3b6fac tempest-CreateVolumesFromSnapshotTest-680474775 None] Acquiring lock "cinder-4dcb3a63-7ad8-4bfb-bd6d-d9ed01e8140f-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:59:38 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-0032a9cc-df77-43a6-8ef0-399d8e3b6fac tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "cinder-4dcb3a63-7ad8-4bfb-bd6d-d9ed01e8140f-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:59:38 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-0032a9cc-df77-43a6-8ef0-399d8e3b6fac tempest-CreateVolumesFromSnapshotTest-680474775 None] Acquiring lock "cinder-quobyte-4dcb3a63-7ad8-4bfb-bd6d-d9ed01e8140f" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:59:38 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-0032a9cc-df77-43a6-8ef0-399d8e3b6fac tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "cinder-quobyte-4dcb3a63-7ad8-4bfb-bd6d-d9ed01e8140f" acquired by "delete_volume" :: waited 0.025s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:59:38 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef90147a-76b3-46c4-847e-bbc3337a8184]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:59:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0032a9cc-df77-43a6-8ef0-399d8e3b6fac tempest-CreateVolumesFromSnapshotTest-680474775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-4dcb3a63-7ad8-4bfb-bd6d-d9ed01e8140f {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:39 devstack sudo[100670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-4dcb3a63-7ad8-4bfb-bd6d-d9ed01e8140f Jul 30 16:59:39 devstack sudo[100670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:39 devstack sudo[100670]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0032a9cc-df77-43a6-8ef0-399d8e3b6fac tempest-CreateVolumesFromSnapshotTest-680474775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-4dcb3a63-7ad8-4bfb-bd6d-d9ed01e8140f" returned: 0 in 0.450s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0032a9cc-df77-43a6-8ef0-399d8e3b6fac tempest-CreateVolumesFromSnapshotTest-680474775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-4dcb3a63-7ad8-4bfb-bd6d-d9ed01e8140f {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:39 devstack sudo[100675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-4dcb3a63-7ad8-4bfb-bd6d-d9ed01e8140f Jul 30 16:59:39 devstack sudo[100675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:39 devstack sudo[100675]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0032a9cc-df77-43a6-8ef0-399d8e3b6fac tempest-CreateVolumesFromSnapshotTest-680474775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-4dcb3a63-7ad8-4bfb-bd6d-d9ed01e8140f" returned: 0 in 0.336s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:39 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-0032a9cc-df77-43a6-8ef0-399d8e3b6fac tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "cinder-quobyte-4dcb3a63-7ad8-4bfb-bd6d-d9ed01e8140f" released by "delete_volume" :: held 0.855s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:39 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-0032a9cc-df77-43a6-8ef0-399d8e3b6fac tempest-CreateVolumesFromSnapshotTest-680474775 None] Created reservations ['56dc4e85-5c5e-45c7-8f50-48c1367a0f54', '6e8f5adb-ebcc-4f78-aded-13616f5f498e', 'd76cc732-3e86-4c3d-8e32-dd02868aecf6', '55e34e2e-2d10-4a76-a933-f5c4e4d70f34'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:59:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0032a9cc-df77-43a6-8ef0-399d8e3b6fac tempest-CreateVolumesFromSnapshotTest-680474775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0032a9cc-df77-43a6-8ef0-399d8e3b6fac tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:39 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-0032a9cc-df77-43a6-8ef0-399d8e3b6fac tempest-CreateVolumesFromSnapshotTest-680474775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:59:39 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-0032a9cc-df77-43a6-8ef0-399d8e3b6fac tempest-CreateVolumesFromSnapshotTest-680474775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:59:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0032a9cc-df77-43a6-8ef0-399d8e3b6fac tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0032a9cc-df77-43a6-8ef0-399d8e3b6fac tempest-CreateVolumesFromSnapshotTest-680474775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:39 devstack sudo[100679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:59:39 devstack sudo[100679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:40 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-86285991-79b2-43c9-801b-b88876592c0c tempest-CreateVolumesFromSnapshotTest-680474775 None] Acquiring lock "cinder-843deb5e-0e25-4d17-954c-bfe9ef1c1627-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:59:40 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-86285991-79b2-43c9-801b-b88876592c0c tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "cinder-843deb5e-0e25-4d17-954c-bfe9ef1c1627-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:59:40 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-86285991-79b2-43c9-801b-b88876592c0c tempest-CreateVolumesFromSnapshotTest-680474775 None] Acquiring lock "cinder-quobyte-843deb5e-0e25-4d17-954c-bfe9ef1c1627" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:59:40 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-86285991-79b2-43c9-801b-b88876592c0c tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "cinder-quobyte-843deb5e-0e25-4d17-954c-bfe9ef1c1627" acquired by "delete_volume" :: waited 0.025s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:59:40 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[710102f2-73ff-4c39-9695-43a5ad294ec1]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:59:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-86285991-79b2-43c9-801b-b88876592c0c tempest-CreateVolumesFromSnapshotTest-680474775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-843deb5e-0e25-4d17-954c-bfe9ef1c1627 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:40 devstack sudo[100679]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0032a9cc-df77-43a6-8ef0-399d8e3b6fac tempest-CreateVolumesFromSnapshotTest-680474775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.304s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:40 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-0032a9cc-df77-43a6-8ef0-399d8e3b6fac tempest-CreateVolumesFromSnapshotTest-680474775 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:59:40 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-0032a9cc-df77-43a6-8ef0-399d8e3b6fac tempest-CreateVolumesFromSnapshotTest-680474775 None] Deleted volume successfully. Jul 30 16:59:40 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-0032a9cc-df77-43a6-8ef0-399d8e3b6fac tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "cinder-4dcb3a63-7ad8-4bfb-bd6d-d9ed01e8140f-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:40 devstack sudo[100682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-843deb5e-0e25-4d17-954c-bfe9ef1c1627 Jul 30 16:59:40 devstack sudo[100682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:40 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:59:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] Flow 'volume_create_manager' (1467260b-4a33-421b-9a22-81310ede8aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:59:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0fb761e-c93c-400c-a6fd-ae47864074ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:40 devstack sudo[100682]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-86285991-79b2-43c9-801b-b88876592c0c tempest-CreateVolumesFromSnapshotTest-680474775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-843deb5e-0e25-4d17-954c-bfe9ef1c1627" returned: 0 in 0.733s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-86285991-79b2-43c9-801b-b88876592c0c tempest-CreateVolumesFromSnapshotTest-680474775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-843deb5e-0e25-4d17-954c-bfe9ef1c1627 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0fb761e-c93c-400c-a6fd-ae47864074ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:59:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-610223882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aaa9cea-96f7-49c5-947b-194a3304bc3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1d1f342b8dd4d07b859dea20547dd1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:59:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:59:41Z,use_quota=True,user_id='d546044634b647b6be4e77d520042bab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:41 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1780bf0a-0d56-4039-b824-e2febad04a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:41 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1780bf0a-0d56-4039-b824-e2febad04a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:41 devstack sudo[100720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-843deb5e-0e25-4d17-954c-bfe9ef1c1627 Jul 30 16:59:41 devstack sudo[100720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:41 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3ef456c-153e-4d33-950e-5e46476f3453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:41 devstack cinder-volume[88591]: DEBUG cinder.image.glance [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] Creating Keystone auth plugin from conf {{(pid=88591) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 30 16:59:41 devstack sudo[100720]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-86285991-79b2-43c9-801b-b88876592c0c tempest-CreateVolumesFromSnapshotTest-680474775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-843deb5e-0e25-4d17-954c-bfe9ef1c1627" returned: 0 in 0.437s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:41 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-86285991-79b2-43c9-801b-b88876592c0c tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "cinder-quobyte-843deb5e-0e25-4d17-954c-bfe9ef1c1627" released by "delete_volume" :: held 1.246s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:41 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3ef456c-153e-4d33-950e-5e46476f3453) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0aaa9cea-96f7-49c5-947b-194a3304bc3b', 'volume_name': 'volume-0aaa9cea-96f7-49c5-947b-194a3304bc3b', 'volume_size': 1, 'image_id': 'fb94d6e3-28d4-406f-8bad-19349d5f8454', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fb94d6e3-28d4-406f-8bad-19349d5f8454', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7e05c21dff7b441db433e2a7736519e9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fb94d6e3-28d4-406f-8bad-19349d5f8454', 'created_at': datetime.datetime(2026, 7, 30, 14, 42, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 42, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fb94d6e3-28d4-406f-8bad-19349d5f8454/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:41 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fae510f4-23a1-448f-b633-fdf8566413bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:41 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fae510f4-23a1-448f-b633-fdf8566413bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:41 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5614c76-eae9-4b7e-8ff0-3132acc5e711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:41 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] Volume 0aaa9cea-96f7-49c5-947b-194a3304bc3b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0aaa9cea-96f7-49c5-947b-194a3304bc3b', 'volume_size': 1, 'image_id': 'fb94d6e3-28d4-406f-8bad-19349d5f8454', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fb94d6e3-28d4-406f-8bad-19349d5f8454', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7e05c21dff7b441db433e2a7736519e9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fb94d6e3-28d4-406f-8bad-19349d5f8454', 'created_at': datetime.datetime(2026, 7, 30, 14, 42, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 42, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fb94d6e3-28d4-406f-8bad-19349d5f8454/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 30 16:59:41 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] Trying to clone 0aaa9cea-96f7-49c5-947b-194a3304bc3b from image fb94d6e3-28d4-406f-8bad-19349d5f8454 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fb94d6e3-28d4-406f-8bad-19349d5f8454', 'metadata': {}}]). {{(pid=88591) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 30 16:59:41 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-86285991-79b2-43c9-801b-b88876592c0c tempest-CreateVolumesFromSnapshotTest-680474775 None] Created reservations ['d6101e17-3daf-4865-8155-ec2c72ed274e', 'b0a83fb9-59df-4534-8580-ffb2707a0325', '7283702b-ff35-46c6-855b-166a5291a9f5', 'd43ec5ec-6076-4329-8a9e-c0b43c6f414b'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:59:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-86285991-79b2-43c9-801b-b88876592c0c tempest-CreateVolumesFromSnapshotTest-680474775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-86285991-79b2-43c9-801b-b88876592c0c tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:41 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-86285991-79b2-43c9-801b-b88876592c0c tempest-CreateVolumesFromSnapshotTest-680474775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:59:41 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-86285991-79b2-43c9-801b-b88876592c0c tempest-CreateVolumesFromSnapshotTest-680474775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:59:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-86285991-79b2-43c9-801b-b88876592c0c tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-86285991-79b2-43c9-801b-b88876592c0c tempest-CreateVolumesFromSnapshotTest-680474775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:41 devstack sudo[100750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:59:41 devstack sudo[100750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:42 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_ajov0cg6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88591) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 30 16:59:42 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] Image download 20.69 MB at 20.69 MB/s Jul 30 16:59:42 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6279b8b-1e75-495d-a889-948b7a7e4bb0]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:59:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_ajov0cg6devstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:42 devstack sudo[100750]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-86285991-79b2-43c9-801b-b88876592c0c tempest-CreateVolumesFromSnapshotTest-680474775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.391s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:42 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-86285991-79b2-43c9-801b-b88876592c0c tempest-CreateVolumesFromSnapshotTest-680474775 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:59:42 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-86285991-79b2-43c9-801b-b88876592c0c tempest-CreateVolumesFromSnapshotTest-680474775 None] Deleted volume successfully. Jul 30 16:59:42 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-86285991-79b2-43c9-801b-b88876592c0c tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "cinder-843deb5e-0e25-4d17-954c-bfe9ef1c1627-delete_volume" released by "delete_volume" :: held 2.166s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:42 devstack sudo[100765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_ajov0cg6devstack@QuobyteHD Jul 30 16:59:42 devstack sudo[100765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:42 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-da49a829-c7e9-464d-835c-3efc2b3827db tempest-CreateVolumesFromSnapshotTest-680474775 None] Acquiring lock "cinder-191646c7-c03f-48c1-b780-e89186368032-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:59:42 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-da49a829-c7e9-464d-835c-3efc2b3827db tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "cinder-191646c7-c03f-48c1-b780-e89186368032-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:59:42 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-da49a829-c7e9-464d-835c-3efc2b3827db tempest-CreateVolumesFromSnapshotTest-680474775 None] Acquiring lock "cinder-quobyte-191646c7-c03f-48c1-b780-e89186368032" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:59:42 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-da49a829-c7e9-464d-835c-3efc2b3827db tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "cinder-quobyte-191646c7-c03f-48c1-b780-e89186368032" acquired by "delete_volume" :: waited 0.018s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:59:42 devstack sudo[100765]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_ajov0cg6devstack@QuobyteHD" returned: 0 in 0.451s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:42 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] Temporary image fb94d6e3-28d4-406f-8bad-19349d5f8454 is fetched for user d546044634b647b6be4e77d520042bab. {{(pid=88591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 30 16:59:42 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b26093a-62ab-4000-8c65-e4f65c868fa9]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:59:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-da49a829-c7e9-464d-835c-3efc2b3827db tempest-CreateVolumesFromSnapshotTest-680474775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-191646c7-c03f-48c1-b780-e89186368032 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:42 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf90303-6882-44f0-8fda-86bc56f91864]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:59:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_ajov0cg6devstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:42 devstack sudo[100781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-191646c7-c03f-48c1-b780-e89186368032 Jul 30 16:59:42 devstack sudo[100781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:42 devstack sudo[100782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_ajov0cg6devstack@QuobyteHD Jul 30 16:59:42 devstack sudo[100782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:42 devstack sudo[100781]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-da49a829-c7e9-464d-835c-3efc2b3827db tempest-CreateVolumesFromSnapshotTest-680474775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-191646c7-c03f-48c1-b780-e89186368032" returned: 0 in 0.395s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-da49a829-c7e9-464d-835c-3efc2b3827db tempest-CreateVolumesFromSnapshotTest-680474775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-191646c7-c03f-48c1-b780-e89186368032 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:43 devstack sudo[100788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-191646c7-c03f-48c1-b780-e89186368032 Jul 30 16:59:43 devstack sudo[100788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:43 devstack sudo[100782]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_ajov0cg6devstack@QuobyteHD" returned: 0 in 0.379s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:43 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:59:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-610223882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aaa9cea-96f7-49c5-947b-194a3304bc3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1d1f342b8dd4d07b859dea20547dd1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:59:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:59:41Z,use_quota=True,user_id='d546044634b647b6be4e77d520042bab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:59:43 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] Creating volume 0aaa9cea-96f7-49c5-947b-194a3304bc3b {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:59:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:43 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:59:43 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:59:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:43 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:59:43 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 16:59:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0aaa9cea-96f7-49c5-947b-194a3304bc3b 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:43 devstack sudo[100793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0aaa9cea-96f7-49c5-947b-194a3304bc3b 1073741824 Jul 30 16:59:43 devstack sudo[100793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:43 devstack sudo[100788]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-da49a829-c7e9-464d-835c-3efc2b3827db tempest-CreateVolumesFromSnapshotTest-680474775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-191646c7-c03f-48c1-b780-e89186368032" returned: 0 in 0.297s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:43 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-da49a829-c7e9-464d-835c-3efc2b3827db tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "cinder-quobyte-191646c7-c03f-48c1-b780-e89186368032" released by "delete_volume" :: held 0.780s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:43 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-da49a829-c7e9-464d-835c-3efc2b3827db tempest-CreateVolumesFromSnapshotTest-680474775 None] Created reservations ['4c67f21f-a262-46d2-bd9f-261a2d1b2375', '8c2d1554-b5e1-456b-8414-64f29ed32e72', 'a2f68001-17b7-44be-9d0b-e2a8af2ce581', 'df0109a9-8dab-4a24-8708-ebbd30b323f3'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:59:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-da49a829-c7e9-464d-835c-3efc2b3827db tempest-CreateVolumesFromSnapshotTest-680474775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-da49a829-c7e9-464d-835c-3efc2b3827db tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:43 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-da49a829-c7e9-464d-835c-3efc2b3827db tempest-CreateVolumesFromSnapshotTest-680474775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:59:43 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-da49a829-c7e9-464d-835c-3efc2b3827db tempest-CreateVolumesFromSnapshotTest-680474775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:59:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-da49a829-c7e9-464d-835c-3efc2b3827db tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-da49a829-c7e9-464d-835c-3efc2b3827db tempest-CreateVolumesFromSnapshotTest-680474775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:43 devstack sudo[100803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:59:43 devstack sudo[100803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:43 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-46cc1fbf-79be-4561-9b1c-ecf9e875d169 tempest-CreateVolumesFromSnapshotTest-680474775 None] Acquiring lock "cinder-6472c758-b270-4e68-8271-bc7e62557c8b-delete_snapshot" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:59:43 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-46cc1fbf-79be-4561-9b1c-ecf9e875d169 tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "cinder-6472c758-b270-4e68-8271-bc7e62557c8b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:59:43 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-46cc1fbf-79be-4561-9b1c-ecf9e875d169 tempest-CreateVolumesFromSnapshotTest-680474775 None] Acquiring lock "cinder-quobyte-49698b31-940b-4c00-a4bd-2b8ed9fe778d" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:59:43 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-46cc1fbf-79be-4561-9b1c-ecf9e875d169 tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "cinder-quobyte-49698b31-940b-4c00-a4bd-2b8ed9fe778d" acquired by "delete_snapshot" :: waited 0.044s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:59:43 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-46cc1fbf-79be-4561-9b1c-ecf9e875d169 tempest-CreateVolumesFromSnapshotTest-680474775 None] Acquiring lock "cinder-quobyte-6472c758-b270-4e68-8271-bc7e62557c8b" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:59:43 devstack sudo[100793]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0aaa9cea-96f7-49c5-947b-194a3304bc3b 1073741824" returned: 0 in 0.778s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:43 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-46cc1fbf-79be-4561-9b1c-ecf9e875d169 tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "cinder-quobyte-6472c758-b270-4e68-8271-bc7e62557c8b" acquired by "_delete_snapshot" :: waited 0.060s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:59:43 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-46cc1fbf-79be-4561-9b1c-ecf9e875d169 tempest-CreateVolumesFromSnapshotTest-680474775 None] Deleting offline snapshot 6472c758-b270-4e68-8271-bc7e62557c8b of volume 49698b31-940b-4c00-a4bd-2b8ed9fe778d {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:59:43 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-46cc1fbf-79be-4561-9b1c-ecf9e875d169 tempest-CreateVolumesFromSnapshotTest-680474775 None] snapshot_file for this snap is: volume-49698b31-940b-4c00-a4bd-2b8ed9fe778d.6472c758-b270-4e68-8271-bc7e62557c8b {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:59:43 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5835c48-d79f-4b1a-a2b7-2e854a0ed0a2]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:59:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-46cc1fbf-79be-4561-9b1c-ecf9e875d169 tempest-CreateVolumesFromSnapshotTest-680474775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-49698b31-940b-4c00-a4bd-2b8ed9fe778d.6472c758-b270-4e68-8271-bc7e62557c8b {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0aaa9cea-96f7-49c5-947b-194a3304bc3b {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:44 devstack sudo[100803]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-da49a829-c7e9-464d-835c-3efc2b3827db tempest-CreateVolumesFromSnapshotTest-680474775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.490s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:44 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-da49a829-c7e9-464d-835c-3efc2b3827db tempest-CreateVolumesFromSnapshotTest-680474775 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:59:44 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-da49a829-c7e9-464d-835c-3efc2b3827db tempest-CreateVolumesFromSnapshotTest-680474775 None] Deleted volume successfully. Jul 30 16:59:44 devstack sudo[100807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0aaa9cea-96f7-49c5-947b-194a3304bc3b Jul 30 16:59:44 devstack sudo[100807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:44 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-da49a829-c7e9-464d-835c-3efc2b3827db tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "cinder-191646c7-c03f-48c1-b780-e89186368032-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:44 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-1184aee6-6a46-4c64-92bd-2992d4e54ba5 tempest-VolumesActionsTest-1280755332 None] Acquiring lock "cinder-f980cd79-ba0b-4a43-9339-e87a7849137f" by "attach_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:59:44 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-1184aee6-6a46-4c64-92bd-2992d4e54ba5 tempest-VolumesActionsTest-1280755332 None] Lock "cinder-f980cd79-ba0b-4a43-9339-e87a7849137f" acquired by "attach_volume" :: waited 0.023s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:59:44 devstack sudo[100806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-49698b31-940b-4c00-a4bd-2b8ed9fe778d.6472c758-b270-4e68-8271-bc7e62557c8b Jul 30 16:59:44 devstack sudo[100806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:44 devstack sudo[100807]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0aaa9cea-96f7-49c5-947b-194a3304bc3b" returned: 0 in 0.396s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:44 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] <== create_volume: return (1346ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:59:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.352s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:44 devstack cinder-volume[88591]: DEBUG cinder.volume.volume_utils [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] Attempting download of fb94d6e3-28d4-406f-8bad-19349d5f8454 ((None, [{'url': 'file:///opt/stack/data/glance/images/fb94d6e3-28d4-406f-8bad-19349d5f8454', 'metadata': {}}])) to volume 0aaa9cea-96f7-49c5-947b-194a3304bc3b. {{(pid=88591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 30 16:59:44 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-1184aee6-6a46-4c64-92bd-2992d4e54ba5 tempest-VolumesActionsTest-1280755332 None] Attaching volume f980cd79-ba0b-4a43-9339-e87a7849137f to instance 24b5e0bb-2f2a-46ff-8470-586b910be001 at mountpoint /dev/vdb on host None. Jul 30 16:59:44 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-1184aee6-6a46-4c64-92bd-2992d4e54ba5 tempest-VolumesActionsTest-1280755332 None] Attach volume completed successfully. Jul 30 16:59:44 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-1184aee6-6a46-4c64-92bd-2992d4e54ba5 tempest-VolumesActionsTest-1280755332 None] Lock "cinder-f980cd79-ba0b-4a43-9339-e87a7849137f" released by "attach_volume" :: held 0.185s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:44 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[4604b815-0de1-44b9-8c9d-c3d8d34611bc]: (4, 'raw') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:59:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fb94d6e3-28d4-406f-8bad-19349d5f8454_iw3crd4r {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:44 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-72548dc2-f5db-4c8b-b894-8566544f5dd2 tempest-VolumesActionsTest-1280755332 None] Acquiring lock "cinder-f980cd79-ba0b-4a43-9339-e87a7849137f-detach_volume" by "detach_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:59:44 devstack sudo[100811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fb94d6e3-28d4-406f-8bad-19349d5f8454_iw3crd4r Jul 30 16:59:44 devstack sudo[100811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:44 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-72548dc2-f5db-4c8b-b894-8566544f5dd2 tempest-VolumesActionsTest-1280755332 None] Lock "cinder-f980cd79-ba0b-4a43-9339-e87a7849137f-detach_volume" acquired by "detach_volume" :: waited 0.055s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:59:44 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-72548dc2-f5db-4c8b-b894-8566544f5dd2 tempest-VolumesActionsTest-1280755332 None] Detaching volume f980cd79-ba0b-4a43-9339-e87a7849137f from instance 24b5e0bb-2f2a-46ff-8470-586b910be001. Jul 30 16:59:44 devstack sudo[100806]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-46cc1fbf-79be-4561-9b1c-ecf9e875d169 tempest-CreateVolumesFromSnapshotTest-680474775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-49698b31-940b-4c00-a4bd-2b8ed9fe778d.6472c758-b270-4e68-8271-bc7e62557c8b" returned: 0 in 0.919s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:44 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-46cc1fbf-79be-4561-9b1c-ecf9e875d169 tempest-CreateVolumesFromSnapshotTest-680474775 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49698b31-940b-4c00-a4bd-2b8ed9fe778d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:59:44 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e271e6-3093-49e3-983d-18912d92d0b6]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:59:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-46cc1fbf-79be-4561-9b1c-ecf9e875d169 tempest-CreateVolumesFromSnapshotTest-680474775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-49698b31-940b-4c00-a4bd-2b8ed9fe778d {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:45 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-72548dc2-f5db-4c8b-b894-8566544f5dd2 tempest-VolumesActionsTest-1280755332 None] Detach volume completed successfully. Jul 30 16:59:45 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-72548dc2-f5db-4c8b-b894-8566544f5dd2 tempest-VolumesActionsTest-1280755332 None] Lock "cinder-f980cd79-ba0b-4a43-9339-e87a7849137f-detach_volume" released by "detach_volume" :: held 0.235s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:45 devstack sudo[100816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-49698b31-940b-4c00-a4bd-2b8ed9fe778d Jul 30 16:59:45 devstack sudo[100816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:45 devstack sudo[100811]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fb94d6e3-28d4-406f-8bad-19349d5f8454_iw3crd4r" returned: 0 in 0.632s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fb94d6e3-28d4-406f-8bad-19349d5f8454_iw3crd4r {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:45 devstack sudo[100834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fb94d6e3-28d4-406f-8bad-19349d5f8454_iw3crd4r Jul 30 16:59:45 devstack sudo[100834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:45 devstack sudo[100816]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-46cc1fbf-79be-4561-9b1c-ecf9e875d169 tempest-CreateVolumesFromSnapshotTest-680474775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-49698b31-940b-4c00-a4bd-2b8ed9fe778d" returned: 0 in 0.741s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-46cc1fbf-79be-4561-9b1c-ecf9e875d169 tempest-CreateVolumesFromSnapshotTest-680474775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-49698b31-940b-4c00-a4bd-2b8ed9fe778d.6472c758-b270-4e68-8271-bc7e62557c8b {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:45 devstack sudo[100834]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fb94d6e3-28d4-406f-8bad-19349d5f8454_iw3crd4r" returned: 1 in 0.601s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fb94d6e3-28d4-406f-8bad-19349d5f8454_iw3crd4r' failed. Not Retrying. {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 16:59:45 devstack sudo[100859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-49698b31-940b-4c00-a4bd-2b8ed9fe778d.6472c758-b270-4e68-8271-bc7e62557c8b Jul 30 16:59:45 devstack sudo[100859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:45 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[658d9093-cad5-4c39-887b-92ba0aef348f]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:59:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_ajov0cg6devstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:45 devstack sudo[100863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_ajov0cg6devstack@QuobyteHD Jul 30 16:59:46 devstack sudo[100863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:46 devstack sudo[100863]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_ajov0cg6devstack@QuobyteHD" returned: 0 in 0.541s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:46 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] fb94d6e3-28d4-406f-8bad-19349d5f8454 was qcow2, converting to qcow2 {{(pid=88591) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 30 16:59:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_ajov0cg6devstack@QuobyteHD /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0aaa9cea-96f7-49c5-947b-194a3304bc3b {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:46 devstack sudo[100859]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-46cc1fbf-79be-4561-9b1c-ecf9e875d169 tempest-CreateVolumesFromSnapshotTest-680474775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-49698b31-940b-4c00-a4bd-2b8ed9fe778d.6472c758-b270-4e68-8271-bc7e62557c8b" returned: 0 in 0.710s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-46cc1fbf-79be-4561-9b1c-ecf9e875d169 tempest-CreateVolumesFromSnapshotTest-680474775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-49698b31-940b-4c00-a4bd-2b8ed9fe778d.6472c758-b270-4e68-8271-bc7e62557c8b {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:46 devstack sudo[100887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_ajov0cg6devstack@QuobyteHD /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0aaa9cea-96f7-49c5-947b-194a3304bc3b Jul 30 16:59:46 devstack sudo[100887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:46 devstack sudo[100889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-49698b31-940b-4c00-a4bd-2b8ed9fe778d.6472c758-b270-4e68-8271-bc7e62557c8b Jul 30 16:59:46 devstack sudo[100889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:46 devstack sudo[100889]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-46cc1fbf-79be-4561-9b1c-ecf9e875d169 tempest-CreateVolumesFromSnapshotTest-680474775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-49698b31-940b-4c00-a4bd-2b8ed9fe778d.6472c758-b270-4e68-8271-bc7e62557c8b" returned: 0 in 0.494s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:46 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-46cc1fbf-79be-4561-9b1c-ecf9e875d169 tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "cinder-quobyte-6472c758-b270-4e68-8271-bc7e62557c8b" released by "_delete_snapshot" :: held 3.058s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:46 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-46cc1fbf-79be-4561-9b1c-ecf9e875d169 tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "cinder-quobyte-49698b31-940b-4c00-a4bd-2b8ed9fe778d" released by "delete_snapshot" :: held 3.138s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:47 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-46cc1fbf-79be-4561-9b1c-ecf9e875d169 tempest-CreateVolumesFromSnapshotTest-680474775 None] Created reservations ['5d79a183-6223-4f2d-a3c3-eedc0eb9d3fa', 'f3d705a7-d3fb-4106-8b7f-089e83886832', '745f341d-3c06-44a1-83d8-4067624907f1', '161d21c6-5e76-49ee-bced-ce6d365dabe5'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:59:47 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-46cc1fbf-79be-4561-9b1c-ecf9e875d169 tempest-CreateVolumesFromSnapshotTest-680474775 None] Delete snapshot completed successfully. Jul 30 16:59:47 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-46cc1fbf-79be-4561-9b1c-ecf9e875d169 tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "cinder-6472c758-b270-4e68-8271-bc7e62557c8b-delete_snapshot" released by "delete_snapshot" :: held 3.410s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:48 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-404689af-ac97-4bda-aa6b-a90d53ec5059 tempest-CreateVolumesFromSnapshotTest-680474775 None] Acquiring lock "cinder-49698b31-940b-4c00-a4bd-2b8ed9fe778d-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:59:48 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-404689af-ac97-4bda-aa6b-a90d53ec5059 tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "cinder-49698b31-940b-4c00-a4bd-2b8ed9fe778d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:59:48 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-404689af-ac97-4bda-aa6b-a90d53ec5059 tempest-CreateVolumesFromSnapshotTest-680474775 None] Acquiring lock "cinder-quobyte-49698b31-940b-4c00-a4bd-2b8ed9fe778d" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:59:48 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-404689af-ac97-4bda-aa6b-a90d53ec5059 tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "cinder-quobyte-49698b31-940b-4c00-a4bd-2b8ed9fe778d" acquired by "delete_volume" :: waited 0.022s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:59:48 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15a7296-171c-4723-ba7d-df71cc9a7e80]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:59:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-404689af-ac97-4bda-aa6b-a90d53ec5059 tempest-CreateVolumesFromSnapshotTest-680474775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-49698b31-940b-4c00-a4bd-2b8ed9fe778d {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:48 devstack sudo[100922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-49698b31-940b-4c00-a4bd-2b8ed9fe778d Jul 30 16:59:48 devstack sudo[100922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:48 devstack sudo[100922]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-404689af-ac97-4bda-aa6b-a90d53ec5059 tempest-CreateVolumesFromSnapshotTest-680474775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-49698b31-940b-4c00-a4bd-2b8ed9fe778d" returned: 0 in 0.558s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-404689af-ac97-4bda-aa6b-a90d53ec5059 tempest-CreateVolumesFromSnapshotTest-680474775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-49698b31-940b-4c00-a4bd-2b8ed9fe778d {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:48 devstack sudo[100930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-49698b31-940b-4c00-a4bd-2b8ed9fe778d Jul 30 16:59:48 devstack sudo[100930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:49 devstack sudo[100887]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_ajov0cg6devstack@QuobyteHD /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0aaa9cea-96f7-49c5-947b-194a3304bc3b" returned: 0 in 2.730s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:49 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_ajov0cg6devstack@QuobyteHD, size 112.00 MB, duration 2.73 sec, destination /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0aaa9cea-96f7-49c5-947b-194a3304bc3b {{(pid=88591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:59:49 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] Converted 112.00 MB image at 41.00 MB/s Jul 30 16:59:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0aaa9cea-96f7-49c5-947b-194a3304bc3b 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:49 devstack sudo[100939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0aaa9cea-96f7-49c5-947b-194a3304bc3b 1G Jul 30 16:59:49 devstack sudo[100939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:49 devstack sudo[100930]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-404689af-ac97-4bda-aa6b-a90d53ec5059 tempest-CreateVolumesFromSnapshotTest-680474775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-49698b31-940b-4c00-a4bd-2b8ed9fe778d" returned: 0 in 0.397s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:49 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-404689af-ac97-4bda-aa6b-a90d53ec5059 tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "cinder-quobyte-49698b31-940b-4c00-a4bd-2b8ed9fe778d" released by "delete_volume" :: held 1.084s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-aa817645-64b4-446e-8dbd-8377fac9ac3d req-36faead4-481b-48a7-869c-a17e15b4c791 tempest-TestInstancesWithCinderVolumes-358578746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-aa817645-64b4-446e-8dbd-8377fac9ac3d req-36faead4-481b-48a7-869c-a17e15b4c791 tempest-TestInstancesWithCinderVolumes-358578746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-aa817645-64b4-446e-8dbd-8377fac9ac3d req-36faead4-481b-48a7-869c-a17e15b4c791 tempest-TestInstancesWithCinderVolumes-358578746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:49 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-404689af-ac97-4bda-aa6b-a90d53ec5059 tempest-CreateVolumesFromSnapshotTest-680474775 None] Created reservations ['172e9d6e-575f-4365-9d7f-368fdbc4b1a8', 'b9228ca0-fa6a-4d08-af30-647495a416c2', '05fdfda6-a9da-4847-b024-4faae9df3098', 'fda51a5e-cef9-4231-8da1-c550b8f41e5c'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:59:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-aa817645-64b4-446e-8dbd-8377fac9ac3d req-36faead4-481b-48a7-869c-a17e15b4c791 tempest-TestInstancesWithCinderVolumes-358578746 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202', 'name': 'volume-69637c2a-4072-40b8-b2f4-0eb86371bb28', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5f982f51-128a-4608-b1a1-ab763a6f8635', 'enforce_multipath': True} {{(pid=88591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:59:49 devstack sudo[100939]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0aaa9cea-96f7-49c5-947b-194a3304bc3b 1G" returned: 0 in 0.387s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:49 devstack cinder-volume[88591]: DEBUG cinder.volume.volume_utils [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] Downloaded image fb94d6e3-28d4-406f-8bad-19349d5f8454 ((None, [{'url': 'file:///opt/stack/data/glance/images/fb94d6e3-28d4-406f-8bad-19349d5f8454', 'metadata': {}}])) to volume 0aaa9cea-96f7-49c5-947b-194a3304bc3b successfully. {{(pid=88591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 30 16:59:49 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] Temporary image fb94d6e3-28d4-406f-8bad-19349d5f8454 for user d546044634b647b6be4e77d520042bab is deleted. {{(pid=88591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 30 16:59:49 devstack cinder-volume[88591]: DEBUG cinder.volume.volume_utils [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] Marking volume 0aaa9cea-96f7-49c5-947b-194a3304bc3b as bootable. {{(pid=88591) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 30 16:59:49 devstack cinder-volume[88591]: INFO cinder.volume.manager [req-aa817645-64b4-446e-8dbd-8377fac9ac3d req-36faead4-481b-48a7-869c-a17e15b4c791 tempest-TestInstancesWithCinderVolumes-358578746 None] attachment_update completed successfully. Jul 30 16:59:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-404689af-ac97-4bda-aa6b-a90d53ec5059 tempest-CreateVolumesFromSnapshotTest-680474775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-404689af-ac97-4bda-aa6b-a90d53ec5059 tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:49 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-404689af-ac97-4bda-aa6b-a90d53ec5059 tempest-CreateVolumesFromSnapshotTest-680474775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:59:49 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-404689af-ac97-4bda-aa6b-a90d53ec5059 tempest-CreateVolumesFromSnapshotTest-680474775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:59:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-404689af-ac97-4bda-aa6b-a90d53ec5059 tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-404689af-ac97-4bda-aa6b-a90d53ec5059 tempest-CreateVolumesFromSnapshotTest-680474775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:49 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] Copying metadata from image fb94d6e3-28d4-406f-8bad-19349d5f8454 to 0aaa9cea-96f7-49c5-947b-194a3304bc3b. {{(pid=88591) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 30 16:59:49 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] Creating volume glance metadata for volume 0aaa9cea-96f7-49c5-947b-194a3304bc3b backed by image fb94d6e3-28d4-406f-8bad-19349d5f8454 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fb94d6e3-28d4-406f-8bad-19349d5f8454', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88591) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 30 16:59:49 devstack sudo[100947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:59:49 devstack sudo[100947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5614c76-eae9-4b7e-8ff0-3132acc5e711) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0aaa9cea-96f7-49c5-947b-194a3304bc3b', 'volume_size': 1, 'image_id': 'fb94d6e3-28d4-406f-8bad-19349d5f8454', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fb94d6e3-28d4-406f-8bad-19349d5f8454', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7e05c21dff7b441db433e2a7736519e9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fb94d6e3-28d4-406f-8bad-19349d5f8454', 'created_at': datetime.datetime(2026, 7, 30, 14, 42, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 42, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fb94d6e3-28d4-406f-8bad-19349d5f8454/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9537459c-f300-48ae-a924-4c1430001c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:49 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] Volume volume-0aaa9cea-96f7-49c5-947b-194a3304bc3b (0aaa9cea-96f7-49c5-947b-194a3304bc3b): created successfully Jul 30 16:59:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9537459c-f300-48ae-a924-4c1430001c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] Flow 'volume_create_manager' (1467260b-4a33-421b-9a22-81310ede8aba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:59:49 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-4e2f7d09-3ac4-4752-a123-cf17226555a5 tempest-VolumesImageMetadata-457239271 None] Created volume successfully. Jul 30 16:59:49 devstack sudo[100947]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-404689af-ac97-4bda-aa6b-a90d53ec5059 tempest-CreateVolumesFromSnapshotTest-680474775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.299s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:49 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-404689af-ac97-4bda-aa6b-a90d53ec5059 tempest-CreateVolumesFromSnapshotTest-680474775 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:59:49 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-404689af-ac97-4bda-aa6b-a90d53ec5059 tempest-CreateVolumesFromSnapshotTest-680474775 None] Deleted volume successfully. Jul 30 16:59:49 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-404689af-ac97-4bda-aa6b-a90d53ec5059 tempest-CreateVolumesFromSnapshotTest-680474775 None] Lock "cinder-49698b31-940b-4c00-a4bd-2b8ed9fe778d-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1b2608f9-8d0a-49d3-8b6a-4ba5b8e1cd31 tempest-VolumesActionsTest-1280755332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1b2608f9-8d0a-49d3-8b6a-4ba5b8e1cd31 tempest-VolumesActionsTest-1280755332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:50 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d3db4a-b17f-44d3-99fd-2acd8cc03aba]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:59:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1b2608f9-8d0a-49d3-8b6a-4ba5b8e1cd31 tempest-VolumesActionsTest-1280755332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f980cd79-ba0b-4a43-9339-e87a7849137f {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:50 devstack sudo[100963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f980cd79-ba0b-4a43-9339-e87a7849137f Jul 30 16:59:50 devstack sudo[100963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:50 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-186da8d6-cbeb-45a2-afd5-b28de3cbd918 tempest-VolumesImageMetadata-457239271 None] Acquiring lock "cinder-0aaa9cea-96f7-49c5-947b-194a3304bc3b-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:59:51 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-186da8d6-cbeb-45a2-afd5-b28de3cbd918 tempest-VolumesImageMetadata-457239271 None] Lock "cinder-0aaa9cea-96f7-49c5-947b-194a3304bc3b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:59:51 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-186da8d6-cbeb-45a2-afd5-b28de3cbd918 tempest-VolumesImageMetadata-457239271 None] Acquiring lock "cinder-quobyte-0aaa9cea-96f7-49c5-947b-194a3304bc3b" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:59:51 devstack sudo[100963]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1b2608f9-8d0a-49d3-8b6a-4ba5b8e1cd31 tempest-VolumesActionsTest-1280755332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f980cd79-ba0b-4a43-9339-e87a7849137f" returned: 0 in 0.477s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:51 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-186da8d6-cbeb-45a2-afd5-b28de3cbd918 tempest-VolumesImageMetadata-457239271 None] Lock "cinder-quobyte-0aaa9cea-96f7-49c5-947b-194a3304bc3b" acquired by "delete_volume" :: waited 0.021s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:59:51 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ffde82-2a0e-4d68-893c-39be9068a75c]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:59:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1b2608f9-8d0a-49d3-8b6a-4ba5b8e1cd31 tempest-VolumesActionsTest-1280755332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f980cd79-ba0b-4a43-9339-e87a7849137f {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:51 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db0df7a-8d23-4079-bcaa-2f5312acb27f]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:59:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-186da8d6-cbeb-45a2-afd5-b28de3cbd918 tempest-VolumesImageMetadata-457239271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0aaa9cea-96f7-49c5-947b-194a3304bc3b {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:51 devstack sudo[100968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f980cd79-ba0b-4a43-9339-e87a7849137f Jul 30 16:59:51 devstack sudo[100968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:51 devstack sudo[100971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0aaa9cea-96f7-49c5-947b-194a3304bc3b Jul 30 16:59:51 devstack sudo[100971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:51 devstack sudo[100968]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1b2608f9-8d0a-49d3-8b6a-4ba5b8e1cd31 tempest-VolumesActionsTest-1280755332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f980cd79-ba0b-4a43-9339-e87a7849137f" returned: 0 in 0.468s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1b2608f9-8d0a-49d3-8b6a-4ba5b8e1cd31 tempest-VolumesActionsTest-1280755332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f980cd79-ba0b-4a43-9339-e87a7849137f /opt/stack/data/cinder/conversion/f980cd79-ba0b-4a43-9339-e87a7849137f.temp_image.14798198-b5a5-4031-bffd-21ef16c569ecws_m3qex.img {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:51 devstack sudo[100971]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-186da8d6-cbeb-45a2-afd5-b28de3cbd918 tempest-VolumesImageMetadata-457239271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0aaa9cea-96f7-49c5-947b-194a3304bc3b" returned: 0 in 0.456s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-186da8d6-cbeb-45a2-afd5-b28de3cbd918 tempest-VolumesImageMetadata-457239271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0aaa9cea-96f7-49c5-947b-194a3304bc3b {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:51 devstack sudo[100985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f980cd79-ba0b-4a43-9339-e87a7849137f /opt/stack/data/cinder/conversion/f980cd79-ba0b-4a43-9339-e87a7849137f.temp_image.14798198-b5a5-4031-bffd-21ef16c569ecws_m3qex.img Jul 30 16:59:51 devstack sudo[100985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:51 devstack sudo[100986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0aaa9cea-96f7-49c5-947b-194a3304bc3b Jul 30 16:59:51 devstack sudo[100986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:51 devstack sudo[100986]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-186da8d6-cbeb-45a2-afd5-b28de3cbd918 tempest-VolumesImageMetadata-457239271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0aaa9cea-96f7-49c5-947b-194a3304bc3b" returned: 0 in 0.341s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:51 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-186da8d6-cbeb-45a2-afd5-b28de3cbd918 tempest-VolumesImageMetadata-457239271 None] Lock "cinder-quobyte-0aaa9cea-96f7-49c5-947b-194a3304bc3b" released by "delete_volume" :: held 0.858s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:52 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-186da8d6-cbeb-45a2-afd5-b28de3cbd918 tempest-VolumesImageMetadata-457239271 None] Created reservations ['9be441e6-6c9e-4292-a29f-7c509f1e8488', 'dfafb1dc-da85-4d8a-9501-b30e3ec73802', 'ac124554-e8f7-414c-9a71-24cba76caad3', '3c9719e9-c533-43f1-91c3-7e5ca52a6620'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:59:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-186da8d6-cbeb-45a2-afd5-b28de3cbd918 tempest-VolumesImageMetadata-457239271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-186da8d6-cbeb-45a2-afd5-b28de3cbd918 tempest-VolumesImageMetadata-457239271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:59:52 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-186da8d6-cbeb-45a2-afd5-b28de3cbd918 tempest-VolumesImageMetadata-457239271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:59:52 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-186da8d6-cbeb-45a2-afd5-b28de3cbd918 tempest-VolumesImageMetadata-457239271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:59:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-186da8d6-cbeb-45a2-afd5-b28de3cbd918 tempest-VolumesImageMetadata-457239271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:59:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-186da8d6-cbeb-45a2-afd5-b28de3cbd918 tempest-VolumesImageMetadata-457239271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:52 devstack sudo[101004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 16:59:52 devstack sudo[101004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:52 devstack sudo[101004]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-186da8d6-cbeb-45a2-afd5-b28de3cbd918 tempest-VolumesImageMetadata-457239271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.431s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:52 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-186da8d6-cbeb-45a2-afd5-b28de3cbd918 tempest-VolumesImageMetadata-457239271 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:59:52 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-186da8d6-cbeb-45a2-afd5-b28de3cbd918 tempest-VolumesImageMetadata-457239271 None] Deleted volume successfully. Jul 30 16:59:52 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-186da8d6-cbeb-45a2-afd5-b28de3cbd918 tempest-VolumesImageMetadata-457239271 None] Lock "cinder-0aaa9cea-96f7-49c5-947b-194a3304bc3b-delete_volume" released by "delete_volume" :: held 1.882s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:59:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-d76908e4-3389-4980-b0b5-40f7305ccf29 req-cb8ae8d6-a5c7-453e-8357-dbfdf67cc3e5 tempest-TestInstancesWithCinderVolumes-358578746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:59:57 devstack sudo[100985]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1b2608f9-8d0a-49d3-8b6a-4ba5b8e1cd31 tempest-VolumesActionsTest-1280755332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f980cd79-ba0b-4a43-9339-e87a7849137f /opt/stack/data/cinder/conversion/f980cd79-ba0b-4a43-9339-e87a7849137f.temp_image.14798198-b5a5-4031-bffd-21ef16c569ecws_m3qex.img" returned: 0 in 5.723s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:57 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[3505d2c1-2626-444b-b1a0-0dd8400e02a5]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:59:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1b2608f9-8d0a-49d3-8b6a-4ba5b8e1cd31 tempest-VolumesActionsTest-1280755332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f980cd79-ba0b-4a43-9339-e87a7849137f {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:59:57 devstack sudo[101016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f980cd79-ba0b-4a43-9339-e87a7849137f Jul 30 16:59:57 devstack sudo[101016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:59:57 devstack sudo[101016]: pam_unix(sudo:session): session closed for user root Jul 30 16:59:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1b2608f9-8d0a-49d3-8b6a-4ba5b8e1cd31 tempest-VolumesActionsTest-1280755332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f980cd79-ba0b-4a43-9339-e87a7849137f" returned: 0 in 0.580s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:59:57 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-1b2608f9-8d0a-49d3-8b6a-4ba5b8e1cd31 tempest-VolumesActionsTest-1280755332 None] Image conversion details: src /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f980cd79-ba0b-4a43-9339-e87a7849137f, size 1024.00 MB, duration 5.72 sec, destination /opt/stack/data/cinder/conversion/f980cd79-ba0b-4a43-9339-e87a7849137f.temp_image.14798198-b5a5-4031-bffd-21ef16c569ecws_m3qex.img {{(pid=88591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:59:57 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-1b2608f9-8d0a-49d3-8b6a-4ba5b8e1cd31 tempest-VolumesActionsTest-1280755332 None] Converted 1024.00 MB image at 178.89 MB/s Jul 30 16:59:57 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-1b2608f9-8d0a-49d3-8b6a-4ba5b8e1cd31 tempest-VolumesActionsTest-1280755332 None] 14798198-b5a5-4031-bffd-21ef16c569ec was raw, no need to convert to raw {{(pid=88591) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 30 16:59:59 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aed784c-4792-4f01-ba21-b677b18a2137 tempest-SnapshotMetadataTestJSON-1261755755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:59:59 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6aed784c-4792-4f01-ba21-b677b18a2137 tempest-SnapshotMetadataTestJSON-1261755755 None] Flow 'volume_create_manager' (501d0e47-6a40-4799-ac0b-90bff3e8809d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:59:59 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6aed784c-4792-4f01-ba21-b677b18a2137 tempest-SnapshotMetadataTestJSON-1261755755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (740d6530-c2de-4aec-a1b8-a43a8f345180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:59 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6aed784c-4792-4f01-ba21-b677b18a2137 tempest-SnapshotMetadataTestJSON-1261755755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (740d6530-c2de-4aec-a1b8-a43a8f345180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:59:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1843863156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=513f2f16-fb7e-4584-a5ab-86c64a8644c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='812d7c64017f4a339cfb2f6628fd90b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:59:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:59:59Z,use_quota=True,user_id='ebe700f972f9441a924b8e4b89e978b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:59 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6aed784c-4792-4f01-ba21-b677b18a2137 tempest-SnapshotMetadataTestJSON-1261755755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (effd446f-099c-49c0-9f33-cae13c801e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:59 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6aed784c-4792-4f01-ba21-b677b18a2137 tempest-SnapshotMetadataTestJSON-1261755755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (effd446f-099c-49c0-9f33-cae13c801e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:59 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6aed784c-4792-4f01-ba21-b677b18a2137 tempest-SnapshotMetadataTestJSON-1261755755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24629975-a655-456a-b4b6-fed625be46a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:59 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6aed784c-4792-4f01-ba21-b677b18a2137 tempest-SnapshotMetadataTestJSON-1261755755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24629975-a655-456a-b4b6-fed625be46a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '513f2f16-fb7e-4584-a5ab-86c64a8644c3', 'volume_name': 'volume-513f2f16-fb7e-4584-a5ab-86c64a8644c3', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:59 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6aed784c-4792-4f01-ba21-b677b18a2137 tempest-SnapshotMetadataTestJSON-1261755755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5448b88a-49d9-44f9-b429-0d8e3131c99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:59 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6aed784c-4792-4f01-ba21-b677b18a2137 tempest-SnapshotMetadataTestJSON-1261755755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5448b88a-49d9-44f9-b429-0d8e3131c99e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:59:59 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6aed784c-4792-4f01-ba21-b677b18a2137 tempest-SnapshotMetadataTestJSON-1261755755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e77fb3b-8954-407f-a0f7-fd49c1d65fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:59:59 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-6aed784c-4792-4f01-ba21-b677b18a2137 tempest-SnapshotMetadataTestJSON-1261755755 None] Volume 513f2f16-fb7e-4584-a5ab-86c64a8644c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-513f2f16-fb7e-4584-a5ab-86c64a8644c3', 'volume_size': 1} Jul 30 16:59:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-6aed784c-4792-4f01-ba21-b677b18a2137 tempest-SnapshotMetadataTestJSON-1261755755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:00:07 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:SELECT=58,cinder:INSERT=22,cinder:UPDATE=69,cinder:DELETE=5 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:00:09 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:INSERT=26,cinder:UPDATE=73,cinder:SELECT=74,cinder:DELETE=3 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:00:12 devstack cinder-volume[88591]: DEBUG oslo_service.periodic_task [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 17:00:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:00:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:00:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:00:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:00:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:00:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:12 devstack sudo[101024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:00:12 devstack sudo[101024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:12 devstack sudo[101024]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.290s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:12 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:00:12 devstack cinder-volume[88591]: DEBUG oslo_service.periodic_task [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running periodic task VolumeManager._thread_info {{(pid=88591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 17:00:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] thread count: 28 {{(pid=88591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 17:00:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] thread info: [<_MainThread(MainThread, started 140677178003584)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 17:00:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1b2608f9-8d0a-49d3-8b6a-4ba5b8e1cd31 tempest-VolumesActionsTest-1280755332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.095s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:00:17 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1b2608f9-8d0a-49d3-8b6a-4ba5b8e1cd31 tempest-VolumesActionsTest-1280755332 None] Uploaded volume to glance image-id: 14798198-b5a5-4031-bffd-21ef16c569ec. {{(pid=88591) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 30 17:00:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-d76908e4-3389-4980-b0b5-40f7305ccf29 req-cb8ae8d6-a5c7-453e-8357-dbfdf67cc3e5 tempest-TestInstancesWithCinderVolumes-358578746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 24.544s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:00:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-d76908e4-3389-4980-b0b5-40f7305ccf29 req-cb8ae8d6-a5c7-453e-8357-dbfdf67cc3e5 tempest-TestInstancesWithCinderVolumes-358578746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:00:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-6aed784c-4792-4f01-ba21-b677b18a2137 tempest-SnapshotMetadataTestJSON-1261755755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.402s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:00:17 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-6aed784c-4792-4f01-ba21-b677b18a2137 tempest-SnapshotMetadataTestJSON-1261755755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:59:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1843863156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=513f2f16-fb7e-4584-a5ab-86c64a8644c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='812d7c64017f4a339cfb2f6628fd90b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:59:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:59:59Z,use_quota=True,user_id='ebe700f972f9441a924b8e4b89e978b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:00:17 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-6aed784c-4792-4f01-ba21-b677b18a2137 tempest-SnapshotMetadataTestJSON-1261755755 None] Creating volume 513f2f16-fb7e-4584-a5ab-86c64a8644c3 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:00:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-6aed784c-4792-4f01-ba21-b677b18a2137 tempest-SnapshotMetadataTestJSON-1261755755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:00:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-6aed784c-4792-4f01-ba21-b677b18a2137 tempest-SnapshotMetadataTestJSON-1261755755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:00:17 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-6aed784c-4792-4f01-ba21-b677b18a2137 tempest-SnapshotMetadataTestJSON-1261755755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:00:17 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-6aed784c-4792-4f01-ba21-b677b18a2137 tempest-SnapshotMetadataTestJSON-1261755755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:00:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-6aed784c-4792-4f01-ba21-b677b18a2137 tempest-SnapshotMetadataTestJSON-1261755755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:00:17 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-6aed784c-4792-4f01-ba21-b677b18a2137 tempest-SnapshotMetadataTestJSON-1261755755 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:00:17 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-6aed784c-4792-4f01-ba21-b677b18a2137 tempest-SnapshotMetadataTestJSON-1261755755 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:00:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6aed784c-4792-4f01-ba21-b677b18a2137 tempest-SnapshotMetadataTestJSON-1261755755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-513f2f16-fb7e-4584-a5ab-86c64a8644c3 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:17 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-1b2608f9-8d0a-49d3-8b6a-4ba5b8e1cd31 tempest-VolumesActionsTest-1280755332 None] Copy volume to image completed successfully. Jul 30 17:00:17 devstack sudo[101027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-513f2f16-fb7e-4584-a5ab-86c64a8644c3 1073741824 Jul 30 17:00:17 devstack sudo[101027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:17 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-d76908e4-3389-4980-b0b5-40f7305ccf29 req-cb8ae8d6-a5c7-453e-8357-dbfdf67cc3e5 tempest-TestInstancesWithCinderVolumes-358578746 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202', 'name': 'volume-14efd33c-0eef-4e29-8d37-ebb314a03f58', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '84f62e45-640b-43fa-93ff-febb671f288e', 'enforce_multipath': True} {{(pid=88591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 17:00:17 devstack cinder-volume[88591]: INFO cinder.volume.manager [req-d76908e4-3389-4980-b0b5-40f7305ccf29 req-cb8ae8d6-a5c7-453e-8357-dbfdf67cc3e5 tempest-TestInstancesWithCinderVolumes-358578746 None] attachment_update completed successfully. Jul 30 17:00:18 devstack sudo[101027]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6aed784c-4792-4f01-ba21-b677b18a2137 tempest-SnapshotMetadataTestJSON-1261755755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-513f2f16-fb7e-4584-a5ab-86c64a8644c3 1073741824" returned: 0 in 0.515s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6aed784c-4792-4f01-ba21-b677b18a2137 tempest-SnapshotMetadataTestJSON-1261755755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-513f2f16-fb7e-4584-a5ab-86c64a8644c3 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:18 devstack sudo[101040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-513f2f16-fb7e-4584-a5ab-86c64a8644c3 Jul 30 17:00:18 devstack sudo[101040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:18 devstack sudo[101040]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6aed784c-4792-4f01-ba21-b677b18a2137 tempest-SnapshotMetadataTestJSON-1261755755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-513f2f16-fb7e-4584-a5ab-86c64a8644c3" returned: 0 in 0.308s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:18 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-6aed784c-4792-4f01-ba21-b677b18a2137 tempest-SnapshotMetadataTestJSON-1261755755 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:00:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-6aed784c-4792-4f01-ba21-b677b18a2137 tempest-SnapshotMetadataTestJSON-1261755755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:00:18 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6aed784c-4792-4f01-ba21-b677b18a2137 tempest-SnapshotMetadataTestJSON-1261755755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e77fb3b-8954-407f-a0f7-fd49c1d65fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-513f2f16-fb7e-4584-a5ab-86c64a8644c3', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:00:18 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6aed784c-4792-4f01-ba21-b677b18a2137 tempest-SnapshotMetadataTestJSON-1261755755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7066527-b33f-4f94-8767-3b123890a521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:00:18 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-6aed784c-4792-4f01-ba21-b677b18a2137 tempest-SnapshotMetadataTestJSON-1261755755 None] Volume volume-513f2f16-fb7e-4584-a5ab-86c64a8644c3 (513f2f16-fb7e-4584-a5ab-86c64a8644c3): created successfully Jul 30 17:00:18 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6aed784c-4792-4f01-ba21-b677b18a2137 tempest-SnapshotMetadataTestJSON-1261755755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7066527-b33f-4f94-8767-3b123890a521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:00:18 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6aed784c-4792-4f01-ba21-b677b18a2137 tempest-SnapshotMetadataTestJSON-1261755755 None] Flow 'volume_create_manager' (501d0e47-6a40-4799-ac0b-90bff3e8809d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:00:18 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-6aed784c-4792-4f01-ba21-b677b18a2137 tempest-SnapshotMetadataTestJSON-1261755755 None] Created volume successfully. Jul 30 17:00:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-490ee14f-fad4-40b9-9526-ef44a9a410f2 tempest-VolumesActionsTest-1280755332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:00:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-490ee14f-fad4-40b9-9526-ef44a9a410f2 tempest-VolumesActionsTest-1280755332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:00:18 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e888a374-fa69-4f9e-a5ab-3f6757740043]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:00:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-490ee14f-fad4-40b9-9526-ef44a9a410f2 tempest-VolumesActionsTest-1280755332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f980cd79-ba0b-4a43-9339-e87a7849137f {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:19 devstack sudo[101044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f980cd79-ba0b-4a43-9339-e87a7849137f Jul 30 17:00:19 devstack sudo[101044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:19 devstack sudo[101044]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-490ee14f-fad4-40b9-9526-ef44a9a410f2 tempest-VolumesActionsTest-1280755332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f980cd79-ba0b-4a43-9339-e87a7849137f" returned: 0 in 0.368s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:19 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5dbb9b-fbfa-4af3-9c07-f9fc6cd49811]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:00:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-490ee14f-fad4-40b9-9526-ef44a9a410f2 tempest-VolumesActionsTest-1280755332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f980cd79-ba0b-4a43-9339-e87a7849137f {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:19 devstack sudo[101057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f980cd79-ba0b-4a43-9339-e87a7849137f Jul 30 17:00:19 devstack sudo[101057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:19 devstack sudo[101057]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-490ee14f-fad4-40b9-9526-ef44a9a410f2 tempest-VolumesActionsTest-1280755332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f980cd79-ba0b-4a43-9339-e87a7849137f" returned: 0 in 0.400s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-490ee14f-fad4-40b9-9526-ef44a9a410f2 tempest-VolumesActionsTest-1280755332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f980cd79-ba0b-4a43-9339-e87a7849137f /opt/stack/data/cinder/conversion/f980cd79-ba0b-4a43-9339-e87a7849137f.temp_image.2c136f1f-7bed-471c-bf18-d57fe7c5d19aom0mu5rh.img {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:19 devstack sudo[101062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f980cd79-ba0b-4a43-9339-e87a7849137f /opt/stack/data/cinder/conversion/f980cd79-ba0b-4a43-9339-e87a7849137f.temp_image.2c136f1f-7bed-471c-bf18-d57fe7c5d19aom0mu5rh.img Jul 30 17:00:19 devstack sudo[101062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c46d49e6-f801-4553-82a6-ed1c95ba394c tempest-SnapshotMetadataTestJSON-1261755755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:00:24 devstack sudo[101062]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-490ee14f-fad4-40b9-9526-ef44a9a410f2 tempest-VolumesActionsTest-1280755332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f980cd79-ba0b-4a43-9339-e87a7849137f /opt/stack/data/cinder/conversion/f980cd79-ba0b-4a43-9339-e87a7849137f.temp_image.2c136f1f-7bed-471c-bf18-d57fe7c5d19aom0mu5rh.img" returned: 0 in 4.716s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:24 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[690fab86-b497-4c5d-adeb-3add6332977d]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:00:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-490ee14f-fad4-40b9-9526-ef44a9a410f2 tempest-VolumesActionsTest-1280755332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f980cd79-ba0b-4a43-9339-e87a7849137f {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:24 devstack sudo[101102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f980cd79-ba0b-4a43-9339-e87a7849137f Jul 30 17:00:24 devstack sudo[101102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:24 devstack cinder-volume[88591]: INFO cinder.volume.manager [req-b44e47fc-9286-43bd-bfbc-bfc1a0f484ec req-73b52edc-b9d0-46a6-a7dd-05ab00a1d267 tempest-TestInstancesWithCinderVolumes-358578746 None] Terminate volume connection completed successfully. Jul 30 17:00:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-b44e47fc-9286-43bd-bfbc-bfc1a0f484ec req-73b52edc-b9d0-46a6-a7dd-05ab00a1d267 tempest-TestInstancesWithCinderVolumes-358578746 None] Deleting attachment 5f982f51-128a-4608-b1a1-ab763a6f8635. {{(pid=88591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 17:00:25 devstack sudo[101102]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-490ee14f-fad4-40b9-9526-ef44a9a410f2 tempest-VolumesActionsTest-1280755332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f980cd79-ba0b-4a43-9339-e87a7849137f" returned: 0 in 0.542s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:25 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-490ee14f-fad4-40b9-9526-ef44a9a410f2 tempest-VolumesActionsTest-1280755332 None] Image conversion details: src /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f980cd79-ba0b-4a43-9339-e87a7849137f, size 1024.00 MB, duration 4.72 sec, destination /opt/stack/data/cinder/conversion/f980cd79-ba0b-4a43-9339-e87a7849137f.temp_image.2c136f1f-7bed-471c-bf18-d57fe7c5d19aom0mu5rh.img {{(pid=88591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 17:00:25 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-490ee14f-fad4-40b9-9526-ef44a9a410f2 tempest-VolumesActionsTest-1280755332 None] Converted 1024.00 MB image at 217.06 MB/s Jul 30 17:00:25 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-490ee14f-fad4-40b9-9526-ef44a9a410f2 tempest-VolumesActionsTest-1280755332 None] 2c136f1f-7bed-471c-bf18-d57fe7c5d19a was raw, converting to qcow2 {{(pid=88591) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 30 17:00:25 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcfc8975-4520-4817-a1f1-990a118d3cfa]: (4, 'raw') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:00:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-490ee14f-fad4-40b9-9526-ef44a9a410f2 tempest-VolumesActionsTest-1280755332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f980cd79-ba0b-4a43-9339-e87a7849137f.temp_image.2c136f1f-7bed-471c-bf18-d57fe7c5d19aom0mu5rh.img {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:25 devstack sudo[101113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f980cd79-ba0b-4a43-9339-e87a7849137f.temp_image.2c136f1f-7bed-471c-bf18-d57fe7c5d19aom0mu5rh.img Jul 30 17:00:25 devstack sudo[101113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:25 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-19960ec8-98f2-49a5-89e0-c5f0915b9012 tempest-TestInstancesWithCinderVolumes-358578746 None] Acquiring lock "cinder-69637c2a-4072-40b8-b2f4-0eb86371bb28-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:00:25 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-19960ec8-98f2-49a5-89e0-c5f0915b9012 tempest-TestInstancesWithCinderVolumes-358578746 None] Lock "cinder-69637c2a-4072-40b8-b2f4-0eb86371bb28-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:00:25 devstack sudo[101113]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:25 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-19960ec8-98f2-49a5-89e0-c5f0915b9012 tempest-TestInstancesWithCinderVolumes-358578746 None] Acquiring lock "cinder-quobyte-69637c2a-4072-40b8-b2f4-0eb86371bb28" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:00:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-490ee14f-fad4-40b9-9526-ef44a9a410f2 tempest-VolumesActionsTest-1280755332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f980cd79-ba0b-4a43-9339-e87a7849137f.temp_image.2c136f1f-7bed-471c-bf18-d57fe7c5d19aom0mu5rh.img" returned: 0 in 0.343s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-490ee14f-fad4-40b9-9526-ef44a9a410f2 tempest-VolumesActionsTest-1280755332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f980cd79-ba0b-4a43-9339-e87a7849137f.temp_image.2c136f1f-7bed-471c-bf18-d57fe7c5d19aom0mu5rh.img {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:25 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-19960ec8-98f2-49a5-89e0-c5f0915b9012 tempest-TestInstancesWithCinderVolumes-358578746 None] Lock "cinder-quobyte-69637c2a-4072-40b8-b2f4-0eb86371bb28" acquired by "delete_volume" :: waited 0.032s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:00:25 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57584a9-f990-414b-b493-25295d8d6965]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:00:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-19960ec8-98f2-49a5-89e0-c5f0915b9012 tempest-TestInstancesWithCinderVolumes-358578746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-69637c2a-4072-40b8-b2f4-0eb86371bb28 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:25 devstack sudo[101119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f980cd79-ba0b-4a43-9339-e87a7849137f.temp_image.2c136f1f-7bed-471c-bf18-d57fe7c5d19aom0mu5rh.img Jul 30 17:00:25 devstack sudo[101119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:25 devstack sudo[101122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-69637c2a-4072-40b8-b2f4-0eb86371bb28 Jul 30 17:00:25 devstack sudo[101122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:25 devstack sudo[101119]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-490ee14f-fad4-40b9-9526-ef44a9a410f2 tempest-VolumesActionsTest-1280755332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f980cd79-ba0b-4a43-9339-e87a7849137f.temp_image.2c136f1f-7bed-471c-bf18-d57fe7c5d19aom0mu5rh.img" returned: 1 in 0.350s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-490ee14f-fad4-40b9-9526-ef44a9a410f2 tempest-VolumesActionsTest-1280755332 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f980cd79-ba0b-4a43-9339-e87a7849137f.temp_image.2c136f1f-7bed-471c-bf18-d57fe7c5d19aom0mu5rh.img' failed. Not Retrying. {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 17:00:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-490ee14f-fad4-40b9-9526-ef44a9a410f2 tempest-VolumesActionsTest-1280755332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f980cd79-ba0b-4a43-9339-e87a7849137f.temp_image.2c136f1f-7bed-471c-bf18-d57fe7c5d19aom0mu5rh.img /opt/stack/data/cinder/conversion/vol_upload_l_7v_97e {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:25 devstack sudo[101129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f980cd79-ba0b-4a43-9339-e87a7849137f.temp_image.2c136f1f-7bed-471c-bf18-d57fe7c5d19aom0mu5rh.img /opt/stack/data/cinder/conversion/vol_upload_l_7v_97e Jul 30 17:00:25 devstack sudo[101129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:25 devstack sudo[101122]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-19960ec8-98f2-49a5-89e0-c5f0915b9012 tempest-TestInstancesWithCinderVolumes-358578746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-69637c2a-4072-40b8-b2f4-0eb86371bb28" returned: 0 in 0.394s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-19960ec8-98f2-49a5-89e0-c5f0915b9012 tempest-TestInstancesWithCinderVolumes-358578746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-69637c2a-4072-40b8-b2f4-0eb86371bb28 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:25 devstack sudo[101133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-69637c2a-4072-40b8-b2f4-0eb86371bb28 Jul 30 17:00:25 devstack sudo[101133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:26 devstack sudo[101129]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-490ee14f-fad4-40b9-9526-ef44a9a410f2 tempest-VolumesActionsTest-1280755332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f980cd79-ba0b-4a43-9339-e87a7849137f.temp_image.2c136f1f-7bed-471c-bf18-d57fe7c5d19aom0mu5rh.img /opt/stack/data/cinder/conversion/vol_upload_l_7v_97e" returned: 0 in 0.296s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:26 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-490ee14f-fad4-40b9-9526-ef44a9a410f2 tempest-VolumesActionsTest-1280755332 None] Image conversion details: src /opt/stack/data/cinder/conversion/f980cd79-ba0b-4a43-9339-e87a7849137f.temp_image.2c136f1f-7bed-471c-bf18-d57fe7c5d19aom0mu5rh.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_l_7v_97e {{(pid=88591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 17:00:26 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-490ee14f-fad4-40b9-9526-ef44a9a410f2 tempest-VolumesActionsTest-1280755332 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 30 17:00:26 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ba188a-d88a-4c13-b2b8-35b60e0a5861]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:00:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-490ee14f-fad4-40b9-9526-ef44a9a410f2 tempest-VolumesActionsTest-1280755332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_l_7v_97e {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:26 devstack sudo[101133]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-19960ec8-98f2-49a5-89e0-c5f0915b9012 tempest-TestInstancesWithCinderVolumes-358578746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-69637c2a-4072-40b8-b2f4-0eb86371bb28" returned: 0 in 0.288s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:26 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-19960ec8-98f2-49a5-89e0-c5f0915b9012 tempest-TestInstancesWithCinderVolumes-358578746 None] Lock "cinder-quobyte-69637c2a-4072-40b8-b2f4-0eb86371bb28" released by "delete_volume" :: held 0.741s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:00:26 devstack sudo[101138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_l_7v_97e Jul 30 17:00:26 devstack sudo[101138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:26 devstack cinder-volume[88591]: WARNING cinder.quota [None req-19960ec8-98f2-49a5-89e0-c5f0915b9012 tempest-TestInstancesWithCinderVolumes-358578746 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-192240285-263674315 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-192240285-263674315, it is now deprecated. Please use the default quota class for default quota. Jul 30 17:00:26 devstack cinder-volume[88591]: WARNING cinder.quota [None req-19960ec8-98f2-49a5-89e0-c5f0915b9012 tempest-TestInstancesWithCinderVolumes-358578746 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-192240285-263674315 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-192240285-263674315, it is now deprecated. Please use the default quota class for default quota. Jul 30 17:00:26 devstack sudo[101138]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-490ee14f-fad4-40b9-9526-ef44a9a410f2 tempest-VolumesActionsTest-1280755332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_l_7v_97e" returned: 0 in 0.415s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:26 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-19960ec8-98f2-49a5-89e0-c5f0915b9012 tempest-TestInstancesWithCinderVolumes-358578746 None] Created reservations ['99817398-bb11-43d5-abca-ce54c5e949eb', 'f59f8b81-ee68-4baf-8b7a-e9cdbca4b70a', '43079308-9d4c-472b-9e9e-efc7ddb71e2d', '672423b0-1f80-4466-8b83-e257b57c99cf'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:00:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-19960ec8-98f2-49a5-89e0-c5f0915b9012 tempest-TestInstancesWithCinderVolumes-358578746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:00:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-19960ec8-98f2-49a5-89e0-c5f0915b9012 tempest-TestInstancesWithCinderVolumes-358578746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:00:26 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-19960ec8-98f2-49a5-89e0-c5f0915b9012 tempest-TestInstancesWithCinderVolumes-358578746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:00:26 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-19960ec8-98f2-49a5-89e0-c5f0915b9012 tempest-TestInstancesWithCinderVolumes-358578746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:00:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-19960ec8-98f2-49a5-89e0-c5f0915b9012 tempest-TestInstancesWithCinderVolumes-358578746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:00:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-19960ec8-98f2-49a5-89e0-c5f0915b9012 tempest-TestInstancesWithCinderVolumes-358578746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:26 devstack sudo[101144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:00:26 devstack sudo[101144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:26 devstack sudo[101144]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-19960ec8-98f2-49a5-89e0-c5f0915b9012 tempest-TestInstancesWithCinderVolumes-358578746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.276s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:26 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-19960ec8-98f2-49a5-89e0-c5f0915b9012 tempest-TestInstancesWithCinderVolumes-358578746 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:00:26 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-19960ec8-98f2-49a5-89e0-c5f0915b9012 tempest-TestInstancesWithCinderVolumes-358578746 None] Deleted volume successfully. Jul 30 17:00:26 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-19960ec8-98f2-49a5-89e0-c5f0915b9012 tempest-TestInstancesWithCinderVolumes-358578746 None] Lock "cinder-69637c2a-4072-40b8-b2f4-0eb86371bb28-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:00:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-490ee14f-fad4-40b9-9526-ef44a9a410f2 tempest-VolumesActionsTest-1280755332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.977s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:00:27 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-490ee14f-fad4-40b9-9526-ef44a9a410f2 tempest-VolumesActionsTest-1280755332 None] Uploaded volume to glance image-id: 2c136f1f-7bed-471c-bf18-d57fe7c5d19a. {{(pid=88591) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 30 17:00:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c46d49e6-f801-4553-82a6-ed1c95ba394c tempest-SnapshotMetadataTestJSON-1261755755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.995s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:00:27 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-c46d49e6-f801-4553-82a6-ed1c95ba394c tempest-SnapshotMetadataTestJSON-1261755755 None] Creating offline snapshot e8d3b2de-bc7d-4c7f-861a-1f13519a9566 of volume 513f2f16-fb7e-4584-a5ab-86c64a8644c3 {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:00:27 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-490ee14f-fad4-40b9-9526-ef44a9a410f2 tempest-VolumesActionsTest-1280755332 None] Copy volume to image completed successfully. Jul 30 17:00:27 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c34bc4-3372-4729-bcf8-96552d7f2ec8]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:00:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c46d49e6-f801-4553-82a6-ed1c95ba394c tempest-SnapshotMetadataTestJSON-1261755755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-513f2f16-fb7e-4584-a5ab-86c64a8644c3 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:28 devstack sudo[101164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-513f2f16-fb7e-4584-a5ab-86c64a8644c3 Jul 30 17:00:28 devstack sudo[101164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:28 devstack sudo[101164]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c46d49e6-f801-4553-82a6-ed1c95ba394c tempest-SnapshotMetadataTestJSON-1261755755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-513f2f16-fb7e-4584-a5ab-86c64a8644c3" returned: 0 in 0.363s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c46d49e6-f801-4553-82a6-ed1c95ba394c tempest-SnapshotMetadataTestJSON-1261755755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-513f2f16-fb7e-4584-a5ab-86c64a8644c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-513f2f16-fb7e-4584-a5ab-86c64a8644c3.e8d3b2de-bc7d-4c7f-861a-1f13519a9566 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:28 devstack sudo[101176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-513f2f16-fb7e-4584-a5ab-86c64a8644c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-513f2f16-fb7e-4584-a5ab-86c64a8644c3.e8d3b2de-bc7d-4c7f-861a-1f13519a9566 1G Jul 30 17:00:28 devstack sudo[101176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:28 devstack sudo[101176]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c46d49e6-f801-4553-82a6-ed1c95ba394c tempest-SnapshotMetadataTestJSON-1261755755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-513f2f16-fb7e-4584-a5ab-86c64a8644c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-513f2f16-fb7e-4584-a5ab-86c64a8644c3.e8d3b2de-bc7d-4c7f-861a-1f13519a9566 1G" returned: 0 in 0.493s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c46d49e6-f801-4553-82a6-ed1c95ba394c tempest-SnapshotMetadataTestJSON-1261755755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-513f2f16-fb7e-4584-a5ab-86c64a8644c3 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-513f2f16-fb7e-4584-a5ab-86c64a8644c3.e8d3b2de-bc7d-4c7f-861a-1f13519a9566 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:28 devstack sudo[101182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-513f2f16-fb7e-4584-a5ab-86c64a8644c3 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-513f2f16-fb7e-4584-a5ab-86c64a8644c3.e8d3b2de-bc7d-4c7f-861a-1f13519a9566 Jul 30 17:00:28 devstack sudo[101182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:29 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f500d9f2-6c03-4672-aaee-a49af7cbb947 tempest-VolumesActionsTest-1280755332 None] Acquiring lock "cinder-f980cd79-ba0b-4a43-9339-e87a7849137f-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:00:29 devstack sudo[101182]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c46d49e6-f801-4553-82a6-ed1c95ba394c tempest-SnapshotMetadataTestJSON-1261755755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-513f2f16-fb7e-4584-a5ab-86c64a8644c3 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-513f2f16-fb7e-4584-a5ab-86c64a8644c3.e8d3b2de-bc7d-4c7f-861a-1f13519a9566" returned: 0 in 0.326s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:29 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-c46d49e6-f801-4553-82a6-ed1c95ba394c tempest-SnapshotMetadataTestJSON-1261755755 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-513f2f16-fb7e-4584-a5ab-86c64a8644c3.e8d3b2de-bc7d-4c7f-861a-1f13519a9566 is being set with open permissions: ugo+rw Jul 30 17:00:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c46d49e6-f801-4553-82a6-ed1c95ba394c tempest-SnapshotMetadataTestJSON-1261755755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-513f2f16-fb7e-4584-a5ab-86c64a8644c3.e8d3b2de-bc7d-4c7f-861a-1f13519a9566 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:29 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f500d9f2-6c03-4672-aaee-a49af7cbb947 tempest-VolumesActionsTest-1280755332 None] Lock "cinder-f980cd79-ba0b-4a43-9339-e87a7849137f-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:00:29 devstack sudo[101191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-513f2f16-fb7e-4584-a5ab-86c64a8644c3.e8d3b2de-bc7d-4c7f-861a-1f13519a9566 Jul 30 17:00:29 devstack sudo[101191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:29 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f500d9f2-6c03-4672-aaee-a49af7cbb947 tempest-VolumesActionsTest-1280755332 None] Acquiring lock "cinder-quobyte-f980cd79-ba0b-4a43-9339-e87a7849137f" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:00:29 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f500d9f2-6c03-4672-aaee-a49af7cbb947 tempest-VolumesActionsTest-1280755332 None] Lock "cinder-quobyte-f980cd79-ba0b-4a43-9339-e87a7849137f" acquired by "delete_volume" :: waited 0.020s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:00:29 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdcc12d3-9737-48b1-a8cf-ddc9f78421ae]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:00:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f500d9f2-6c03-4672-aaee-a49af7cbb947 tempest-VolumesActionsTest-1280755332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f980cd79-ba0b-4a43-9339-e87a7849137f {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:29 devstack cinder-volume[88591]: INFO cinder.volume.manager [req-e0389db7-f51a-4c68-b8b2-3524df4e97ac req-4723eb36-09a7-4c76-a883-979d95153dfe tempest-TestInstancesWithCinderVolumes-358578746 None] Terminate volume connection completed successfully. Jul 30 17:00:29 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-e0389db7-f51a-4c68-b8b2-3524df4e97ac req-4723eb36-09a7-4c76-a883-979d95153dfe tempest-TestInstancesWithCinderVolumes-358578746 None] Deleting attachment 84f62e45-640b-43fa-93ff-febb671f288e. {{(pid=88591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 17:00:29 devstack sudo[101194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f980cd79-ba0b-4a43-9339-e87a7849137f Jul 30 17:00:29 devstack sudo[101194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:29 devstack sudo[101191]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c46d49e6-f801-4553-82a6-ed1c95ba394c tempest-SnapshotMetadataTestJSON-1261755755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-513f2f16-fb7e-4584-a5ab-86c64a8644c3.e8d3b2de-bc7d-4c7f-861a-1f13519a9566" returned: 0 in 0.301s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c46d49e6-f801-4553-82a6-ed1c95ba394c tempest-SnapshotMetadataTestJSON-1261755755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-513f2f16-fb7e-4584-a5ab-86c64a8644c3.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:29 devstack sudo[101197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-513f2f16-fb7e-4584-a5ab-86c64a8644c3.info Jul 30 17:00:29 devstack sudo[101197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:29 devstack sudo[101194]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f500d9f2-6c03-4672-aaee-a49af7cbb947 tempest-VolumesActionsTest-1280755332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f980cd79-ba0b-4a43-9339-e87a7849137f" returned: 0 in 0.391s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f500d9f2-6c03-4672-aaee-a49af7cbb947 tempest-VolumesActionsTest-1280755332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f980cd79-ba0b-4a43-9339-e87a7849137f {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:29 devstack sudo[101202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f980cd79-ba0b-4a43-9339-e87a7849137f Jul 30 17:00:29 devstack sudo[101202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:29 devstack sudo[101197]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c46d49e6-f801-4553-82a6-ed1c95ba394c tempest-SnapshotMetadataTestJSON-1261755755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-513f2f16-fb7e-4584-a5ab-86c64a8644c3.info" returned: 0 in 0.314s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:29 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-c46d49e6-f801-4553-82a6-ed1c95ba394c tempest-SnapshotMetadataTestJSON-1261755755 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-513f2f16-fb7e-4584-a5ab-86c64a8644c3.info is being set with open permissions: ugo+rw Jul 30 17:00:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c46d49e6-f801-4553-82a6-ed1c95ba394c tempest-SnapshotMetadataTestJSON-1261755755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-513f2f16-fb7e-4584-a5ab-86c64a8644c3.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:29 devstack sudo[101205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-513f2f16-fb7e-4584-a5ab-86c64a8644c3.info Jul 30 17:00:29 devstack sudo[101205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:29 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-2270eaac-5a1c-44fa-b0f5-6b5cf094f00f tempest-TestInstancesWithCinderVolumes-358578746 None] Acquiring lock "cinder-14efd33c-0eef-4e29-8d37-ebb314a03f58-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:00:29 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-2270eaac-5a1c-44fa-b0f5-6b5cf094f00f tempest-TestInstancesWithCinderVolumes-358578746 None] Lock "cinder-14efd33c-0eef-4e29-8d37-ebb314a03f58-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:00:29 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-2270eaac-5a1c-44fa-b0f5-6b5cf094f00f tempest-TestInstancesWithCinderVolumes-358578746 None] Acquiring lock "cinder-quobyte-14efd33c-0eef-4e29-8d37-ebb314a03f58" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:00:29 devstack sudo[101202]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f500d9f2-6c03-4672-aaee-a49af7cbb947 tempest-VolumesActionsTest-1280755332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f980cd79-ba0b-4a43-9339-e87a7849137f" returned: 0 in 0.296s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:29 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-2270eaac-5a1c-44fa-b0f5-6b5cf094f00f tempest-TestInstancesWithCinderVolumes-358578746 None] Lock "cinder-quobyte-14efd33c-0eef-4e29-8d37-ebb314a03f58" acquired by "delete_volume" :: waited 0.034s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:00:29 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f500d9f2-6c03-4672-aaee-a49af7cbb947 tempest-VolumesActionsTest-1280755332 None] Lock "cinder-quobyte-f980cd79-ba0b-4a43-9339-e87a7849137f" released by "delete_volume" :: held 0.752s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:00:30 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[323eec5f-0328-469a-b2ea-01307e0524e6]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:00:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2270eaac-5a1c-44fa-b0f5-6b5cf094f00f tempest-TestInstancesWithCinderVolumes-358578746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-14efd33c-0eef-4e29-8d37-ebb314a03f58 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:30 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-f500d9f2-6c03-4672-aaee-a49af7cbb947 tempest-VolumesActionsTest-1280755332 None] Created reservations ['258814a0-80d3-4d04-9dfa-89aa9aaf56fc', 'a58063df-6c75-4f70-bd30-1beeb8e74933', 'eb7e01cb-c63b-4656-bc8b-f0e0a57445aa', '5c96cf86-cf92-4707-bb1a-8e9ae2a6c1d6'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:00:30 devstack sudo[101205]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c46d49e6-f801-4553-82a6-ed1c95ba394c tempest-SnapshotMetadataTestJSON-1261755755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-513f2f16-fb7e-4584-a5ab-86c64a8644c3.info" returned: 0 in 0.314s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:30 devstack sudo[101208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-14efd33c-0eef-4e29-8d37-ebb314a03f58 Jul 30 17:00:30 devstack sudo[101208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c46d49e6-f801-4553-82a6-ed1c95ba394c tempest-SnapshotMetadataTestJSON-1261755755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.230s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:00:30 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-c46d49e6-f801-4553-82a6-ed1c95ba394c tempest-SnapshotMetadataTestJSON-1261755755 None] Create snapshot completed successfully Jul 30 17:00:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f500d9f2-6c03-4672-aaee-a49af7cbb947 tempest-VolumesActionsTest-1280755332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:00:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f500d9f2-6c03-4672-aaee-a49af7cbb947 tempest-VolumesActionsTest-1280755332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:00:30 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f500d9f2-6c03-4672-aaee-a49af7cbb947 tempest-VolumesActionsTest-1280755332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:00:30 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f500d9f2-6c03-4672-aaee-a49af7cbb947 tempest-VolumesActionsTest-1280755332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:00:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f500d9f2-6c03-4672-aaee-a49af7cbb947 tempest-VolumesActionsTest-1280755332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:00:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f500d9f2-6c03-4672-aaee-a49af7cbb947 tempest-VolumesActionsTest-1280755332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:30 devstack sudo[101211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:00:30 devstack sudo[101211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:30 devstack sudo[101208]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2270eaac-5a1c-44fa-b0f5-6b5cf094f00f tempest-TestInstancesWithCinderVolumes-358578746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-14efd33c-0eef-4e29-8d37-ebb314a03f58" returned: 0 in 0.486s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2270eaac-5a1c-44fa-b0f5-6b5cf094f00f tempest-TestInstancesWithCinderVolumes-358578746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-14efd33c-0eef-4e29-8d37-ebb314a03f58 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:30 devstack sudo[101211]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f500d9f2-6c03-4672-aaee-a49af7cbb947 tempest-VolumesActionsTest-1280755332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.323s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:30 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-f500d9f2-6c03-4672-aaee-a49af7cbb947 tempest-VolumesActionsTest-1280755332 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:00:30 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-f500d9f2-6c03-4672-aaee-a49af7cbb947 tempest-VolumesActionsTest-1280755332 None] Deleted volume successfully. Jul 30 17:00:30 devstack sudo[101218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-14efd33c-0eef-4e29-8d37-ebb314a03f58 Jul 30 17:00:30 devstack sudo[101218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:30 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f500d9f2-6c03-4672-aaee-a49af7cbb947 tempest-VolumesActionsTest-1280755332 None] Lock "cinder-f980cd79-ba0b-4a43-9339-e87a7849137f-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:00:30 devstack sudo[101218]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2270eaac-5a1c-44fa-b0f5-6b5cf094f00f tempest-TestInstancesWithCinderVolumes-358578746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-14efd33c-0eef-4e29-8d37-ebb314a03f58" returned: 0 in 0.390s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:30 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-2270eaac-5a1c-44fa-b0f5-6b5cf094f00f tempest-TestInstancesWithCinderVolumes-358578746 None] Lock "cinder-quobyte-14efd33c-0eef-4e29-8d37-ebb314a03f58" released by "delete_volume" :: held 0.942s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:00:30 devstack cinder-volume[88591]: WARNING cinder.quota [None req-2270eaac-5a1c-44fa-b0f5-6b5cf094f00f tempest-TestInstancesWithCinderVolumes-358578746 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-686761580-727816718 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-686761580-727816718, it is now deprecated. Please use the default quota class for default quota. Jul 30 17:00:30 devstack cinder-volume[88591]: WARNING cinder.quota [None req-2270eaac-5a1c-44fa-b0f5-6b5cf094f00f tempest-TestInstancesWithCinderVolumes-358578746 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-686761580-727816718 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-686761580-727816718, it is now deprecated. Please use the default quota class for default quota. Jul 30 17:00:30 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-2270eaac-5a1c-44fa-b0f5-6b5cf094f00f tempest-TestInstancesWithCinderVolumes-358578746 None] Created reservations ['400e3f92-7988-4633-aa5c-0e5e5e5d74d1', 'f0152fa9-dc1e-4633-bb8f-58033e9d896f', '757a03ae-26ca-493d-ae9a-15f896c09a50', '83ca94b4-83f8-45cb-9e5e-7dde3fa31b24'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:00:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2270eaac-5a1c-44fa-b0f5-6b5cf094f00f tempest-TestInstancesWithCinderVolumes-358578746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:00:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2270eaac-5a1c-44fa-b0f5-6b5cf094f00f tempest-TestInstancesWithCinderVolumes-358578746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:00:31 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-2270eaac-5a1c-44fa-b0f5-6b5cf094f00f tempest-TestInstancesWithCinderVolumes-358578746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:00:31 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-2270eaac-5a1c-44fa-b0f5-6b5cf094f00f tempest-TestInstancesWithCinderVolumes-358578746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:00:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2270eaac-5a1c-44fa-b0f5-6b5cf094f00f tempest-TestInstancesWithCinderVolumes-358578746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:00:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2270eaac-5a1c-44fa-b0f5-6b5cf094f00f tempest-TestInstancesWithCinderVolumes-358578746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:31 devstack sudo[101222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:00:31 devstack sudo[101222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:31 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f0943a79-fa29-4dc5-bd70-fb7820e2a89f tempest-SnapshotMetadataTestJSON-1261755755 None] Acquiring lock "cinder-e8d3b2de-bc7d-4c7f-861a-1f13519a9566-delete_snapshot" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:00:31 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f0943a79-fa29-4dc5-bd70-fb7820e2a89f tempest-SnapshotMetadataTestJSON-1261755755 None] Lock "cinder-e8d3b2de-bc7d-4c7f-861a-1f13519a9566-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:00:31 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f0943a79-fa29-4dc5-bd70-fb7820e2a89f tempest-SnapshotMetadataTestJSON-1261755755 None] Acquiring lock "cinder-quobyte-513f2f16-fb7e-4584-a5ab-86c64a8644c3" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:00:31 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f0943a79-fa29-4dc5-bd70-fb7820e2a89f tempest-SnapshotMetadataTestJSON-1261755755 None] Lock "cinder-quobyte-513f2f16-fb7e-4584-a5ab-86c64a8644c3" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:00:31 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f0943a79-fa29-4dc5-bd70-fb7820e2a89f tempest-SnapshotMetadataTestJSON-1261755755 None] Acquiring lock "cinder-quobyte-e8d3b2de-bc7d-4c7f-861a-1f13519a9566" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:00:31 devstack sudo[101222]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:31 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f0943a79-fa29-4dc5-bd70-fb7820e2a89f tempest-SnapshotMetadataTestJSON-1261755755 None] Lock "cinder-quobyte-e8d3b2de-bc7d-4c7f-861a-1f13519a9566" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:00:31 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-f0943a79-fa29-4dc5-bd70-fb7820e2a89f tempest-SnapshotMetadataTestJSON-1261755755 None] Deleting offline snapshot e8d3b2de-bc7d-4c7f-861a-1f13519a9566 of volume 513f2f16-fb7e-4584-a5ab-86c64a8644c3 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:00:31 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-f0943a79-fa29-4dc5-bd70-fb7820e2a89f tempest-SnapshotMetadataTestJSON-1261755755 None] snapshot_file for this snap is: volume-513f2f16-fb7e-4584-a5ab-86c64a8644c3.e8d3b2de-bc7d-4c7f-861a-1f13519a9566 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:00:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2270eaac-5a1c-44fa-b0f5-6b5cf094f00f tempest-TestInstancesWithCinderVolumes-358578746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.505s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:31 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-2270eaac-5a1c-44fa-b0f5-6b5cf094f00f tempest-TestInstancesWithCinderVolumes-358578746 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:00:31 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-2270eaac-5a1c-44fa-b0f5-6b5cf094f00f tempest-TestInstancesWithCinderVolumes-358578746 None] Deleted volume successfully. Jul 30 17:00:31 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[369783d5-20b5-4b28-8e32-857d3102302c]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:00:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f0943a79-fa29-4dc5-bd70-fb7820e2a89f tempest-SnapshotMetadataTestJSON-1261755755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-513f2f16-fb7e-4584-a5ab-86c64a8644c3.e8d3b2de-bc7d-4c7f-861a-1f13519a9566 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:31 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-2270eaac-5a1c-44fa-b0f5-6b5cf094f00f tempest-TestInstancesWithCinderVolumes-358578746 None] Lock "cinder-14efd33c-0eef-4e29-8d37-ebb314a03f58-delete_volume" released by "delete_volume" :: held 1.820s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:00:31 devstack sudo[101226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-513f2f16-fb7e-4584-a5ab-86c64a8644c3.e8d3b2de-bc7d-4c7f-861a-1f13519a9566 Jul 30 17:00:31 devstack sudo[101226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:32 devstack sudo[101226]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f0943a79-fa29-4dc5-bd70-fb7820e2a89f tempest-SnapshotMetadataTestJSON-1261755755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-513f2f16-fb7e-4584-a5ab-86c64a8644c3.e8d3b2de-bc7d-4c7f-861a-1f13519a9566" returned: 0 in 0.465s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:32 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-f0943a79-fa29-4dc5-bd70-fb7820e2a89f tempest-SnapshotMetadataTestJSON-1261755755 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-513f2f16-fb7e-4584-a5ab-86c64a8644c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:00:32 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf17125b-efdc-4168-ab25-677fe7ede349]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:00:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f0943a79-fa29-4dc5-bd70-fb7820e2a89f tempest-SnapshotMetadataTestJSON-1261755755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-513f2f16-fb7e-4584-a5ab-86c64a8644c3 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:32 devstack sudo[101232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-513f2f16-fb7e-4584-a5ab-86c64a8644c3 Jul 30 17:00:32 devstack sudo[101232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:32 devstack sudo[101232]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f0943a79-fa29-4dc5-bd70-fb7820e2a89f tempest-SnapshotMetadataTestJSON-1261755755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-513f2f16-fb7e-4584-a5ab-86c64a8644c3" returned: 0 in 0.459s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f0943a79-fa29-4dc5-bd70-fb7820e2a89f tempest-SnapshotMetadataTestJSON-1261755755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-513f2f16-fb7e-4584-a5ab-86c64a8644c3.e8d3b2de-bc7d-4c7f-861a-1f13519a9566 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:32 devstack sudo[101238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-513f2f16-fb7e-4584-a5ab-86c64a8644c3.e8d3b2de-bc7d-4c7f-861a-1f13519a9566 Jul 30 17:00:32 devstack sudo[101238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:33 devstack sudo[101238]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f0943a79-fa29-4dc5-bd70-fb7820e2a89f tempest-SnapshotMetadataTestJSON-1261755755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-513f2f16-fb7e-4584-a5ab-86c64a8644c3.e8d3b2de-bc7d-4c7f-861a-1f13519a9566" returned: 0 in 0.506s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f0943a79-fa29-4dc5-bd70-fb7820e2a89f tempest-SnapshotMetadataTestJSON-1261755755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-513f2f16-fb7e-4584-a5ab-86c64a8644c3.e8d3b2de-bc7d-4c7f-861a-1f13519a9566 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:33 devstack sudo[101246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-513f2f16-fb7e-4584-a5ab-86c64a8644c3.e8d3b2de-bc7d-4c7f-861a-1f13519a9566 Jul 30 17:00:33 devstack sudo[101246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:33 devstack sudo[101246]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f0943a79-fa29-4dc5-bd70-fb7820e2a89f tempest-SnapshotMetadataTestJSON-1261755755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-513f2f16-fb7e-4584-a5ab-86c64a8644c3.e8d3b2de-bc7d-4c7f-861a-1f13519a9566" returned: 0 in 0.334s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:33 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f0943a79-fa29-4dc5-bd70-fb7820e2a89f tempest-SnapshotMetadataTestJSON-1261755755 None] Lock "cinder-quobyte-e8d3b2de-bc7d-4c7f-861a-1f13519a9566" released by "_delete_snapshot" :: held 1.918s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:00:33 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f0943a79-fa29-4dc5-bd70-fb7820e2a89f tempest-SnapshotMetadataTestJSON-1261755755 None] Lock "cinder-quobyte-513f2f16-fb7e-4584-a5ab-86c64a8644c3" released by "delete_snapshot" :: held 1.958s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:00:33 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-f0943a79-fa29-4dc5-bd70-fb7820e2a89f tempest-SnapshotMetadataTestJSON-1261755755 None] Created reservations ['06bce817-33f9-414b-8eb4-ccfa98f18db2', '57823ad0-7182-4c1b-83f0-6bf9d6fb9382', 'b7340011-77da-45fb-896b-39720664aaa5', '901ac1f4-e4e0-4c4e-8658-14e28507cf0c'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:00:33 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-f0943a79-fa29-4dc5-bd70-fb7820e2a89f tempest-SnapshotMetadataTestJSON-1261755755 None] Delete snapshot completed successfully. Jul 30 17:00:33 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f0943a79-fa29-4dc5-bd70-fb7820e2a89f tempest-SnapshotMetadataTestJSON-1261755755 None] Lock "cinder-e8d3b2de-bc7d-4c7f-861a-1f13519a9566-delete_snapshot" released by "delete_snapshot" :: held 2.164s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:00:33 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-90d5c070-4c21-4c2d-b13c-26344cd0d83b tempest-SnapshotMetadataTestJSON-1261755755 None] Acquiring lock "cinder-513f2f16-fb7e-4584-a5ab-86c64a8644c3-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:00:34 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-90d5c070-4c21-4c2d-b13c-26344cd0d83b tempest-SnapshotMetadataTestJSON-1261755755 None] Lock "cinder-513f2f16-fb7e-4584-a5ab-86c64a8644c3-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:00:34 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-90d5c070-4c21-4c2d-b13c-26344cd0d83b tempest-SnapshotMetadataTestJSON-1261755755 None] Acquiring lock "cinder-quobyte-513f2f16-fb7e-4584-a5ab-86c64a8644c3" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:00:34 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-90d5c070-4c21-4c2d-b13c-26344cd0d83b tempest-SnapshotMetadataTestJSON-1261755755 None] Lock "cinder-quobyte-513f2f16-fb7e-4584-a5ab-86c64a8644c3" acquired by "delete_volume" :: waited 0.017s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:00:34 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8fb2acd-f0ea-4eaf-be1c-ae9e55039e7b]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:00:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-90d5c070-4c21-4c2d-b13c-26344cd0d83b tempest-SnapshotMetadataTestJSON-1261755755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-513f2f16-fb7e-4584-a5ab-86c64a8644c3 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:34 devstack sudo[101272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-513f2f16-fb7e-4584-a5ab-86c64a8644c3 Jul 30 17:00:34 devstack sudo[101272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:34 devstack sudo[101272]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-90d5c070-4c21-4c2d-b13c-26344cd0d83b tempest-SnapshotMetadataTestJSON-1261755755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-513f2f16-fb7e-4584-a5ab-86c64a8644c3" returned: 0 in 0.433s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-90d5c070-4c21-4c2d-b13c-26344cd0d83b tempest-SnapshotMetadataTestJSON-1261755755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-513f2f16-fb7e-4584-a5ab-86c64a8644c3 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:34 devstack sudo[101278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-513f2f16-fb7e-4584-a5ab-86c64a8644c3 Jul 30 17:00:34 devstack sudo[101278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:34 devstack sudo[101278]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:34 devstack cinder-volume[88591]: INFO cinder.volume.manager [req-d2fa20b1-5c62-46e3-9c30-c2b7e88af4df req-b791fbd8-ed32-46e7-8268-18a36b3f36c7 tempest-TestInstancesWithCinderVolumes-358578746 None] Terminate volume connection completed successfully. Jul 30 17:00:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-d2fa20b1-5c62-46e3-9c30-c2b7e88af4df req-b791fbd8-ed32-46e7-8268-18a36b3f36c7 tempest-TestInstancesWithCinderVolumes-358578746 None] Deleting attachment fc1c2fcd-5681-410f-bd28-c863b6c31a73. {{(pid=88591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 17:00:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-90d5c070-4c21-4c2d-b13c-26344cd0d83b tempest-SnapshotMetadataTestJSON-1261755755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-513f2f16-fb7e-4584-a5ab-86c64a8644c3" returned: 0 in 0.370s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:34 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-90d5c070-4c21-4c2d-b13c-26344cd0d83b tempest-SnapshotMetadataTestJSON-1261755755 None] Lock "cinder-quobyte-513f2f16-fb7e-4584-a5ab-86c64a8644c3" released by "delete_volume" :: held 0.893s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:00:35 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-90d5c070-4c21-4c2d-b13c-26344cd0d83b tempest-SnapshotMetadataTestJSON-1261755755 None] Created reservations ['279ce026-0655-4868-8f4a-af0b2568dfeb', 'f65a3603-9189-4747-ab05-ad2a3b468039', '87443529-fced-41df-9ba9-79d8dc162db0', 'ca9f1f8a-eb89-48e3-9dca-9453a2104484'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:00:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-90d5c070-4c21-4c2d-b13c-26344cd0d83b tempest-SnapshotMetadataTestJSON-1261755755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:00:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-90d5c070-4c21-4c2d-b13c-26344cd0d83b tempest-SnapshotMetadataTestJSON-1261755755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:00:35 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-90d5c070-4c21-4c2d-b13c-26344cd0d83b tempest-SnapshotMetadataTestJSON-1261755755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:00:35 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-90d5c070-4c21-4c2d-b13c-26344cd0d83b tempest-SnapshotMetadataTestJSON-1261755755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:00:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-90d5c070-4c21-4c2d-b13c-26344cd0d83b tempest-SnapshotMetadataTestJSON-1261755755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:00:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-90d5c070-4c21-4c2d-b13c-26344cd0d83b tempest-SnapshotMetadataTestJSON-1261755755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:35 devstack sudo[101283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:00:35 devstack sudo[101283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:35 devstack sudo[101283]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-90d5c070-4c21-4c2d-b13c-26344cd0d83b tempest-SnapshotMetadataTestJSON-1261755755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.353s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:35 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-90d5c070-4c21-4c2d-b13c-26344cd0d83b tempest-SnapshotMetadataTestJSON-1261755755 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:00:35 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-90d5c070-4c21-4c2d-b13c-26344cd0d83b tempest-SnapshotMetadataTestJSON-1261755755 None] Deleted volume successfully. Jul 30 17:00:35 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-90d5c070-4c21-4c2d-b13c-26344cd0d83b tempest-SnapshotMetadataTestJSON-1261755755 None] Lock "cinder-513f2f16-fb7e-4584-a5ab-86c64a8644c3-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:00:36 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-4ff8e1a5-4712-4113-88f7-58c2b2c716e4 tempest-TestInstancesWithCinderVolumes-358578746 None] Acquiring lock "cinder-2627b4e3-5b32-4ec8-a5d9-8c403228c543-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:00:36 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-4ff8e1a5-4712-4113-88f7-58c2b2c716e4 tempest-TestInstancesWithCinderVolumes-358578746 None] Lock "cinder-2627b4e3-5b32-4ec8-a5d9-8c403228c543-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:00:36 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-4ff8e1a5-4712-4113-88f7-58c2b2c716e4 tempest-TestInstancesWithCinderVolumes-358578746 None] Acquiring lock "cinder-quobyte-2627b4e3-5b32-4ec8-a5d9-8c403228c543" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:00:36 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-4ff8e1a5-4712-4113-88f7-58c2b2c716e4 tempest-TestInstancesWithCinderVolumes-358578746 None] Lock "cinder-quobyte-2627b4e3-5b32-4ec8-a5d9-8c403228c543" acquired by "delete_volume" :: waited 0.026s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:00:36 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d398a88-56e7-4d41-9d34-a35dd2163032]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:00:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4ff8e1a5-4712-4113-88f7-58c2b2c716e4 tempest-TestInstancesWithCinderVolumes-358578746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2627b4e3-5b32-4ec8-a5d9-8c403228c543 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:36 devstack sudo[101286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2627b4e3-5b32-4ec8-a5d9-8c403228c543 Jul 30 17:00:36 devstack sudo[101286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:36 devstack sudo[101286]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4ff8e1a5-4712-4113-88f7-58c2b2c716e4 tempest-TestInstancesWithCinderVolumes-358578746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2627b4e3-5b32-4ec8-a5d9-8c403228c543" returned: 0 in 0.468s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4ff8e1a5-4712-4113-88f7-58c2b2c716e4 tempest-TestInstancesWithCinderVolumes-358578746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2627b4e3-5b32-4ec8-a5d9-8c403228c543 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:36 devstack sudo[101292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2627b4e3-5b32-4ec8-a5d9-8c403228c543 Jul 30 17:00:36 devstack sudo[101292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:37 devstack sudo[101292]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4ff8e1a5-4712-4113-88f7-58c2b2c716e4 tempest-TestInstancesWithCinderVolumes-358578746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2627b4e3-5b32-4ec8-a5d9-8c403228c543" returned: 0 in 0.339s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:37 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-4ff8e1a5-4712-4113-88f7-58c2b2c716e4 tempest-TestInstancesWithCinderVolumes-358578746 None] Lock "cinder-quobyte-2627b4e3-5b32-4ec8-a5d9-8c403228c543" released by "delete_volume" :: held 0.861s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:00:37 devstack cinder-volume[88591]: WARNING cinder.quota [None req-4ff8e1a5-4712-4113-88f7-58c2b2c716e4 tempest-TestInstancesWithCinderVolumes-358578746 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1881003687-1663116688 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1881003687-1663116688, it is now deprecated. Please use the default quota class for default quota. Jul 30 17:00:37 devstack cinder-volume[88591]: WARNING cinder.quota [None req-4ff8e1a5-4712-4113-88f7-58c2b2c716e4 tempest-TestInstancesWithCinderVolumes-358578746 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1881003687-1663116688 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1881003687-1663116688, it is now deprecated. Please use the default quota class for default quota. Jul 30 17:00:37 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-4ff8e1a5-4712-4113-88f7-58c2b2c716e4 tempest-TestInstancesWithCinderVolumes-358578746 None] Created reservations ['8e8d33e9-53c2-4683-ba92-24ba44a68893', '4193ccc7-682f-4d13-be7f-7ba755a01d60', '52907c56-bec5-4ea7-8791-3ad5367d8cdb', '4fa025b7-7601-45f9-8672-c48bfb2092a8'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:00:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-4ff8e1a5-4712-4113-88f7-58c2b2c716e4 tempest-TestInstancesWithCinderVolumes-358578746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:00:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-4ff8e1a5-4712-4113-88f7-58c2b2c716e4 tempest-TestInstancesWithCinderVolumes-358578746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:00:37 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-4ff8e1a5-4712-4113-88f7-58c2b2c716e4 tempest-TestInstancesWithCinderVolumes-358578746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:00:37 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-4ff8e1a5-4712-4113-88f7-58c2b2c716e4 tempest-TestInstancesWithCinderVolumes-358578746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:00:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-4ff8e1a5-4712-4113-88f7-58c2b2c716e4 tempest-TestInstancesWithCinderVolumes-358578746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:00:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4ff8e1a5-4712-4113-88f7-58c2b2c716e4 tempest-TestInstancesWithCinderVolumes-358578746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:37 devstack sudo[101295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:00:37 devstack sudo[101295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:37 devstack sudo[101295]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4ff8e1a5-4712-4113-88f7-58c2b2c716e4 tempest-TestInstancesWithCinderVolumes-358578746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.283s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:37 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-4ff8e1a5-4712-4113-88f7-58c2b2c716e4 tempest-TestInstancesWithCinderVolumes-358578746 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:00:37 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-4ff8e1a5-4712-4113-88f7-58c2b2c716e4 tempest-TestInstancesWithCinderVolumes-358578746 None] Deleted volume successfully. Jul 30 17:00:37 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-4ff8e1a5-4712-4113-88f7-58c2b2c716e4 tempest-TestInstancesWithCinderVolumes-358578746 None] Lock "cinder-2627b4e3-5b32-4ec8-a5d9-8c403228c543-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:00:39 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-677267bf-9ae8-4068-a2ee-c9b0117665ca tempest-VolumesDeleteCascade-1931691609 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:00:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-677267bf-9ae8-4068-a2ee-c9b0117665ca tempest-VolumesDeleteCascade-1931691609 None] Flow 'volume_create_manager' (8a2323b2-6b77-4354-b369-0e1441511f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:00:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-677267bf-9ae8-4068-a2ee-c9b0117665ca tempest-VolumesDeleteCascade-1931691609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7670ed6-dae6-4327-a785-ac1628a271dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:00:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-677267bf-9ae8-4068-a2ee-c9b0117665ca tempest-VolumesDeleteCascade-1931691609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7670ed6-dae6-4327-a785-ac1628a271dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:00:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1278834676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baf2ff61-5cc3-4bca-9bba-a78343c22318,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baa4f167a88d413ea4324a241828dcf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:00:39Z,use_quota=True,user_id='970610264ec84d35ac2b14e89fe45184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:00:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-677267bf-9ae8-4068-a2ee-c9b0117665ca tempest-VolumesDeleteCascade-1931691609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dfea320-e22c-4a1d-850e-72dd71d33e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:00:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-677267bf-9ae8-4068-a2ee-c9b0117665ca tempest-VolumesDeleteCascade-1931691609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dfea320-e22c-4a1d-850e-72dd71d33e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:00:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-677267bf-9ae8-4068-a2ee-c9b0117665ca tempest-VolumesDeleteCascade-1931691609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7436b028-e611-4ebd-bcfe-58c24dd14c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:00:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-677267bf-9ae8-4068-a2ee-c9b0117665ca tempest-VolumesDeleteCascade-1931691609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7436b028-e611-4ebd-bcfe-58c24dd14c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'baf2ff61-5cc3-4bca-9bba-a78343c22318', 'volume_name': 'volume-baf2ff61-5cc3-4bca-9bba-a78343c22318', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:00:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-677267bf-9ae8-4068-a2ee-c9b0117665ca tempest-VolumesDeleteCascade-1931691609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e8fb939-8fde-42ca-8f6f-221e24b17653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:00:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-677267bf-9ae8-4068-a2ee-c9b0117665ca tempest-VolumesDeleteCascade-1931691609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e8fb939-8fde-42ca-8f6f-221e24b17653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:00:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-677267bf-9ae8-4068-a2ee-c9b0117665ca tempest-VolumesDeleteCascade-1931691609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d0b8bd6-1e4a-4e57-b908-785932b0733d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:00:39 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-677267bf-9ae8-4068-a2ee-c9b0117665ca tempest-VolumesDeleteCascade-1931691609 None] Volume baf2ff61-5cc3-4bca-9bba-a78343c22318: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-baf2ff61-5cc3-4bca-9bba-a78343c22318', 'volume_size': 1} Jul 30 17:00:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-677267bf-9ae8-4068-a2ee-c9b0117665ca tempest-VolumesDeleteCascade-1931691609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:00:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-677267bf-9ae8-4068-a2ee-c9b0117665ca tempest-VolumesDeleteCascade-1931691609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:00:39 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-677267bf-9ae8-4068-a2ee-c9b0117665ca tempest-VolumesDeleteCascade-1931691609 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:00:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1278834676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baf2ff61-5cc3-4bca-9bba-a78343c22318,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baa4f167a88d413ea4324a241828dcf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:00:39Z,use_quota=True,user_id='970610264ec84d35ac2b14e89fe45184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:00:39 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-677267bf-9ae8-4068-a2ee-c9b0117665ca tempest-VolumesDeleteCascade-1931691609 None] Creating volume baf2ff61-5cc3-4bca-9bba-a78343c22318 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:00:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-677267bf-9ae8-4068-a2ee-c9b0117665ca tempest-VolumesDeleteCascade-1931691609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:00:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-677267bf-9ae8-4068-a2ee-c9b0117665ca tempest-VolumesDeleteCascade-1931691609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:00:39 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-677267bf-9ae8-4068-a2ee-c9b0117665ca tempest-VolumesDeleteCascade-1931691609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:00:39 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-677267bf-9ae8-4068-a2ee-c9b0117665ca tempest-VolumesDeleteCascade-1931691609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:00:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-677267bf-9ae8-4068-a2ee-c9b0117665ca tempest-VolumesDeleteCascade-1931691609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:00:39 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-677267bf-9ae8-4068-a2ee-c9b0117665ca tempest-VolumesDeleteCascade-1931691609 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:00:39 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-677267bf-9ae8-4068-a2ee-c9b0117665ca tempest-VolumesDeleteCascade-1931691609 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:00:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-677267bf-9ae8-4068-a2ee-c9b0117665ca tempest-VolumesDeleteCascade-1931691609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:39 devstack sudo[101298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318 1073741824 Jul 30 17:00:39 devstack sudo[101298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:39 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:00:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] Flow 'volume_create_manager' (719f99d2-ee10-4270-a0a9-f13d61910a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:00:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98a676ea-092b-43a8-a580-68b2223d8aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:00:39 devstack sudo[101298]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-677267bf-9ae8-4068-a2ee-c9b0117665ca tempest-VolumesDeleteCascade-1931691609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318 1073741824" returned: 0 in 0.542s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98a676ea-092b-43a8-a580-68b2223d8aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:00:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1519134915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57e91a18-035b-4ede-84b7-9527ca0b1260,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4895a538d9314e559e11ab07204e0e44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:00:40Z,use_quota=True,user_id='f833cee52c1e48cd978e166608f46582',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:00:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d90bb76-8b16-4e44-951e-2e52bfb6531d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:00:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d90bb76-8b16-4e44-951e-2e52bfb6531d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:00:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (702f854b-4273-42f9-b684-d3e0fa99b14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:00:39 devstack cinder-volume[88591]: DEBUG cinder.image.glance [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] Creating Keystone auth plugin from conf {{(pid=88591) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 30 17:00:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-677267bf-9ae8-4068-a2ee-c9b0117665ca tempest-VolumesDeleteCascade-1931691609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:39 devstack sudo[101305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318 Jul 30 17:00:39 devstack sudo[101305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (702f854b-4273-42f9-b684-d3e0fa99b14c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '57e91a18-035b-4ede-84b7-9527ca0b1260', 'volume_name': 'volume-57e91a18-035b-4ede-84b7-9527ca0b1260', 'volume_size': 1, 'image_id': 'fb94d6e3-28d4-406f-8bad-19349d5f8454', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fb94d6e3-28d4-406f-8bad-19349d5f8454', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7e05c21dff7b441db433e2a7736519e9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fb94d6e3-28d4-406f-8bad-19349d5f8454', 'created_at': datetime.datetime(2026, 7, 30, 14, 42, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 42, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fb94d6e3-28d4-406f-8bad-19349d5f8454/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:00:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b42f0c38-3257-43ce-962a-0423633f228c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:00:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b42f0c38-3257-43ce-962a-0423633f228c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:00:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01e09cb0-b4cd-4efc-a5a2-a2b620728884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:00:40 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] Volume 57e91a18-035b-4ede-84b7-9527ca0b1260: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-57e91a18-035b-4ede-84b7-9527ca0b1260', 'volume_size': 1, 'image_id': 'fb94d6e3-28d4-406f-8bad-19349d5f8454', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fb94d6e3-28d4-406f-8bad-19349d5f8454', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7e05c21dff7b441db433e2a7736519e9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fb94d6e3-28d4-406f-8bad-19349d5f8454', 'created_at': datetime.datetime(2026, 7, 30, 14, 42, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 42, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fb94d6e3-28d4-406f-8bad-19349d5f8454/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 30 17:00:40 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] Trying to clone 57e91a18-035b-4ede-84b7-9527ca0b1260 from image fb94d6e3-28d4-406f-8bad-19349d5f8454 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fb94d6e3-28d4-406f-8bad-19349d5f8454', 'metadata': {}}]). {{(pid=88591) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 30 17:00:40 devstack sudo[101305]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-677267bf-9ae8-4068-a2ee-c9b0117665ca tempest-VolumesDeleteCascade-1931691609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318" returned: 0 in 0.278s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:40 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-677267bf-9ae8-4068-a2ee-c9b0117665ca tempest-VolumesDeleteCascade-1931691609 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:00:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-677267bf-9ae8-4068-a2ee-c9b0117665ca tempest-VolumesDeleteCascade-1931691609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:00:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-677267bf-9ae8-4068-a2ee-c9b0117665ca tempest-VolumesDeleteCascade-1931691609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d0b8bd6-1e4a-4e57-b908-785932b0733d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-baf2ff61-5cc3-4bca-9bba-a78343c22318', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:00:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-677267bf-9ae8-4068-a2ee-c9b0117665ca tempest-VolumesDeleteCascade-1931691609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bec236fb-60b3-4c2c-878b-eb64beaedc1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:00:40 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-677267bf-9ae8-4068-a2ee-c9b0117665ca tempest-VolumesDeleteCascade-1931691609 None] Volume volume-baf2ff61-5cc3-4bca-9bba-a78343c22318 (baf2ff61-5cc3-4bca-9bba-a78343c22318): created successfully Jul 30 17:00:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-677267bf-9ae8-4068-a2ee-c9b0117665ca tempest-VolumesDeleteCascade-1931691609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bec236fb-60b3-4c2c-878b-eb64beaedc1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:00:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-677267bf-9ae8-4068-a2ee-c9b0117665ca tempest-VolumesDeleteCascade-1931691609 None] Flow 'volume_create_manager' (8a2323b2-6b77-4354-b369-0e1441511f52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:00:40 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-677267bf-9ae8-4068-a2ee-c9b0117665ca tempest-VolumesDeleteCascade-1931691609 None] Created volume successfully. Jul 30 17:00:40 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_d16lr04ndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88591) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 30 17:00:40 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] Image download 20.69 MB at 20.69 MB/s Jul 30 17:00:40 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[554a1597-2fd5-4399-b71c-f863d6065286]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:00:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_d16lr04ndevstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:40 devstack sudo[101309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_d16lr04ndevstack@QuobyteHD Jul 30 17:00:40 devstack sudo[101309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:40 devstack sudo[101309]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_d16lr04ndevstack@QuobyteHD" returned: 0 in 0.374s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:40 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] Temporary image fb94d6e3-28d4-406f-8bad-19349d5f8454 is fetched for user f833cee52c1e48cd978e166608f46582. {{(pid=88591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 30 17:00:40 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c6d17a-844b-4b1a-b500-49276bf7cdb3]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:00:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_d16lr04ndevstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:41 devstack sudo[101314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_d16lr04ndevstack@QuobyteHD Jul 30 17:00:41 devstack sudo[101314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:41 devstack sudo[101314]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-44800dd8-9090-4971-9b84-db39ecb391d4 tempest-VolumesDeleteCascade-1931691609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:00:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-44800dd8-9090-4971-9b84-db39ecb391d4 tempest-VolumesDeleteCascade-1931691609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:00:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_d16lr04ndevstack@QuobyteHD" returned: 0 in 0.439s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:00:41 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-44800dd8-9090-4971-9b84-db39ecb391d4 tempest-VolumesDeleteCascade-1931691609 None] Creating offline snapshot 00a68231-baee-458b-926e-079832d932e6 of volume baf2ff61-5cc3-4bca-9bba-a78343c22318 {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:00:41 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e879655-c432-44a6-8048-0786648f1a94]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:00:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-44800dd8-9090-4971-9b84-db39ecb391d4 tempest-VolumesDeleteCascade-1931691609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:41 devstack sudo[101319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318 Jul 30 17:00:41 devstack sudo[101319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:41 devstack sudo[101319]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-44800dd8-9090-4971-9b84-db39ecb391d4 tempest-VolumesDeleteCascade-1931691609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318" returned: 0 in 0.414s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-44800dd8-9090-4971-9b84-db39ecb391d4 tempest-VolumesDeleteCascade-1931691609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.00a68231-baee-458b-926e-079832d932e6 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:41 devstack sudo[101324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.00a68231-baee-458b-926e-079832d932e6 1G Jul 30 17:00:41 devstack sudo[101324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:42 devstack sudo[101324]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-44800dd8-9090-4971-9b84-db39ecb391d4 tempest-VolumesDeleteCascade-1931691609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.00a68231-baee-458b-926e-079832d932e6 1G" returned: 0 in 0.456s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-44800dd8-9090-4971-9b84-db39ecb391d4 tempest-VolumesDeleteCascade-1931691609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-baf2ff61-5cc3-4bca-9bba-a78343c22318 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.00a68231-baee-458b-926e-079832d932e6 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:42 devstack sudo[101332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-baf2ff61-5cc3-4bca-9bba-a78343c22318 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.00a68231-baee-458b-926e-079832d932e6 Jul 30 17:00:42 devstack sudo[101332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:42 devstack sudo[101332]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-44800dd8-9090-4971-9b84-db39ecb391d4 tempest-VolumesDeleteCascade-1931691609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-baf2ff61-5cc3-4bca-9bba-a78343c22318 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.00a68231-baee-458b-926e-079832d932e6" returned: 0 in 0.287s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:42 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-44800dd8-9090-4971-9b84-db39ecb391d4 tempest-VolumesDeleteCascade-1931691609 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.00a68231-baee-458b-926e-079832d932e6 is being set with open permissions: ugo+rw Jul 30 17:00:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-44800dd8-9090-4971-9b84-db39ecb391d4 tempest-VolumesDeleteCascade-1931691609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.00a68231-baee-458b-926e-079832d932e6 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:42 devstack sudo[101337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.00a68231-baee-458b-926e-079832d932e6 Jul 30 17:00:42 devstack sudo[101337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:42 devstack sudo[101337]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-44800dd8-9090-4971-9b84-db39ecb391d4 tempest-VolumesDeleteCascade-1931691609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.00a68231-baee-458b-926e-079832d932e6" returned: 0 in 0.287s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-44800dd8-9090-4971-9b84-db39ecb391d4 tempest-VolumesDeleteCascade-1931691609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:42 devstack sudo[101340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.info Jul 30 17:00:42 devstack sudo[101340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:43 devstack sudo[101340]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-44800dd8-9090-4971-9b84-db39ecb391d4 tempest-VolumesDeleteCascade-1931691609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.info" returned: 0 in 0.242s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:43 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-44800dd8-9090-4971-9b84-db39ecb391d4 tempest-VolumesDeleteCascade-1931691609 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.info is being set with open permissions: ugo+rw Jul 30 17:00:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-44800dd8-9090-4971-9b84-db39ecb391d4 tempest-VolumesDeleteCascade-1931691609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:43 devstack sudo[101343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.info Jul 30 17:00:43 devstack sudo[101343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:43 devstack sudo[101343]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-44800dd8-9090-4971-9b84-db39ecb391d4 tempest-VolumesDeleteCascade-1931691609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.info" returned: 0 in 0.248s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-44800dd8-9090-4971-9b84-db39ecb391d4 tempest-VolumesDeleteCascade-1931691609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.026s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:00:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.024s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:00:43 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:00:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1519134915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57e91a18-035b-4ede-84b7-9527ca0b1260,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4895a538d9314e559e11ab07204e0e44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:00:40Z,use_quota=True,user_id='f833cee52c1e48cd978e166608f46582',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:00:43 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] Creating volume 57e91a18-035b-4ede-84b7-9527ca0b1260 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:00:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:00:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:00:43 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:00:43 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:00:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:00:43 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:00:43 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:00:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57e91a18-035b-4ede-84b7-9527ca0b1260 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:43 devstack sudo[101346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57e91a18-035b-4ede-84b7-9527ca0b1260 1073741824 Jul 30 17:00:43 devstack sudo[101346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:43 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-44800dd8-9090-4971-9b84-db39ecb391d4 tempest-VolumesDeleteCascade-1931691609 None] Create snapshot completed successfully Jul 30 17:00:43 devstack sudo[101346]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57e91a18-035b-4ede-84b7-9527ca0b1260 1073741824" returned: 0 in 0.492s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57e91a18-035b-4ede-84b7-9527ca0b1260 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:44 devstack sudo[101353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57e91a18-035b-4ede-84b7-9527ca0b1260 Jul 30 17:00:44 devstack sudo[101353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:44 devstack sudo[101353]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57e91a18-035b-4ede-84b7-9527ca0b1260" returned: 0 in 0.258s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:44 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:00:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:00:44 devstack cinder-volume[88591]: DEBUG cinder.volume.volume_utils [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] Attempting download of fb94d6e3-28d4-406f-8bad-19349d5f8454 ((None, [{'url': 'file:///opt/stack/data/glance/images/fb94d6e3-28d4-406f-8bad-19349d5f8454', 'metadata': {}}])) to volume 57e91a18-035b-4ede-84b7-9527ca0b1260. {{(pid=88591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 30 17:00:44 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[badd0479-acf9-43e8-82fb-e38fe71b5080]: (4, 'raw') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:00:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fb94d6e3-28d4-406f-8bad-19349d5f8454_g91es0c4 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:44 devstack sudo[101356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fb94d6e3-28d4-406f-8bad-19349d5f8454_g91es0c4 Jul 30 17:00:44 devstack sudo[101356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:44 devstack sudo[101356]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fb94d6e3-28d4-406f-8bad-19349d5f8454_g91es0c4" returned: 0 in 0.388s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fb94d6e3-28d4-406f-8bad-19349d5f8454_g91es0c4 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-37caa7d8-b783-4b4b-b1c0-2196d2d03227 tempest-VolumesDeleteCascade-1931691609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:00:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-37caa7d8-b783-4b4b-b1c0-2196d2d03227 tempest-VolumesDeleteCascade-1931691609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:00:44 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-37caa7d8-b783-4b4b-b1c0-2196d2d03227 tempest-VolumesDeleteCascade-1931691609 None] Creating offline snapshot 75cba2bc-8bc4-427b-af72-895e357bd8fd of volume baf2ff61-5cc3-4bca-9bba-a78343c22318 {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:00:44 devstack sudo[101360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fb94d6e3-28d4-406f-8bad-19349d5f8454_g91es0c4 Jul 30 17:00:44 devstack sudo[101360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:44 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9a74ca-434c-4278-ad4c-56094cbcee9b]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:00:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-37caa7d8-b783-4b4b-b1c0-2196d2d03227 tempest-VolumesDeleteCascade-1931691609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.00a68231-baee-458b-926e-079832d932e6 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:45 devstack sudo[101362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.00a68231-baee-458b-926e-079832d932e6 Jul 30 17:00:45 devstack sudo[101362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:45 devstack sudo[101360]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fb94d6e3-28d4-406f-8bad-19349d5f8454_g91es0c4" returned: 1 in 0.450s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fb94d6e3-28d4-406f-8bad-19349d5f8454_g91es0c4' failed. Not Retrying. {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 17:00:45 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc62e6f-3542-4897-a60e-807004e0ce76]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:00:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_d16lr04ndevstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:45 devstack sudo[101366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_d16lr04ndevstack@QuobyteHD Jul 30 17:00:45 devstack sudo[101366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:45 devstack sudo[101362]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-37caa7d8-b783-4b4b-b1c0-2196d2d03227 tempest-VolumesDeleteCascade-1931691609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.00a68231-baee-458b-926e-079832d932e6" returned: 0 in 0.424s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:45 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-37caa7d8-b783-4b4b-b1c0-2196d2d03227 tempest-VolumesDeleteCascade-1931691609 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-baf2ff61-5cc3-4bca-9bba-a78343c22318(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:00:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-37caa7d8-b783-4b4b-b1c0-2196d2d03227 tempest-VolumesDeleteCascade-1931691609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.00a68231-baee-458b-926e-079832d932e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.75cba2bc-8bc4-427b-af72-895e357bd8fd 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:45 devstack sudo[101371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.00a68231-baee-458b-926e-079832d932e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.75cba2bc-8bc4-427b-af72-895e357bd8fd 1G Jul 30 17:00:45 devstack sudo[101371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:45 devstack sudo[101366]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_d16lr04ndevstack@QuobyteHD" returned: 0 in 0.368s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:45 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] fb94d6e3-28d4-406f-8bad-19349d5f8454 was qcow2, converting to qcow2 {{(pid=88591) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 30 17:00:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_d16lr04ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57e91a18-035b-4ede-84b7-9527ca0b1260 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:45 devstack sudo[101376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_d16lr04ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57e91a18-035b-4ede-84b7-9527ca0b1260 Jul 30 17:00:45 devstack sudo[101376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:45 devstack sudo[101371]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-37caa7d8-b783-4b4b-b1c0-2196d2d03227 tempest-VolumesDeleteCascade-1931691609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.00a68231-baee-458b-926e-079832d932e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.75cba2bc-8bc4-427b-af72-895e357bd8fd 1G" returned: 0 in 0.569s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-37caa7d8-b783-4b4b-b1c0-2196d2d03227 tempest-VolumesDeleteCascade-1931691609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.00a68231-baee-458b-926e-079832d932e6 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.75cba2bc-8bc4-427b-af72-895e357bd8fd {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:45 devstack sudo[101387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.00a68231-baee-458b-926e-079832d932e6 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.75cba2bc-8bc4-427b-af72-895e357bd8fd Jul 30 17:00:45 devstack sudo[101387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:46 devstack sudo[101387]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-37caa7d8-b783-4b4b-b1c0-2196d2d03227 tempest-VolumesDeleteCascade-1931691609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.00a68231-baee-458b-926e-079832d932e6 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.75cba2bc-8bc4-427b-af72-895e357bd8fd" returned: 0 in 0.368s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:46 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-37caa7d8-b783-4b4b-b1c0-2196d2d03227 tempest-VolumesDeleteCascade-1931691609 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.75cba2bc-8bc4-427b-af72-895e357bd8fd is being set with open permissions: ugo+rw Jul 30 17:00:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-37caa7d8-b783-4b4b-b1c0-2196d2d03227 tempest-VolumesDeleteCascade-1931691609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.75cba2bc-8bc4-427b-af72-895e357bd8fd {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:46 devstack sudo[101409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.75cba2bc-8bc4-427b-af72-895e357bd8fd Jul 30 17:00:46 devstack sudo[101409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:46 devstack sudo[101409]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-37caa7d8-b783-4b4b-b1c0-2196d2d03227 tempest-VolumesDeleteCascade-1931691609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.75cba2bc-8bc4-427b-af72-895e357bd8fd" returned: 0 in 0.294s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-37caa7d8-b783-4b4b-b1c0-2196d2d03227 tempest-VolumesDeleteCascade-1931691609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.876s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:00:46 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-37caa7d8-b783-4b4b-b1c0-2196d2d03227 tempest-VolumesDeleteCascade-1931691609 None] Create snapshot completed successfully Jul 30 17:00:46 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Acquiring lock "cinder-baf2ff61-5cc3-4bca-9bba-a78343c22318-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:00:47 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Lock "cinder-baf2ff61-5cc3-4bca-9bba-a78343c22318-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:00:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Performing cascade delete. {{(pid=88591) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 30 17:00:47 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Acquiring lock "cinder-00a68231-baee-458b-926e-079832d932e6-delete_snapshot" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:00:47 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Lock "cinder-00a68231-baee-458b-926e-079832d932e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:00:47 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Acquiring lock "cinder-quobyte-baf2ff61-5cc3-4bca-9bba-a78343c22318" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:00:47 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Lock "cinder-quobyte-baf2ff61-5cc3-4bca-9bba-a78343c22318" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:00:47 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Acquiring lock "cinder-quobyte-00a68231-baee-458b-926e-079832d932e6" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:00:47 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Lock "cinder-quobyte-00a68231-baee-458b-926e-079832d932e6" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:00:47 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Deleting offline snapshot 00a68231-baee-458b-926e-079832d932e6 of volume baf2ff61-5cc3-4bca-9bba-a78343c22318 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:00:47 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] snapshot_file for this snap is: volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.00a68231-baee-458b-926e-079832d932e6 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:00:47 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f0934d-22a9-4d20-b684-76f11513f663]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:00:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.00a68231-baee-458b-926e-079832d932e6 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:47 devstack sudo[101434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.00a68231-baee-458b-926e-079832d932e6 Jul 30 17:00:47 devstack sudo[101434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:47 devstack sudo[101434]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.00a68231-baee-458b-926e-079832d932e6" returned: 0 in 0.446s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:47 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-baf2ff61-5cc3-4bca-9bba-a78343c22318(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:00:47 devstack sudo[101376]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_d16lr04ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57e91a18-035b-4ede-84b7-9527ca0b1260" returned: 0 in 2.186s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:47 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_d16lr04ndevstack@QuobyteHD, size 112.00 MB, duration 2.19 sec, destination /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57e91a18-035b-4ede-84b7-9527ca0b1260 {{(pid=88591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 17:00:47 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] Converted 112.00 MB image at 51.22 MB/s Jul 30 17:00:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57e91a18-035b-4ede-84b7-9527ca0b1260 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:47 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[4245c52c-d6b6-44db-818b-903b638498a3]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:00:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:47 devstack sudo[101439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57e91a18-035b-4ede-84b7-9527ca0b1260 1G Jul 30 17:00:47 devstack sudo[101439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:47 devstack sudo[101440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318 Jul 30 17:00:47 devstack sudo[101440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:48 devstack sudo[101439]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57e91a18-035b-4ede-84b7-9527ca0b1260 1G" returned: 0 in 0.364s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:48 devstack cinder-volume[88591]: DEBUG cinder.volume.volume_utils [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] Downloaded image fb94d6e3-28d4-406f-8bad-19349d5f8454 ((None, [{'url': 'file:///opt/stack/data/glance/images/fb94d6e3-28d4-406f-8bad-19349d5f8454', 'metadata': {}}])) to volume 57e91a18-035b-4ede-84b7-9527ca0b1260 successfully. {{(pid=88591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 30 17:00:48 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] Temporary image fb94d6e3-28d4-406f-8bad-19349d5f8454 for user f833cee52c1e48cd978e166608f46582 is deleted. {{(pid=88591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 30 17:00:48 devstack cinder-volume[88591]: DEBUG cinder.volume.volume_utils [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] Marking volume 57e91a18-035b-4ede-84b7-9527ca0b1260 as bootable. {{(pid=88591) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 30 17:00:48 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] Copying metadata from image fb94d6e3-28d4-406f-8bad-19349d5f8454 to 57e91a18-035b-4ede-84b7-9527ca0b1260. {{(pid=88591) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 30 17:00:48 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] Creating volume glance metadata for volume 57e91a18-035b-4ede-84b7-9527ca0b1260 backed by image fb94d6e3-28d4-406f-8bad-19349d5f8454 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fb94d6e3-28d4-406f-8bad-19349d5f8454', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88591) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 30 17:00:48 devstack sudo[101440]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318" returned: 0 in 0.449s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:48 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c4d308-9b0a-4e3f-acf4-e73f84d43a83]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:00:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.75cba2bc-8bc4-427b-af72-895e357bd8fd {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:48 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01e09cb0-b4cd-4efc-a5a2-a2b620728884) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57e91a18-035b-4ede-84b7-9527ca0b1260', 'volume_size': 1, 'image_id': 'fb94d6e3-28d4-406f-8bad-19349d5f8454', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fb94d6e3-28d4-406f-8bad-19349d5f8454', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7e05c21dff7b441db433e2a7736519e9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fb94d6e3-28d4-406f-8bad-19349d5f8454', 'created_at': datetime.datetime(2026, 7, 30, 14, 42, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 42, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fb94d6e3-28d4-406f-8bad-19349d5f8454/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:00:48 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af3ed567-6092-4fc2-acf3-2ed7dd0119e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:00:48 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] Volume volume-57e91a18-035b-4ede-84b7-9527ca0b1260 (57e91a18-035b-4ede-84b7-9527ca0b1260): created successfully Jul 30 17:00:48 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af3ed567-6092-4fc2-acf3-2ed7dd0119e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:00:48 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] Flow 'volume_create_manager' (719f99d2-ee10-4270-a0a9-f13d61910a96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:00:48 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-475b80d0-1643-4e75-bf4f-80aef07a08f9 tempest-VolumesExtendTest-1971058098 None] Created volume successfully. Jul 30 17:00:48 devstack sudo[101449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.75cba2bc-8bc4-427b-af72-895e357bd8fd Jul 30 17:00:48 devstack sudo[101449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:48 devstack sudo[101449]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.75cba2bc-8bc4-427b-af72-895e357bd8fd" returned: 0 in 0.400s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:48 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-baf2ff61-5cc3-4bca-9bba-a78343c22318(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:00:48 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[468d0760-40fa-4d4f-9772-dd9172e9d10d]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:00:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.00a68231-baee-458b-926e-079832d932e6 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:48 devstack sudo[101454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.00a68231-baee-458b-926e-079832d932e6 Jul 30 17:00:48 devstack sudo[101454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:49 devstack sudo[101454]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.00a68231-baee-458b-926e-079832d932e6" returned: 0 in 0.397s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:49 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-baf2ff61-5cc3-4bca-9bba-a78343c22318(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:00:49 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d25ecf7-95b8-4ffe-aebb-9bd620a23d0c]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:00:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:49 devstack sudo[101459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318 Jul 30 17:00:49 devstack sudo[101459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-233e539c-2654-4bd0-be93-312b98313eb6 tempest-VolumesExtendTest-1971058098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:00:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-233e539c-2654-4bd0-be93-312b98313eb6 tempest-VolumesExtendTest-1971058098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:00:49 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7efa17-662a-4854-9035-b8269ce251b7]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:00:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-233e539c-2654-4bd0-be93-312b98313eb6 tempest-VolumesExtendTest-1971058098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57e91a18-035b-4ede-84b7-9527ca0b1260 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:49 devstack sudo[101459]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318" returned: 0 in 0.436s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.00a68231-baee-458b-926e-079832d932e6 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:49 devstack sudo[101465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.00a68231-baee-458b-926e-079832d932e6 Jul 30 17:00:49 devstack sudo[101465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:49 devstack sudo[101464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57e91a18-035b-4ede-84b7-9527ca0b1260 Jul 30 17:00:49 devstack sudo[101464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:49 devstack sudo[101465]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.00a68231-baee-458b-926e-079832d932e6" returned: 0 in 0.435s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.00a68231-baee-458b-926e-079832d932e6 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:49 devstack sudo[101476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.00a68231-baee-458b-926e-079832d932e6 Jul 30 17:00:49 devstack sudo[101476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:49 devstack sudo[101464]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-233e539c-2654-4bd0-be93-312b98313eb6 tempest-VolumesExtendTest-1971058098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57e91a18-035b-4ede-84b7-9527ca0b1260" returned: 0 in 0.505s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-233e539c-2654-4bd0-be93-312b98313eb6 tempest-VolumesExtendTest-1971058098 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57e91a18-035b-4ede-84b7-9527ca0b1260 2G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-233e539c-2654-4bd0-be93-312b98313eb6 tempest-VolumesExtendTest-1971058098 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57e91a18-035b-4ede-84b7-9527ca0b1260 2G" returned: 0 in 0.135s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-233e539c-2654-4bd0-be93-312b98313eb6 tempest-VolumesExtendTest-1971058098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.676s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:00:50 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-233e539c-2654-4bd0-be93-312b98313eb6 tempest-VolumesExtendTest-1971058098 None] Extend volume completed successfully. Jul 30 17:00:50 devstack sudo[101476]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.00a68231-baee-458b-926e-079832d932e6" returned: 0 in 0.312s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-baf2ff61-5cc3-4bca-9bba-a78343c22318 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.75cba2bc-8bc4-427b-af72-895e357bd8fd -F qcow2 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:50 devstack sudo[101483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-baf2ff61-5cc3-4bca-9bba-a78343c22318 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.75cba2bc-8bc4-427b-af72-895e357bd8fd -F qcow2 Jul 30 17:00:50 devstack sudo[101483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:50 devstack sudo[101483]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-baf2ff61-5cc3-4bca-9bba-a78343c22318 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.75cba2bc-8bc4-427b-af72-895e357bd8fd -F qcow2" returned: 0 in 0.357s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:50 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Lock "cinder-quobyte-00a68231-baee-458b-926e-079832d932e6" released by "_delete_snapshot" :: held 3.461s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:00:50 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Lock "cinder-quobyte-baf2ff61-5cc3-4bca-9bba-a78343c22318" released by "delete_snapshot" :: held 3.497s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:00:50 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Created reservations ['08dd597f-4b8a-412b-a1cf-b8d85f1995ca', 'f84af417-734b-480c-924b-f6c73e352fa3', '4aa29054-0aef-418c-a8ee-e17ac9f1bc03', 'a8db3895-344e-4b71-957c-c85569e4fb8a'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:00:50 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-8ef34ce9-9acf-42ad-b4b2-eae4b6fa10cc tempest-VolumesExtendTest-1971058098 None] Acquiring lock "cinder-57e91a18-035b-4ede-84b7-9527ca0b1260-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:00:50 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-8ef34ce9-9acf-42ad-b4b2-eae4b6fa10cc tempest-VolumesExtendTest-1971058098 None] Lock "cinder-57e91a18-035b-4ede-84b7-9527ca0b1260-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:00:50 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-8ef34ce9-9acf-42ad-b4b2-eae4b6fa10cc tempest-VolumesExtendTest-1971058098 None] Acquiring lock "cinder-quobyte-57e91a18-035b-4ede-84b7-9527ca0b1260" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:00:50 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-8ef34ce9-9acf-42ad-b4b2-eae4b6fa10cc tempest-VolumesExtendTest-1971058098 None] Lock "cinder-quobyte-57e91a18-035b-4ede-84b7-9527ca0b1260" acquired by "delete_volume" :: waited 0.025s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:00:50 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Delete snapshot completed successfully. Jul 30 17:00:50 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Lock "cinder-00a68231-baee-458b-926e-079832d932e6-delete_snapshot" released by "delete_snapshot" :: held 3.828s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:00:50 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Acquiring lock "cinder-75cba2bc-8bc4-427b-af72-895e357bd8fd-delete_snapshot" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:00:50 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f19bbbf-9d0e-4454-a12e-055d67c36289]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:00:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8ef34ce9-9acf-42ad-b4b2-eae4b6fa10cc tempest-VolumesExtendTest-1971058098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57e91a18-035b-4ede-84b7-9527ca0b1260 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:51 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Lock "cinder-75cba2bc-8bc4-427b-af72-895e357bd8fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:00:51 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Acquiring lock "cinder-quobyte-baf2ff61-5cc3-4bca-9bba-a78343c22318" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:00:51 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Lock "cinder-quobyte-baf2ff61-5cc3-4bca-9bba-a78343c22318" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:00:51 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Acquiring lock "cinder-quobyte-75cba2bc-8bc4-427b-af72-895e357bd8fd" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:00:51 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Lock "cinder-quobyte-75cba2bc-8bc4-427b-af72-895e357bd8fd" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:00:51 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Deleting offline snapshot 75cba2bc-8bc4-427b-af72-895e357bd8fd of volume baf2ff61-5cc3-4bca-9bba-a78343c22318 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:00:51 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] snapshot_file for this snap is: volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.75cba2bc-8bc4-427b-af72-895e357bd8fd {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:00:51 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[783baa38-46fb-4086-aeac-eb81c6d65dcc]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:00:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.75cba2bc-8bc4-427b-af72-895e357bd8fd {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:51 devstack sudo[101494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57e91a18-035b-4ede-84b7-9527ca0b1260 Jul 30 17:00:51 devstack sudo[101494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:51 devstack sudo[101495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.75cba2bc-8bc4-427b-af72-895e357bd8fd Jul 30 17:00:51 devstack sudo[101495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:51 devstack sudo[101494]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8ef34ce9-9acf-42ad-b4b2-eae4b6fa10cc tempest-VolumesExtendTest-1971058098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57e91a18-035b-4ede-84b7-9527ca0b1260" returned: 0 in 0.453s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8ef34ce9-9acf-42ad-b4b2-eae4b6fa10cc tempest-VolumesExtendTest-1971058098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57e91a18-035b-4ede-84b7-9527ca0b1260 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:51 devstack sudo[101503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57e91a18-035b-4ede-84b7-9527ca0b1260 Jul 30 17:00:51 devstack sudo[101503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:51 devstack sudo[101495]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.75cba2bc-8bc4-427b-af72-895e357bd8fd" returned: 0 in 0.425s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:51 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-baf2ff61-5cc3-4bca-9bba-a78343c22318(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:00:51 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42631e9-ce6d-4b63-abe9-10d5a318a6f3]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:00:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:51 devstack sudo[101506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318 Jul 30 17:00:51 devstack sudo[101506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:51 devstack sudo[101503]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8ef34ce9-9acf-42ad-b4b2-eae4b6fa10cc tempest-VolumesExtendTest-1971058098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57e91a18-035b-4ede-84b7-9527ca0b1260" returned: 0 in 0.273s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:51 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-8ef34ce9-9acf-42ad-b4b2-eae4b6fa10cc tempest-VolumesExtendTest-1971058098 None] Lock "cinder-quobyte-57e91a18-035b-4ede-84b7-9527ca0b1260" released by "delete_volume" :: held 0.805s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:00:51 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-8ef34ce9-9acf-42ad-b4b2-eae4b6fa10cc tempest-VolumesExtendTest-1971058098 None] Created reservations ['91a93893-10ab-47b0-b57b-7ed4f8b0e69a', '2d0617da-9208-49bd-8334-7a90548b9c8d', '7ad22d3c-b4b5-4561-b95e-7c7a8c918cd3', 'cb7c2a23-608d-4e1c-b700-45f465669baf'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:00:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8ef34ce9-9acf-42ad-b4b2-eae4b6fa10cc tempest-VolumesExtendTest-1971058098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:00:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8ef34ce9-9acf-42ad-b4b2-eae4b6fa10cc tempest-VolumesExtendTest-1971058098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:00:51 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-8ef34ce9-9acf-42ad-b4b2-eae4b6fa10cc tempest-VolumesExtendTest-1971058098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:00:51 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-8ef34ce9-9acf-42ad-b4b2-eae4b6fa10cc tempest-VolumesExtendTest-1971058098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:00:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8ef34ce9-9acf-42ad-b4b2-eae4b6fa10cc tempest-VolumesExtendTest-1971058098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:00:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8ef34ce9-9acf-42ad-b4b2-eae4b6fa10cc tempest-VolumesExtendTest-1971058098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:51 devstack sudo[101509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:00:51 devstack sudo[101509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:52 devstack sudo[101506]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318" returned: 0 in 0.523s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.75cba2bc-8bc4-427b-af72-895e357bd8fd {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:52 devstack sudo[101515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.75cba2bc-8bc4-427b-af72-895e357bd8fd Jul 30 17:00:52 devstack sudo[101515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:52 devstack sudo[101509]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8ef34ce9-9acf-42ad-b4b2-eae4b6fa10cc tempest-VolumesExtendTest-1971058098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.305s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:52 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-8ef34ce9-9acf-42ad-b4b2-eae4b6fa10cc tempest-VolumesExtendTest-1971058098 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:00:52 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-8ef34ce9-9acf-42ad-b4b2-eae4b6fa10cc tempest-VolumesExtendTest-1971058098 None] Deleted volume successfully. Jul 30 17:00:52 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-8ef34ce9-9acf-42ad-b4b2-eae4b6fa10cc tempest-VolumesExtendTest-1971058098 None] Lock "cinder-57e91a18-035b-4ede-84b7-9527ca0b1260-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:00:52 devstack sudo[101515]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.75cba2bc-8bc4-427b-af72-895e357bd8fd" returned: 0 in 0.480s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.75cba2bc-8bc4-427b-af72-895e357bd8fd {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:52 devstack sudo[101522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.75cba2bc-8bc4-427b-af72-895e357bd8fd Jul 30 17:00:52 devstack sudo[101522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:52 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c5c3c06-6376-49bd-b152-ac80d520e368 tempest-VolumesExtendTest-1971058098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:00:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8c5c3c06-6376-49bd-b152-ac80d520e368 tempest-VolumesExtendTest-1971058098 None] Flow 'volume_create_manager' (a0d3858f-3edb-4ec3-82b0-fd23bc73425f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:00:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8c5c3c06-6376-49bd-b152-ac80d520e368 tempest-VolumesExtendTest-1971058098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c4ec72e-69df-4298-8e33-c82946fbb743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:00:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8c5c3c06-6376-49bd-b152-ac80d520e368 tempest-VolumesExtendTest-1971058098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c4ec72e-69df-4298-8e33-c82946fbb743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:00:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-992710020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=563b442f-b0c0-4db6-8960-5b67bd05d8bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4895a538d9314e559e11ab07204e0e44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:00:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:00:53Z,use_quota=True,user_id='f833cee52c1e48cd978e166608f46582',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:00:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8c5c3c06-6376-49bd-b152-ac80d520e368 tempest-VolumesExtendTest-1971058098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc2b1c35-83b6-4be7-b370-34068dbb047f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:00:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8c5c3c06-6376-49bd-b152-ac80d520e368 tempest-VolumesExtendTest-1971058098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc2b1c35-83b6-4be7-b370-34068dbb047f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:00:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8c5c3c06-6376-49bd-b152-ac80d520e368 tempest-VolumesExtendTest-1971058098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db534e04-bf42-4af3-a6d9-da2dbda29008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:00:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8c5c3c06-6376-49bd-b152-ac80d520e368 tempest-VolumesExtendTest-1971058098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db534e04-bf42-4af3-a6d9-da2dbda29008) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '563b442f-b0c0-4db6-8960-5b67bd05d8bb', 'volume_name': 'volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:00:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8c5c3c06-6376-49bd-b152-ac80d520e368 tempest-VolumesExtendTest-1971058098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f63c4ce-230b-4df7-9125-8daad04f0707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:00:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8c5c3c06-6376-49bd-b152-ac80d520e368 tempest-VolumesExtendTest-1971058098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f63c4ce-230b-4df7-9125-8daad04f0707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:00:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8c5c3c06-6376-49bd-b152-ac80d520e368 tempest-VolumesExtendTest-1971058098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b581c7d1-2178-411b-b90e-0801bfcd66d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:00:52 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-8c5c3c06-6376-49bd-b152-ac80d520e368 tempest-VolumesExtendTest-1971058098 None] Volume 563b442f-b0c0-4db6-8960-5b67bd05d8bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb', 'volume_size': 1} Jul 30 17:00:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8c5c3c06-6376-49bd-b152-ac80d520e368 tempest-VolumesExtendTest-1971058098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:00:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8c5c3c06-6376-49bd-b152-ac80d520e368 tempest-VolumesExtendTest-1971058098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:00:52 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-8c5c3c06-6376-49bd-b152-ac80d520e368 tempest-VolumesExtendTest-1971058098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:00:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-992710020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=563b442f-b0c0-4db6-8960-5b67bd05d8bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4895a538d9314e559e11ab07204e0e44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:00:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:00:53Z,use_quota=True,user_id='f833cee52c1e48cd978e166608f46582',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:00:52 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-8c5c3c06-6376-49bd-b152-ac80d520e368 tempest-VolumesExtendTest-1971058098 None] Creating volume 563b442f-b0c0-4db6-8960-5b67bd05d8bb {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:00:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8c5c3c06-6376-49bd-b152-ac80d520e368 tempest-VolumesExtendTest-1971058098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:00:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8c5c3c06-6376-49bd-b152-ac80d520e368 tempest-VolumesExtendTest-1971058098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:00:52 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-8c5c3c06-6376-49bd-b152-ac80d520e368 tempest-VolumesExtendTest-1971058098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:00:52 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-8c5c3c06-6376-49bd-b152-ac80d520e368 tempest-VolumesExtendTest-1971058098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:00:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8c5c3c06-6376-49bd-b152-ac80d520e368 tempest-VolumesExtendTest-1971058098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:00:52 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-8c5c3c06-6376-49bd-b152-ac80d520e368 tempest-VolumesExtendTest-1971058098 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:00:52 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-8c5c3c06-6376-49bd-b152-ac80d520e368 tempest-VolumesExtendTest-1971058098 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:00:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8c5c3c06-6376-49bd-b152-ac80d520e368 tempest-VolumesExtendTest-1971058098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:52 devstack sudo[101524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb 1073741824 Jul 30 17:00:52 devstack sudo[101524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:52 devstack sudo[101522]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318.75cba2bc-8bc4-427b-af72-895e357bd8fd" returned: 0 in 0.319s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:52 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Lock "cinder-quobyte-75cba2bc-8bc4-427b-af72-895e357bd8fd" released by "_delete_snapshot" :: held 1.873s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:00:52 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Lock "cinder-quobyte-baf2ff61-5cc3-4bca-9bba-a78343c22318" released by "delete_snapshot" :: held 1.913s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:00:53 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Created reservations ['5cd695f9-8265-46e3-b372-3a087779131c', 'c9435613-2732-448a-9e98-76f01dca65ce', '6ceabc50-7c6c-41aa-8125-ff005974a649', '86606dca-f87f-42fc-8465-a411b4e415c5'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:00:53 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Delete snapshot completed successfully. Jul 30 17:00:53 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Lock "cinder-75cba2bc-8bc4-427b-af72-895e357bd8fd-delete_snapshot" released by "delete_snapshot" :: held 2.106s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:00:53 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Snapshots deleted, issuing volume delete {{(pid=88591) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 30 17:00:53 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Acquiring lock "cinder-quobyte-baf2ff61-5cc3-4bca-9bba-a78343c22318" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:00:53 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Lock "cinder-quobyte-baf2ff61-5cc3-4bca-9bba-a78343c22318" acquired by "delete_volume" :: waited 0.017s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:00:53 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[037eecc4-2c84-439f-813e-e4a41df83695]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:00:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:53 devstack sudo[101524]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8c5c3c06-6376-49bd-b152-ac80d520e368 tempest-VolumesExtendTest-1971058098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb 1073741824" returned: 0 in 0.549s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:53 devstack sudo[101531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318 Jul 30 17:00:53 devstack sudo[101531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8c5c3c06-6376-49bd-b152-ac80d520e368 tempest-VolumesExtendTest-1971058098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:53 devstack sudo[101533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb Jul 30 17:00:53 devstack sudo[101533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:53 devstack sudo[101531]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318" returned: 0 in 0.460s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:53 devstack sudo[101533]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8c5c3c06-6376-49bd-b152-ac80d520e368 tempest-VolumesExtendTest-1971058098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb" returned: 0 in 0.324s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:53 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-8c5c3c06-6376-49bd-b152-ac80d520e368 tempest-VolumesExtendTest-1971058098 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:00:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8c5c3c06-6376-49bd-b152-ac80d520e368 tempest-VolumesExtendTest-1971058098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:00:53 devstack sudo[101540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318 Jul 30 17:00:53 devstack sudo[101540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:53 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8c5c3c06-6376-49bd-b152-ac80d520e368 tempest-VolumesExtendTest-1971058098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b581c7d1-2178-411b-b90e-0801bfcd66d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:00:53 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8c5c3c06-6376-49bd-b152-ac80d520e368 tempest-VolumesExtendTest-1971058098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (407478df-5876-4a8c-b68b-607a2a6b8ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:00:53 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-8c5c3c06-6376-49bd-b152-ac80d520e368 tempest-VolumesExtendTest-1971058098 None] Volume volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb (563b442f-b0c0-4db6-8960-5b67bd05d8bb): created successfully Jul 30 17:00:53 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8c5c3c06-6376-49bd-b152-ac80d520e368 tempest-VolumesExtendTest-1971058098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (407478df-5876-4a8c-b68b-607a2a6b8ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:00:53 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8c5c3c06-6376-49bd-b152-ac80d520e368 tempest-VolumesExtendTest-1971058098 None] Flow 'volume_create_manager' (a0d3858f-3edb-4ec3-82b0-fd23bc73425f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:00:53 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-8c5c3c06-6376-49bd-b152-ac80d520e368 tempest-VolumesExtendTest-1971058098 None] Created volume successfully. Jul 30 17:00:53 devstack sudo[101540]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baf2ff61-5cc3-4bca-9bba-a78343c22318" returned: 0 in 0.303s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:53 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Lock "cinder-quobyte-baf2ff61-5cc3-4bca-9bba-a78343c22318" released by "delete_volume" :: held 0.825s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:00:54 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Created reservations ['732a4583-9063-42b3-8ce6-7df16889f190', '32a12f1c-c3bf-413b-b279-9e08ac12735a', 'fbcdd467-1d2a-4d0c-9567-dd5f3b4953fe', 'f9fe8bd5-74b1-4f1d-8098-7a204938e5e9'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:00:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:00:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:00:54 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:00:54 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:00:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:00:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:54 devstack sudo[101543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:00:54 devstack sudo[101543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:54 devstack sudo[101543]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.261s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:54 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:00:54 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Deleted volume successfully. Jul 30 17:00:54 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-75f1d9e5-6b26-48fb-a014-7ed216c510fc tempest-VolumesDeleteCascade-1931691609 None] Lock "cinder-baf2ff61-5cc3-4bca-9bba-a78343c22318-delete_volume" released by "delete_volume" :: held 7.331s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:00:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c45e4ea2-952e-4743-8d54-058eb58b2718 tempest-VolumesExtendTest-1971058098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:00:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c45e4ea2-952e-4743-8d54-058eb58b2718 tempest-VolumesExtendTest-1971058098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:00:55 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-c45e4ea2-952e-4743-8d54-058eb58b2718 tempest-VolumesExtendTest-1971058098 None] Creating offline snapshot 31828a05-8449-4ba3-95a1-b481e03b82fb of volume 563b442f-b0c0-4db6-8960-5b67bd05d8bb {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:00:55 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d71427a-582a-462a-a095-c3ab3774375d]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:00:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c45e4ea2-952e-4743-8d54-058eb58b2718 tempest-VolumesExtendTest-1971058098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:55 devstack sudo[101546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb Jul 30 17:00:55 devstack sudo[101546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:55 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7c37926-8b9b-4ab4-99a1-00e021eea898 tempest-VolumesDeleteCascade-1931691609 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:00:55 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b7c37926-8b9b-4ab4-99a1-00e021eea898 tempest-VolumesDeleteCascade-1931691609 None] Flow 'volume_create_manager' (bac4453b-4f46-4ae5-b0c2-0c0ac94435f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:00:55 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b7c37926-8b9b-4ab4-99a1-00e021eea898 tempest-VolumesDeleteCascade-1931691609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccfeb08d-365a-42c5-949d-da106fa33507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:00:55 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b7c37926-8b9b-4ab4-99a1-00e021eea898 tempest-VolumesDeleteCascade-1931691609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccfeb08d-365a-42c5-949d-da106fa33507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:00:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-135836031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=114f44d0-3633-4b82-b396-0829e7dfc1f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baa4f167a88d413ea4324a241828dcf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:00:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:00:55Z,use_quota=True,user_id='970610264ec84d35ac2b14e89fe45184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:00:55 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b7c37926-8b9b-4ab4-99a1-00e021eea898 tempest-VolumesDeleteCascade-1931691609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb4e347e-51da-4266-874e-ba04e08dde5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:00:55 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b7c37926-8b9b-4ab4-99a1-00e021eea898 tempest-VolumesDeleteCascade-1931691609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb4e347e-51da-4266-874e-ba04e08dde5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:00:55 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b7c37926-8b9b-4ab4-99a1-00e021eea898 tempest-VolumesDeleteCascade-1931691609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de5ef799-0cdd-4926-884f-eb214a89b60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:00:55 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b7c37926-8b9b-4ab4-99a1-00e021eea898 tempest-VolumesDeleteCascade-1931691609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de5ef799-0cdd-4926-884f-eb214a89b60b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '114f44d0-3633-4b82-b396-0829e7dfc1f7', 'volume_name': 'volume-114f44d0-3633-4b82-b396-0829e7dfc1f7', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:00:55 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b7c37926-8b9b-4ab4-99a1-00e021eea898 tempest-VolumesDeleteCascade-1931691609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d90d9a31-40f0-45f4-8e80-545fdfe5dd38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:00:55 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b7c37926-8b9b-4ab4-99a1-00e021eea898 tempest-VolumesDeleteCascade-1931691609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d90d9a31-40f0-45f4-8e80-545fdfe5dd38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:00:55 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b7c37926-8b9b-4ab4-99a1-00e021eea898 tempest-VolumesDeleteCascade-1931691609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c220bb6-d742-454c-bd47-fae13420fbfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:00:55 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-b7c37926-8b9b-4ab4-99a1-00e021eea898 tempest-VolumesDeleteCascade-1931691609 None] Volume 114f44d0-3633-4b82-b396-0829e7dfc1f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-114f44d0-3633-4b82-b396-0829e7dfc1f7', 'volume_size': 1} Jul 30 17:00:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b7c37926-8b9b-4ab4-99a1-00e021eea898 tempest-VolumesDeleteCascade-1931691609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:00:55 devstack sudo[101546]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c45e4ea2-952e-4743-8d54-058eb58b2718 tempest-VolumesExtendTest-1971058098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb" returned: 0 in 0.467s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c45e4ea2-952e-4743-8d54-058eb58b2718 tempest-VolumesExtendTest-1971058098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb.31828a05-8449-4ba3-95a1-b481e03b82fb 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:55 devstack sudo[101551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb.31828a05-8449-4ba3-95a1-b481e03b82fb 1G Jul 30 17:00:55 devstack sudo[101551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:56 devstack sudo[101551]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c45e4ea2-952e-4743-8d54-058eb58b2718 tempest-VolumesExtendTest-1971058098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb.31828a05-8449-4ba3-95a1-b481e03b82fb 1G" returned: 0 in 0.439s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c45e4ea2-952e-4743-8d54-058eb58b2718 tempest-VolumesExtendTest-1971058098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb.31828a05-8449-4ba3-95a1-b481e03b82fb {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:56 devstack sudo[101556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb.31828a05-8449-4ba3-95a1-b481e03b82fb Jul 30 17:00:56 devstack sudo[101556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:56 devstack sudo[101556]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c45e4ea2-952e-4743-8d54-058eb58b2718 tempest-VolumesExtendTest-1971058098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb.31828a05-8449-4ba3-95a1-b481e03b82fb" returned: 0 in 0.326s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:56 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-c45e4ea2-952e-4743-8d54-058eb58b2718 tempest-VolumesExtendTest-1971058098 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb.31828a05-8449-4ba3-95a1-b481e03b82fb is being set with open permissions: ugo+rw Jul 30 17:00:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c45e4ea2-952e-4743-8d54-058eb58b2718 tempest-VolumesExtendTest-1971058098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb.31828a05-8449-4ba3-95a1-b481e03b82fb {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:56 devstack sudo[101561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb.31828a05-8449-4ba3-95a1-b481e03b82fb Jul 30 17:00:56 devstack sudo[101561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:56 devstack sudo[101561]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c45e4ea2-952e-4743-8d54-058eb58b2718 tempest-VolumesExtendTest-1971058098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb.31828a05-8449-4ba3-95a1-b481e03b82fb" returned: 0 in 0.271s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c45e4ea2-952e-4743-8d54-058eb58b2718 tempest-VolumesExtendTest-1971058098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:56 devstack sudo[101564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb.info Jul 30 17:00:56 devstack sudo[101564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:57 devstack sudo[101564]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c45e4ea2-952e-4743-8d54-058eb58b2718 tempest-VolumesExtendTest-1971058098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb.info" returned: 0 in 0.275s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:57 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-c45e4ea2-952e-4743-8d54-058eb58b2718 tempest-VolumesExtendTest-1971058098 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb.info is being set with open permissions: ugo+rw Jul 30 17:00:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c45e4ea2-952e-4743-8d54-058eb58b2718 tempest-VolumesExtendTest-1971058098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:57 devstack sudo[101567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb.info Jul 30 17:00:57 devstack sudo[101567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:57 devstack sudo[101567]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c45e4ea2-952e-4743-8d54-058eb58b2718 tempest-VolumesExtendTest-1971058098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb.info" returned: 0 in 0.258s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c45e4ea2-952e-4743-8d54-058eb58b2718 tempest-VolumesExtendTest-1971058098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.143s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:00:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b7c37926-8b9b-4ab4-99a1-00e021eea898 tempest-VolumesDeleteCascade-1931691609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.689s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:00:57 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b7c37926-8b9b-4ab4-99a1-00e021eea898 tempest-VolumesDeleteCascade-1931691609 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:00:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-135836031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=114f44d0-3633-4b82-b396-0829e7dfc1f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baa4f167a88d413ea4324a241828dcf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:00:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:00:55Z,use_quota=True,user_id='970610264ec84d35ac2b14e89fe45184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:00:57 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-b7c37926-8b9b-4ab4-99a1-00e021eea898 tempest-VolumesDeleteCascade-1931691609 None] Creating volume 114f44d0-3633-4b82-b396-0829e7dfc1f7 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:00:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b7c37926-8b9b-4ab4-99a1-00e021eea898 tempest-VolumesDeleteCascade-1931691609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:00:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b7c37926-8b9b-4ab4-99a1-00e021eea898 tempest-VolumesDeleteCascade-1931691609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:00:57 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b7c37926-8b9b-4ab4-99a1-00e021eea898 tempest-VolumesDeleteCascade-1931691609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:00:57 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b7c37926-8b9b-4ab4-99a1-00e021eea898 tempest-VolumesDeleteCascade-1931691609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:00:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b7c37926-8b9b-4ab4-99a1-00e021eea898 tempest-VolumesDeleteCascade-1931691609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:00:57 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b7c37926-8b9b-4ab4-99a1-00e021eea898 tempest-VolumesDeleteCascade-1931691609 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:00:57 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-b7c37926-8b9b-4ab4-99a1-00e021eea898 tempest-VolumesDeleteCascade-1931691609 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:00:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b7c37926-8b9b-4ab4-99a1-00e021eea898 tempest-VolumesDeleteCascade-1931691609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-114f44d0-3633-4b82-b396-0829e7dfc1f7 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:57 devstack sudo[101570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-114f44d0-3633-4b82-b396-0829e7dfc1f7 1073741824 Jul 30 17:00:57 devstack sudo[101570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:57 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-c45e4ea2-952e-4743-8d54-058eb58b2718 tempest-VolumesExtendTest-1971058098 None] Create snapshot completed successfully Jul 30 17:00:57 devstack sudo[101570]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b7c37926-8b9b-4ab4-99a1-00e021eea898 tempest-VolumesDeleteCascade-1931691609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-114f44d0-3633-4b82-b396-0829e7dfc1f7 1073741824" returned: 0 in 0.511s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b7c37926-8b9b-4ab4-99a1-00e021eea898 tempest-VolumesDeleteCascade-1931691609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-114f44d0-3633-4b82-b396-0829e7dfc1f7 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:57 devstack sudo[101576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-114f44d0-3633-4b82-b396-0829e7dfc1f7 Jul 30 17:00:57 devstack sudo[101576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:58 devstack sudo[101576]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b7c37926-8b9b-4ab4-99a1-00e021eea898 tempest-VolumesDeleteCascade-1931691609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-114f44d0-3633-4b82-b396-0829e7dfc1f7" returned: 0 in 0.252s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:58 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b7c37926-8b9b-4ab4-99a1-00e021eea898 tempest-VolumesDeleteCascade-1931691609 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:00:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b7c37926-8b9b-4ab4-99a1-00e021eea898 tempest-VolumesDeleteCascade-1931691609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:00:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b7c37926-8b9b-4ab4-99a1-00e021eea898 tempest-VolumesDeleteCascade-1931691609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c220bb6-d742-454c-bd47-fae13420fbfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-114f44d0-3633-4b82-b396-0829e7dfc1f7', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:00:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b7c37926-8b9b-4ab4-99a1-00e021eea898 tempest-VolumesDeleteCascade-1931691609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9507554a-d826-4356-8991-3a9dcd2b3655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:00:58 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-b7c37926-8b9b-4ab4-99a1-00e021eea898 tempest-VolumesDeleteCascade-1931691609 None] Volume volume-114f44d0-3633-4b82-b396-0829e7dfc1f7 (114f44d0-3633-4b82-b396-0829e7dfc1f7): created successfully Jul 30 17:00:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b7c37926-8b9b-4ab4-99a1-00e021eea898 tempest-VolumesDeleteCascade-1931691609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9507554a-d826-4356-8991-3a9dcd2b3655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:00:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b7c37926-8b9b-4ab4-99a1-00e021eea898 tempest-VolumesDeleteCascade-1931691609 None] Flow 'volume_create_manager' (bac4453b-4f46-4ae5-b0c2-0c0ac94435f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:00:58 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-b7c37926-8b9b-4ab4-99a1-00e021eea898 tempest-VolumesDeleteCascade-1931691609 None] Created volume successfully. Jul 30 17:00:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-77433511-fb86-4878-9851-32370e7d998f tempest-VolumesExtendTest-1971058098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:00:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-77433511-fb86-4878-9851-32370e7d998f tempest-VolumesExtendTest-1971058098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:00:58 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9a5d01-dcbb-4a48-a7b4-414de4e6a4e4]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:00:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-77433511-fb86-4878-9851-32370e7d998f tempest-VolumesExtendTest-1971058098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:58 devstack sudo[101579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb Jul 30 17:00:58 devstack sudo[101579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:58 devstack sudo[101579]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-e1889e69-3017-420b-b276-68f3770964ed tempest-VolumesDeleteCascade-1931691609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:00:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-77433511-fb86-4878-9851-32370e7d998f tempest-VolumesExtendTest-1971058098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb" returned: 0 in 0.474s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-77433511-fb86-4878-9851-32370e7d998f tempest-VolumesExtendTest-1971058098 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb.31828a05-8449-4ba3-95a1-b481e03b82fb 2G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-77433511-fb86-4878-9851-32370e7d998f tempest-VolumesExtendTest-1971058098 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb.31828a05-8449-4ba3-95a1-b481e03b82fb 2G" returned: 0 in 0.159s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-77433511-fb86-4878-9851-32370e7d998f tempest-VolumesExtendTest-1971058098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.672s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:00:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-e1889e69-3017-420b-b276-68f3770964ed tempest-VolumesDeleteCascade-1931691609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.189s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:00:59 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-e1889e69-3017-420b-b276-68f3770964ed tempest-VolumesDeleteCascade-1931691609 None] Creating offline snapshot c96fe4fc-9974-4cfb-b9d6-0645f5362452 of volume 114f44d0-3633-4b82-b396-0829e7dfc1f7 {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:00:59 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db256ae-8832-418b-b859-321d0f974f4f]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:00:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e1889e69-3017-420b-b276-68f3770964ed tempest-VolumesDeleteCascade-1931691609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-114f44d0-3633-4b82-b396-0829e7dfc1f7 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:59 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-77433511-fb86-4878-9851-32370e7d998f tempest-VolumesExtendTest-1971058098 None] Extend volume completed successfully. Jul 30 17:00:59 devstack sudo[101588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-114f44d0-3633-4b82-b396-0829e7dfc1f7 Jul 30 17:00:59 devstack sudo[101588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:59 devstack sudo[101588]: pam_unix(sudo:session): session closed for user root Jul 30 17:00:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e1889e69-3017-420b-b276-68f3770964ed tempest-VolumesDeleteCascade-1931691609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-114f44d0-3633-4b82-b396-0829e7dfc1f7" returned: 0 in 0.474s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:00:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e1889e69-3017-420b-b276-68f3770964ed tempest-VolumesDeleteCascade-1931691609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-114f44d0-3633-4b82-b396-0829e7dfc1f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-114f44d0-3633-4b82-b396-0829e7dfc1f7.c96fe4fc-9974-4cfb-b9d6-0645f5362452 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:00:59 devstack sudo[101593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-114f44d0-3633-4b82-b396-0829e7dfc1f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-114f44d0-3633-4b82-b396-0829e7dfc1f7.c96fe4fc-9974-4cfb-b9d6-0645f5362452 1G Jul 30 17:00:59 devstack sudo[101593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:00:59 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-6b928e48-d1c4-45b1-9ad5-eadd94f60eca tempest-VolumesExtendTest-1971058098 None] Acquiring lock "cinder-31828a05-8449-4ba3-95a1-b481e03b82fb-delete_snapshot" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:00:59 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-6b928e48-d1c4-45b1-9ad5-eadd94f60eca tempest-VolumesExtendTest-1971058098 None] Lock "cinder-31828a05-8449-4ba3-95a1-b481e03b82fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:00:59 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-6b928e48-d1c4-45b1-9ad5-eadd94f60eca tempest-VolumesExtendTest-1971058098 None] Acquiring lock "cinder-quobyte-563b442f-b0c0-4db6-8960-5b67bd05d8bb" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:00:59 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-6b928e48-d1c4-45b1-9ad5-eadd94f60eca tempest-VolumesExtendTest-1971058098 None] Lock "cinder-quobyte-563b442f-b0c0-4db6-8960-5b67bd05d8bb" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:00:59 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-6b928e48-d1c4-45b1-9ad5-eadd94f60eca tempest-VolumesExtendTest-1971058098 None] Acquiring lock "cinder-quobyte-31828a05-8449-4ba3-95a1-b481e03b82fb" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:00:59 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-6b928e48-d1c4-45b1-9ad5-eadd94f60eca tempest-VolumesExtendTest-1971058098 None] Lock "cinder-quobyte-31828a05-8449-4ba3-95a1-b481e03b82fb" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:00:59 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-6b928e48-d1c4-45b1-9ad5-eadd94f60eca tempest-VolumesExtendTest-1971058098 None] Deleting offline snapshot 31828a05-8449-4ba3-95a1-b481e03b82fb of volume 563b442f-b0c0-4db6-8960-5b67bd05d8bb {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:00:59 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-6b928e48-d1c4-45b1-9ad5-eadd94f60eca tempest-VolumesExtendTest-1971058098 None] snapshot_file for this snap is: volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb.31828a05-8449-4ba3-95a1-b481e03b82fb {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:00:59 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae9030e-0433-4c4e-a75b-3ab586aeeb97]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:00:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6b928e48-d1c4-45b1-9ad5-eadd94f60eca tempest-VolumesExtendTest-1971058098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb.31828a05-8449-4ba3-95a1-b481e03b82fb {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:00 devstack sudo[101595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb.31828a05-8449-4ba3-95a1-b481e03b82fb Jul 30 17:01:00 devstack sudo[101595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:00 devstack sudo[101593]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e1889e69-3017-420b-b276-68f3770964ed tempest-VolumesDeleteCascade-1931691609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-114f44d0-3633-4b82-b396-0829e7dfc1f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-114f44d0-3633-4b82-b396-0829e7dfc1f7.c96fe4fc-9974-4cfb-b9d6-0645f5362452 1G" returned: 0 in 0.643s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e1889e69-3017-420b-b276-68f3770964ed tempest-VolumesDeleteCascade-1931691609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-114f44d0-3633-4b82-b396-0829e7dfc1f7 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-114f44d0-3633-4b82-b396-0829e7dfc1f7.c96fe4fc-9974-4cfb-b9d6-0645f5362452 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:00 devstack sudo[101600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-114f44d0-3633-4b82-b396-0829e7dfc1f7 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-114f44d0-3633-4b82-b396-0829e7dfc1f7.c96fe4fc-9974-4cfb-b9d6-0645f5362452 Jul 30 17:01:00 devstack sudo[101600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:00 devstack sudo[101595]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6b928e48-d1c4-45b1-9ad5-eadd94f60eca tempest-VolumesExtendTest-1971058098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb.31828a05-8449-4ba3-95a1-b481e03b82fb" returned: 0 in 0.630s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:00 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-6b928e48-d1c4-45b1-9ad5-eadd94f60eca tempest-VolumesExtendTest-1971058098 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:01:00 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf487d3f-5174-4a54-82f7-79cabd19a9db]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6b928e48-d1c4-45b1-9ad5-eadd94f60eca tempest-VolumesExtendTest-1971058098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:00 devstack sudo[101600]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e1889e69-3017-420b-b276-68f3770964ed tempest-VolumesDeleteCascade-1931691609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-114f44d0-3633-4b82-b396-0829e7dfc1f7 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-114f44d0-3633-4b82-b396-0829e7dfc1f7.c96fe4fc-9974-4cfb-b9d6-0645f5362452" returned: 0 in 0.369s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:00 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-e1889e69-3017-420b-b276-68f3770964ed tempest-VolumesDeleteCascade-1931691609 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-114f44d0-3633-4b82-b396-0829e7dfc1f7.c96fe4fc-9974-4cfb-b9d6-0645f5362452 is being set with open permissions: ugo+rw Jul 30 17:01:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e1889e69-3017-420b-b276-68f3770964ed tempest-VolumesDeleteCascade-1931691609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-114f44d0-3633-4b82-b396-0829e7dfc1f7.c96fe4fc-9974-4cfb-b9d6-0645f5362452 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:00 devstack sudo[101605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb Jul 30 17:01:00 devstack sudo[101605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:00 devstack sudo[101609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-114f44d0-3633-4b82-b396-0829e7dfc1f7.c96fe4fc-9974-4cfb-b9d6-0645f5362452 Jul 30 17:01:00 devstack sudo[101609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:00 devstack sudo[101609]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e1889e69-3017-420b-b276-68f3770964ed tempest-VolumesDeleteCascade-1931691609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-114f44d0-3633-4b82-b396-0829e7dfc1f7.c96fe4fc-9974-4cfb-b9d6-0645f5362452" returned: 0 in 0.314s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:00 devstack sudo[101605]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6b928e48-d1c4-45b1-9ad5-eadd94f60eca tempest-VolumesExtendTest-1971058098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb" returned: 0 in 0.481s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6b928e48-d1c4-45b1-9ad5-eadd94f60eca tempest-VolumesExtendTest-1971058098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb.31828a05-8449-4ba3-95a1-b481e03b82fb {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:01 devstack sudo[101616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb.31828a05-8449-4ba3-95a1-b481e03b82fb Jul 30 17:01:01 devstack sudo[101616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e1889e69-3017-420b-b276-68f3770964ed tempest-VolumesDeleteCascade-1931691609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-114f44d0-3633-4b82-b396-0829e7dfc1f7.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:01 devstack sudo[101618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-114f44d0-3633-4b82-b396-0829e7dfc1f7.info Jul 30 17:01:01 devstack sudo[101618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:01 devstack sudo[101618]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e1889e69-3017-420b-b276-68f3770964ed tempest-VolumesDeleteCascade-1931691609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-114f44d0-3633-4b82-b396-0829e7dfc1f7.info" returned: 0 in 0.273s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:01 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-e1889e69-3017-420b-b276-68f3770964ed tempest-VolumesDeleteCascade-1931691609 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-114f44d0-3633-4b82-b396-0829e7dfc1f7.info is being set with open permissions: ugo+rw Jul 30 17:01:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e1889e69-3017-420b-b276-68f3770964ed tempest-VolumesDeleteCascade-1931691609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-114f44d0-3633-4b82-b396-0829e7dfc1f7.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:01 devstack sudo[101624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-114f44d0-3633-4b82-b396-0829e7dfc1f7.info Jul 30 17:01:01 devstack sudo[101624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:01 devstack sudo[101616]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6b928e48-d1c4-45b1-9ad5-eadd94f60eca tempest-VolumesExtendTest-1971058098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb.31828a05-8449-4ba3-95a1-b481e03b82fb" returned: 0 in 0.490s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6b928e48-d1c4-45b1-9ad5-eadd94f60eca tempest-VolumesExtendTest-1971058098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb.31828a05-8449-4ba3-95a1-b481e03b82fb {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:01 devstack sudo[101627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb.31828a05-8449-4ba3-95a1-b481e03b82fb Jul 30 17:01:01 devstack sudo[101627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:01 devstack sudo[101624]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e1889e69-3017-420b-b276-68f3770964ed tempest-VolumesDeleteCascade-1931691609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-114f44d0-3633-4b82-b396-0829e7dfc1f7.info" returned: 0 in 0.289s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-e1889e69-3017-420b-b276-68f3770964ed tempest-VolumesDeleteCascade-1931691609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.499s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:01 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-e1889e69-3017-420b-b276-68f3770964ed tempest-VolumesDeleteCascade-1931691609 None] Create snapshot completed successfully Jul 30 17:01:01 devstack sudo[101627]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6b928e48-d1c4-45b1-9ad5-eadd94f60eca tempest-VolumesExtendTest-1971058098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb.31828a05-8449-4ba3-95a1-b481e03b82fb" returned: 0 in 0.299s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:01 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-6b928e48-d1c4-45b1-9ad5-eadd94f60eca tempest-VolumesExtendTest-1971058098 None] Lock "cinder-quobyte-31828a05-8449-4ba3-95a1-b481e03b82fb" released by "_delete_snapshot" :: held 2.053s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:01 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-6b928e48-d1c4-45b1-9ad5-eadd94f60eca tempest-VolumesExtendTest-1971058098 None] Lock "cinder-quobyte-563b442f-b0c0-4db6-8960-5b67bd05d8bb" released by "delete_snapshot" :: held 2.089s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:01 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-6b928e48-d1c4-45b1-9ad5-eadd94f60eca tempest-VolumesExtendTest-1971058098 None] Created reservations ['692b89a3-4704-4d22-a40e-81ac73f9fbee', '88b57ede-c370-4f00-882f-5dfbbbae83ba', '77fbdc6c-855f-475d-a1bb-955d16715e8b', 'ef6ba89e-fa37-4dd3-87e1-b8222426213a'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:01:01 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-6b928e48-d1c4-45b1-9ad5-eadd94f60eca tempest-VolumesExtendTest-1971058098 None] Delete snapshot completed successfully. Jul 30 17:01:01 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-6b928e48-d1c4-45b1-9ad5-eadd94f60eca tempest-VolumesExtendTest-1971058098 None] Lock "cinder-31828a05-8449-4ba3-95a1-b481e03b82fb-delete_snapshot" released by "delete_snapshot" :: held 2.260s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:02 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-3507d0b3-8440-4dc4-b656-1e9bbd1a7d8f tempest-VolumesDeleteCascade-1931691609 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:01:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3507d0b3-8440-4dc4-b656-1e9bbd1a7d8f tempest-VolumesDeleteCascade-1931691609 None] Flow 'volume_create_manager' (311097e6-a0a1-46cf-b535-e27313f35949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:01:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3507d0b3-8440-4dc4-b656-1e9bbd1a7d8f tempest-VolumesDeleteCascade-1931691609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d919de4-13c2-4b87-8406-1d8c5f92572a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3507d0b3-8440-4dc4-b656-1e9bbd1a7d8f tempest-VolumesDeleteCascade-1931691609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d919de4-13c2-4b87-8406-1d8c5f92572a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:01:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1014273334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8682c242-f570-405c-9172-1d6ccd2f7e08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baa4f167a88d413ea4324a241828dcf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:01:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c96fe4fc-9974-4cfb-b9d6-0645f5362452,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:01:03Z,use_quota=True,user_id='970610264ec84d35ac2b14e89fe45184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3507d0b3-8440-4dc4-b656-1e9bbd1a7d8f tempest-VolumesDeleteCascade-1931691609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (904ac263-ee75-454a-b8ec-22a0653b52c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3507d0b3-8440-4dc4-b656-1e9bbd1a7d8f tempest-VolumesDeleteCascade-1931691609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (904ac263-ee75-454a-b8ec-22a0653b52c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3507d0b3-8440-4dc4-b656-1e9bbd1a7d8f tempest-VolumesDeleteCascade-1931691609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc3d0516-1316-4f71-9f87-0648deada7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3507d0b3-8440-4dc4-b656-1e9bbd1a7d8f tempest-VolumesDeleteCascade-1931691609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc3d0516-1316-4f71-9f87-0648deada7fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8682c242-f570-405c-9172-1d6ccd2f7e08', 'volume_name': 'volume-8682c242-f570-405c-9172-1d6ccd2f7e08', 'volume_size': 1, 'snapshot_id': 'c96fe4fc-9974-4cfb-b9d6-0645f5362452'}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3507d0b3-8440-4dc4-b656-1e9bbd1a7d8f tempest-VolumesDeleteCascade-1931691609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddbbd9cc-f8f7-4780-839b-2a7ef5ad19de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3507d0b3-8440-4dc4-b656-1e9bbd1a7d8f tempest-VolumesDeleteCascade-1931691609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddbbd9cc-f8f7-4780-839b-2a7ef5ad19de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3507d0b3-8440-4dc4-b656-1e9bbd1a7d8f tempest-VolumesDeleteCascade-1931691609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6600d2c7-b6c6-448c-8928-a08303a61918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:02 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-3507d0b3-8440-4dc4-b656-1e9bbd1a7d8f tempest-VolumesDeleteCascade-1931691609 None] Volume 8682c242-f570-405c-9172-1d6ccd2f7e08: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8682c242-f570-405c-9172-1d6ccd2f7e08', 'volume_size': 1, 'snapshot_id': 'c96fe4fc-9974-4cfb-b9d6-0645f5362452'} Jul 30 17:01:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3507d0b3-8440-4dc4-b656-1e9bbd1a7d8f tempest-VolumesDeleteCascade-1931691609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3507d0b3-8440-4dc4-b656-1e9bbd1a7d8f tempest-VolumesDeleteCascade-1931691609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:02 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-3507d0b3-8440-4dc4-b656-1e9bbd1a7d8f tempest-VolumesDeleteCascade-1931691609 None] Acquiring lock "cinder-quobyte-c96fe4fc-9974-4cfb-b9d6-0645f5362452-8682c242-f570-405c-9172-1d6ccd2f7e08" by "_create_volume_from_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:02 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-3507d0b3-8440-4dc4-b656-1e9bbd1a7d8f tempest-VolumesDeleteCascade-1931691609 None] Lock "cinder-quobyte-c96fe4fc-9974-4cfb-b9d6-0645f5362452-8682c242-f570-405c-9172-1d6ccd2f7e08" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:02 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-3507d0b3-8440-4dc4-b656-1e9bbd1a7d8f tempest-VolumesDeleteCascade-1931691609 None] Creating volume 8682c242-f570-405c-9172-1d6ccd2f7e08 from snapshot c96fe4fc-9974-4cfb-b9d6-0645f5362452 {{(pid=88591) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 30 17:01:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3507d0b3-8440-4dc4-b656-1e9bbd1a7d8f tempest-VolumesDeleteCascade-1931691609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3507d0b3-8440-4dc4-b656-1e9bbd1a7d8f tempest-VolumesDeleteCascade-1931691609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:02 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-3507d0b3-8440-4dc4-b656-1e9bbd1a7d8f tempest-VolumesDeleteCascade-1931691609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:01:02 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-3507d0b3-8440-4dc4-b656-1e9bbd1a7d8f tempest-VolumesDeleteCascade-1931691609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:01:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3507d0b3-8440-4dc4-b656-1e9bbd1a7d8f tempest-VolumesDeleteCascade-1931691609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:02 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-3507d0b3-8440-4dc4-b656-1e9bbd1a7d8f tempest-VolumesDeleteCascade-1931691609 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:01:02 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-3507d0b3-8440-4dc4-b656-1e9bbd1a7d8f tempest-VolumesDeleteCascade-1931691609 None] Acquiring lock "cinder-quobyte-8682c242-f570-405c-9172-1d6ccd2f7e08" by "_copy_volume_from_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:02 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-3507d0b3-8440-4dc4-b656-1e9bbd1a7d8f tempest-VolumesDeleteCascade-1931691609 None] Lock "cinder-quobyte-8682c242-f570-405c-9172-1d6ccd2f7e08" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:02 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-3507d0b3-8440-4dc4-b656-1e9bbd1a7d8f tempest-VolumesDeleteCascade-1931691609 None] snapshot: c96fe4fc-9974-4cfb-b9d6-0645f5362452, volume: 8682c242-f570-405c-9172-1d6ccd2f7e08, {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 17:01:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3507d0b3-8440-4dc4-b656-1e9bbd1a7d8f tempest-VolumesDeleteCascade-1931691609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3507d0b3-8440-4dc4-b656-1e9bbd1a7d8f tempest-VolumesDeleteCascade-1931691609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:02 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-3507d0b3-8440-4dc4-b656-1e9bbd1a7d8f tempest-VolumesDeleteCascade-1931691609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:01:02 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-3507d0b3-8440-4dc4-b656-1e9bbd1a7d8f tempest-VolumesDeleteCascade-1931691609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:01:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3507d0b3-8440-4dc4-b656-1e9bbd1a7d8f tempest-VolumesDeleteCascade-1931691609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:02 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[189a85e9-fc81-47dc-8504-5fc5a98a5133]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3507d0b3-8440-4dc4-b656-1e9bbd1a7d8f tempest-VolumesDeleteCascade-1931691609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-114f44d0-3633-4b82-b396-0829e7dfc1f7.c96fe4fc-9974-4cfb-b9d6-0645f5362452 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:03 devstack sudo[101632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-114f44d0-3633-4b82-b396-0829e7dfc1f7.c96fe4fc-9974-4cfb-b9d6-0645f5362452 Jul 30 17:01:03 devstack sudo[101632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:03 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-8391a58b-4dfa-427e-ad7a-0a87b55b9b1b tempest-VolumesExtendTest-1971058098 None] Acquiring lock "cinder-563b442f-b0c0-4db6-8960-5b67bd05d8bb-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:03 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-8391a58b-4dfa-427e-ad7a-0a87b55b9b1b tempest-VolumesExtendTest-1971058098 None] Lock "cinder-563b442f-b0c0-4db6-8960-5b67bd05d8bb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:03 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-8391a58b-4dfa-427e-ad7a-0a87b55b9b1b tempest-VolumesExtendTest-1971058098 None] Acquiring lock "cinder-quobyte-563b442f-b0c0-4db6-8960-5b67bd05d8bb" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:03 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-8391a58b-4dfa-427e-ad7a-0a87b55b9b1b tempest-VolumesExtendTest-1971058098 None] Lock "cinder-quobyte-563b442f-b0c0-4db6-8960-5b67bd05d8bb" acquired by "delete_volume" :: waited 0.023s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:03 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e577e6b2-2d63-4ff7-ac06-425725e46688]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8391a58b-4dfa-427e-ad7a-0a87b55b9b1b tempest-VolumesExtendTest-1971058098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:03 devstack sudo[101634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb Jul 30 17:01:03 devstack sudo[101634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:03 devstack sudo[101632]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3507d0b3-8440-4dc4-b656-1e9bbd1a7d8f tempest-VolumesDeleteCascade-1931691609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-114f44d0-3633-4b82-b396-0829e7dfc1f7.c96fe4fc-9974-4cfb-b9d6-0645f5362452" returned: 0 in 0.445s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:03 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-3507d0b3-8440-4dc4-b656-1e9bbd1a7d8f tempest-VolumesDeleteCascade-1931691609 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-114f44d0-3633-4b82-b396-0829e7dfc1f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:01:03 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[494d81c3-1dd6-454d-aaee-9f632c22d7d5]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3507d0b3-8440-4dc4-b656-1e9bbd1a7d8f tempest-VolumesDeleteCascade-1931691609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-114f44d0-3633-4b82-b396-0829e7dfc1f7 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:03 devstack sudo[101639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-114f44d0-3633-4b82-b396-0829e7dfc1f7 Jul 30 17:01:03 devstack sudo[101639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:03 devstack sudo[101634]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8391a58b-4dfa-427e-ad7a-0a87b55b9b1b tempest-VolumesExtendTest-1971058098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb" returned: 0 in 0.430s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8391a58b-4dfa-427e-ad7a-0a87b55b9b1b tempest-VolumesExtendTest-1971058098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:03 devstack sudo[101644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb Jul 30 17:01:03 devstack sudo[101644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:03 devstack sudo[101639]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3507d0b3-8440-4dc4-b656-1e9bbd1a7d8f tempest-VolumesDeleteCascade-1931691609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-114f44d0-3633-4b82-b396-0829e7dfc1f7" returned: 0 in 0.458s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:03 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-3507d0b3-8440-4dc4-b656-1e9bbd1a7d8f tempest-VolumesDeleteCascade-1931691609 None] will copy from snapshot at /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-114f44d0-3633-4b82-b396-0829e7dfc1f7 {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 17:01:03 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-3507d0b3-8440-4dc4-b656-1e9bbd1a7d8f tempest-VolumesDeleteCascade-1931691609 None] Creating direct copy from snapshot {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 17:01:03 devstack cinder-volume[88591]: DEBUG cinder.utils [None req-3507d0b3-8440-4dc4-b656-1e9bbd1a7d8f tempest-VolumesDeleteCascade-1931691609 None] Path /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8682c242-f570-405c-9172-1d6ccd2f7e08 not found in is_blk_device check {{(pid=88591) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 17:01:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3507d0b3-8440-4dc4-b656-1e9bbd1a7d8f tempest-VolumesDeleteCascade-1931691609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-114f44d0-3633-4b82-b396-0829e7dfc1f7 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8682c242-f570-405c-9172-1d6ccd2f7e08 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:03 devstack sudo[101650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-114f44d0-3633-4b82-b396-0829e7dfc1f7 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8682c242-f570-405c-9172-1d6ccd2f7e08 Jul 30 17:01:03 devstack sudo[101650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:03 devstack sudo[101644]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8391a58b-4dfa-427e-ad7a-0a87b55b9b1b tempest-VolumesExtendTest-1971058098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-563b442f-b0c0-4db6-8960-5b67bd05d8bb" returned: 0 in 0.304s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:03 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-8391a58b-4dfa-427e-ad7a-0a87b55b9b1b tempest-VolumesExtendTest-1971058098 None] Lock "cinder-quobyte-563b442f-b0c0-4db6-8960-5b67bd05d8bb" released by "delete_volume" :: held 0.797s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:04 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-8391a58b-4dfa-427e-ad7a-0a87b55b9b1b tempest-VolumesExtendTest-1971058098 None] Created reservations ['87e79469-2c26-4c48-816b-2e5843d54e6f', '721cbe5b-5425-40a3-a578-006ef1433fb7', '3f0e3025-f657-434b-9f52-6ec1c8e2bde2', '3e63253c-270e-4564-a072-00f98fd24bac'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:01:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8391a58b-4dfa-427e-ad7a-0a87b55b9b1b tempest-VolumesExtendTest-1971058098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8391a58b-4dfa-427e-ad7a-0a87b55b9b1b tempest-VolumesExtendTest-1971058098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:04 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-8391a58b-4dfa-427e-ad7a-0a87b55b9b1b tempest-VolumesExtendTest-1971058098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:01:04 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-8391a58b-4dfa-427e-ad7a-0a87b55b9b1b tempest-VolumesExtendTest-1971058098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:01:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8391a58b-4dfa-427e-ad7a-0a87b55b9b1b tempest-VolumesExtendTest-1971058098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8391a58b-4dfa-427e-ad7a-0a87b55b9b1b tempest-VolumesExtendTest-1971058098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:04 devstack sudo[101655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:01:04 devstack sudo[101655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:04 devstack sudo[101655]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8391a58b-4dfa-427e-ad7a-0a87b55b9b1b tempest-VolumesExtendTest-1971058098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.359s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:04 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-8391a58b-4dfa-427e-ad7a-0a87b55b9b1b tempest-VolumesExtendTest-1971058098 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:01:04 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-8391a58b-4dfa-427e-ad7a-0a87b55b9b1b tempest-VolumesExtendTest-1971058098 None] Deleted volume successfully. Jul 30 17:01:04 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-8391a58b-4dfa-427e-ad7a-0a87b55b9b1b tempest-VolumesExtendTest-1971058098 None] Lock "cinder-563b442f-b0c0-4db6-8960-5b67bd05d8bb-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:09 devstack sudo[101650]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3507d0b3-8440-4dc4-b656-1e9bbd1a7d8f tempest-VolumesDeleteCascade-1931691609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-114f44d0-3633-4b82-b396-0829e7dfc1f7 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8682c242-f570-405c-9172-1d6ccd2f7e08" returned: 0 in 5.926s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:09 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-3507d0b3-8440-4dc4-b656-1e9bbd1a7d8f tempest-VolumesDeleteCascade-1931691609 None] Image conversion details: src /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-114f44d0-3633-4b82-b396-0829e7dfc1f7, size 1024.00 MB, duration 5.93 sec, destination /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8682c242-f570-405c-9172-1d6ccd2f7e08 {{(pid=88591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 17:01:09 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-3507d0b3-8440-4dc4-b656-1e9bbd1a7d8f tempest-VolumesDeleteCascade-1931691609 None] Converted 1024.00 MB image at 172.78 MB/s Jul 30 17:01:09 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-3507d0b3-8440-4dc4-b656-1e9bbd1a7d8f tempest-VolumesDeleteCascade-1931691609 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8682c242-f570-405c-9172-1d6ccd2f7e08 is being set with open permissions: ugo+rw Jul 30 17:01:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3507d0b3-8440-4dc4-b656-1e9bbd1a7d8f tempest-VolumesDeleteCascade-1931691609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8682c242-f570-405c-9172-1d6ccd2f7e08 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:09 devstack sudo[101667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8682c242-f570-405c-9172-1d6ccd2f7e08 Jul 30 17:01:09 devstack sudo[101667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:10 devstack sudo[101667]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3507d0b3-8440-4dc4-b656-1e9bbd1a7d8f tempest-VolumesDeleteCascade-1931691609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8682c242-f570-405c-9172-1d6ccd2f7e08" returned: 0 in 0.333s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:10 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-3507d0b3-8440-4dc4-b656-1e9bbd1a7d8f tempest-VolumesDeleteCascade-1931691609 None] Lock "cinder-quobyte-8682c242-f570-405c-9172-1d6ccd2f7e08" released by "_copy_volume_from_snapshot" :: held 7.259s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:10 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:SELECT=110,cinder:UPDATE=107,cinder:DELETE=12,cinder:INSERT=33 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:01:10 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:SELECT=112,cinder:UPDATE=128,cinder:INSERT=37,cinder:DELETE=6 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:01:10 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-3507d0b3-8440-4dc4-b656-1e9bbd1a7d8f tempest-VolumesDeleteCascade-1931691609 None] Lock "cinder-quobyte-c96fe4fc-9974-4cfb-b9d6-0645f5362452-8682c242-f570-405c-9172-1d6ccd2f7e08" released by "_create_volume_from_snapshot" :: held 7.367s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3507d0b3-8440-4dc4-b656-1e9bbd1a7d8f tempest-VolumesDeleteCascade-1931691609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.386s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:10 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3507d0b3-8440-4dc4-b656-1e9bbd1a7d8f tempest-VolumesDeleteCascade-1931691609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6600d2c7-b6c6-448c-8928-a08303a61918) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8682c242-f570-405c-9172-1d6ccd2f7e08', 'volume_size': 1, 'snapshot_id': 'c96fe4fc-9974-4cfb-b9d6-0645f5362452'}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:10 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3507d0b3-8440-4dc4-b656-1e9bbd1a7d8f tempest-VolumesDeleteCascade-1931691609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca2ce3e8-773b-4852-a1d9-00ca925d7b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:10 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-3507d0b3-8440-4dc4-b656-1e9bbd1a7d8f tempest-VolumesDeleteCascade-1931691609 None] Volume volume-8682c242-f570-405c-9172-1d6ccd2f7e08 (8682c242-f570-405c-9172-1d6ccd2f7e08): created successfully Jul 30 17:01:10 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3507d0b3-8440-4dc4-b656-1e9bbd1a7d8f tempest-VolumesDeleteCascade-1931691609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca2ce3e8-773b-4852-a1d9-00ca925d7b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:10 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3507d0b3-8440-4dc4-b656-1e9bbd1a7d8f tempest-VolumesDeleteCascade-1931691609 None] Flow 'volume_create_manager' (311097e6-a0a1-46cf-b535-e27313f35949) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:01:10 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-3507d0b3-8440-4dc4-b656-1e9bbd1a7d8f tempest-VolumesDeleteCascade-1931691609 None] Created volume successfully. Jul 30 17:01:11 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ee6ba111-9a08-40cc-becf-3573dd3deac6 tempest-VolumesDeleteCascade-1931691609 None] Acquiring lock "cinder-114f44d0-3633-4b82-b396-0829e7dfc1f7-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:11 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ee6ba111-9a08-40cc-becf-3573dd3deac6 tempest-VolumesDeleteCascade-1931691609 None] Lock "cinder-114f44d0-3633-4b82-b396-0829e7dfc1f7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:11 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ee6ba111-9a08-40cc-becf-3573dd3deac6 tempest-VolumesDeleteCascade-1931691609 None] Performing cascade delete. {{(pid=88591) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 30 17:01:11 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ee6ba111-9a08-40cc-becf-3573dd3deac6 tempest-VolumesDeleteCascade-1931691609 None] Acquiring lock "cinder-c96fe4fc-9974-4cfb-b9d6-0645f5362452-delete_snapshot" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:11 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ee6ba111-9a08-40cc-becf-3573dd3deac6 tempest-VolumesDeleteCascade-1931691609 None] Lock "cinder-c96fe4fc-9974-4cfb-b9d6-0645f5362452-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:11 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ee6ba111-9a08-40cc-becf-3573dd3deac6 tempest-VolumesDeleteCascade-1931691609 None] Acquiring lock "cinder-quobyte-114f44d0-3633-4b82-b396-0829e7dfc1f7" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:11 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ee6ba111-9a08-40cc-becf-3573dd3deac6 tempest-VolumesDeleteCascade-1931691609 None] Lock "cinder-quobyte-114f44d0-3633-4b82-b396-0829e7dfc1f7" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:11 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ee6ba111-9a08-40cc-becf-3573dd3deac6 tempest-VolumesDeleteCascade-1931691609 None] Acquiring lock "cinder-quobyte-c96fe4fc-9974-4cfb-b9d6-0645f5362452" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:11 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ee6ba111-9a08-40cc-becf-3573dd3deac6 tempest-VolumesDeleteCascade-1931691609 None] Lock "cinder-quobyte-c96fe4fc-9974-4cfb-b9d6-0645f5362452" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:11 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-ee6ba111-9a08-40cc-becf-3573dd3deac6 tempest-VolumesDeleteCascade-1931691609 None] Deleting offline snapshot c96fe4fc-9974-4cfb-b9d6-0645f5362452 of volume 114f44d0-3633-4b82-b396-0829e7dfc1f7 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:01:11 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-ee6ba111-9a08-40cc-becf-3573dd3deac6 tempest-VolumesDeleteCascade-1931691609 None] snapshot_file for this snap is: volume-114f44d0-3633-4b82-b396-0829e7dfc1f7.c96fe4fc-9974-4cfb-b9d6-0645f5362452 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:01:11 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d955c05-5cdd-418b-9821-68b11bbd09ce]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ee6ba111-9a08-40cc-becf-3573dd3deac6 tempest-VolumesDeleteCascade-1931691609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-114f44d0-3633-4b82-b396-0829e7dfc1f7.c96fe4fc-9974-4cfb-b9d6-0645f5362452 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:11 devstack sudo[101671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-114f44d0-3633-4b82-b396-0829e7dfc1f7.c96fe4fc-9974-4cfb-b9d6-0645f5362452 Jul 30 17:01:11 devstack sudo[101671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:11 devstack sudo[101671]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ee6ba111-9a08-40cc-becf-3573dd3deac6 tempest-VolumesDeleteCascade-1931691609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-114f44d0-3633-4b82-b396-0829e7dfc1f7.c96fe4fc-9974-4cfb-b9d6-0645f5362452" returned: 0 in 0.446s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:11 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-ee6ba111-9a08-40cc-becf-3573dd3deac6 tempest-VolumesDeleteCascade-1931691609 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-114f44d0-3633-4b82-b396-0829e7dfc1f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:01:11 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[377f3bad-9b88-4f98-875c-3c82731a4083]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ee6ba111-9a08-40cc-becf-3573dd3deac6 tempest-VolumesDeleteCascade-1931691609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-114f44d0-3633-4b82-b396-0829e7dfc1f7 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:11 devstack sudo[101676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-114f44d0-3633-4b82-b396-0829e7dfc1f7 Jul 30 17:01:11 devstack sudo[101676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:12 devstack sudo[101676]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ee6ba111-9a08-40cc-becf-3573dd3deac6 tempest-VolumesDeleteCascade-1931691609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-114f44d0-3633-4b82-b396-0829e7dfc1f7" returned: 0 in 0.734s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ee6ba111-9a08-40cc-becf-3573dd3deac6 tempest-VolumesDeleteCascade-1931691609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-114f44d0-3633-4b82-b396-0829e7dfc1f7.c96fe4fc-9974-4cfb-b9d6-0645f5362452 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:12 devstack sudo[101683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-114f44d0-3633-4b82-b396-0829e7dfc1f7.c96fe4fc-9974-4cfb-b9d6-0645f5362452 Jul 30 17:01:12 devstack sudo[101683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:12 devstack cinder-volume[88591]: DEBUG oslo_service.periodic_task [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 17:01:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:01:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:01:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:12 devstack sudo[101685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:01:12 devstack sudo[101685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:12 devstack sudo[101685]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.344s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:12 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:01:12 devstack cinder-volume[88591]: DEBUG oslo_service.periodic_task [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running periodic task VolumeManager._thread_info {{(pid=88591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 17:01:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] thread count: 28 {{(pid=88591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 17:01:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] thread info: [<_MainThread(MainThread, started 140677178003584)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 17:01:12 devstack sudo[101683]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ee6ba111-9a08-40cc-becf-3573dd3deac6 tempest-VolumesDeleteCascade-1931691609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-114f44d0-3633-4b82-b396-0829e7dfc1f7.c96fe4fc-9974-4cfb-b9d6-0645f5362452" returned: 0 in 0.485s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ee6ba111-9a08-40cc-becf-3573dd3deac6 tempest-VolumesDeleteCascade-1931691609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-114f44d0-3633-4b82-b396-0829e7dfc1f7.c96fe4fc-9974-4cfb-b9d6-0645f5362452 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:13 devstack sudo[101691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-114f44d0-3633-4b82-b396-0829e7dfc1f7.c96fe4fc-9974-4cfb-b9d6-0645f5362452 Jul 30 17:01:13 devstack sudo[101691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:13 devstack sudo[101691]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ee6ba111-9a08-40cc-becf-3573dd3deac6 tempest-VolumesDeleteCascade-1931691609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-114f44d0-3633-4b82-b396-0829e7dfc1f7.c96fe4fc-9974-4cfb-b9d6-0645f5362452" returned: 0 in 0.276s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:13 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ee6ba111-9a08-40cc-becf-3573dd3deac6 tempest-VolumesDeleteCascade-1931691609 None] Lock "cinder-quobyte-c96fe4fc-9974-4cfb-b9d6-0645f5362452" released by "_delete_snapshot" :: held 2.076s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:13 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ee6ba111-9a08-40cc-becf-3573dd3deac6 tempest-VolumesDeleteCascade-1931691609 None] Lock "cinder-quobyte-114f44d0-3633-4b82-b396-0829e7dfc1f7" released by "delete_snapshot" :: held 2.108s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:13 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-ee6ba111-9a08-40cc-becf-3573dd3deac6 tempest-VolumesDeleteCascade-1931691609 None] Created reservations ['2b679143-c60d-4bc1-8ab6-21d8ccb58243', '70b38843-d1a8-4cda-8c38-4d31b4848f11', '51c19d5c-4708-47cf-be29-ed402fc80282', '5e53c929-286a-4d3e-8a52-ec11675b347b'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:01:13 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-ee6ba111-9a08-40cc-becf-3573dd3deac6 tempest-VolumesDeleteCascade-1931691609 None] Delete snapshot completed successfully. Jul 30 17:01:13 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ee6ba111-9a08-40cc-becf-3573dd3deac6 tempest-VolumesDeleteCascade-1931691609 None] Lock "cinder-c96fe4fc-9974-4cfb-b9d6-0645f5362452-delete_snapshot" released by "delete_snapshot" :: held 2.304s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ee6ba111-9a08-40cc-becf-3573dd3deac6 tempest-VolumesDeleteCascade-1931691609 None] Snapshots deleted, issuing volume delete {{(pid=88591) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 30 17:01:13 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ee6ba111-9a08-40cc-becf-3573dd3deac6 tempest-VolumesDeleteCascade-1931691609 None] Acquiring lock "cinder-quobyte-114f44d0-3633-4b82-b396-0829e7dfc1f7" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:13 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ee6ba111-9a08-40cc-becf-3573dd3deac6 tempest-VolumesDeleteCascade-1931691609 None] Lock "cinder-quobyte-114f44d0-3633-4b82-b396-0829e7dfc1f7" acquired by "delete_volume" :: waited 0.024s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:13 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c247fd2-1b82-4f9a-b135-71e29faef5a1]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ee6ba111-9a08-40cc-becf-3573dd3deac6 tempest-VolumesDeleteCascade-1931691609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-114f44d0-3633-4b82-b396-0829e7dfc1f7 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:13 devstack sudo[101694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-114f44d0-3633-4b82-b396-0829e7dfc1f7 Jul 30 17:01:13 devstack sudo[101694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:14 devstack sudo[101694]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ee6ba111-9a08-40cc-becf-3573dd3deac6 tempest-VolumesDeleteCascade-1931691609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-114f44d0-3633-4b82-b396-0829e7dfc1f7" returned: 0 in 0.489s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ee6ba111-9a08-40cc-becf-3573dd3deac6 tempest-VolumesDeleteCascade-1931691609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-114f44d0-3633-4b82-b396-0829e7dfc1f7 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:14 devstack sudo[101699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-114f44d0-3633-4b82-b396-0829e7dfc1f7 Jul 30 17:01:14 devstack sudo[101699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:14 devstack sudo[101699]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ee6ba111-9a08-40cc-becf-3573dd3deac6 tempest-VolumesDeleteCascade-1931691609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-114f44d0-3633-4b82-b396-0829e7dfc1f7" returned: 0 in 0.364s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:14 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ee6ba111-9a08-40cc-becf-3573dd3deac6 tempest-VolumesDeleteCascade-1931691609 None] Lock "cinder-quobyte-114f44d0-3633-4b82-b396-0829e7dfc1f7" released by "delete_volume" :: held 0.988s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:14 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-ee6ba111-9a08-40cc-becf-3573dd3deac6 tempest-VolumesDeleteCascade-1931691609 None] Created reservations ['23b27f6f-38b5-4de0-9d9a-2d8eea5ffbbd', 'e05fbaef-e5e6-41b3-8b9e-28fca88d2f7e', '9ae353ca-b733-4f38-8bf8-7a1532b789d9', 'c6789a89-60cc-4b70-8618-b17abcca9157'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:01:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ee6ba111-9a08-40cc-becf-3573dd3deac6 tempest-VolumesDeleteCascade-1931691609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ee6ba111-9a08-40cc-becf-3573dd3deac6 tempest-VolumesDeleteCascade-1931691609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:14 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ee6ba111-9a08-40cc-becf-3573dd3deac6 tempest-VolumesDeleteCascade-1931691609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:01:14 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ee6ba111-9a08-40cc-becf-3573dd3deac6 tempest-VolumesDeleteCascade-1931691609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:01:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ee6ba111-9a08-40cc-becf-3573dd3deac6 tempest-VolumesDeleteCascade-1931691609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ee6ba111-9a08-40cc-becf-3573dd3deac6 tempest-VolumesDeleteCascade-1931691609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:14 devstack sudo[101702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:01:14 devstack sudo[101702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:14 devstack sudo[101702]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ee6ba111-9a08-40cc-becf-3573dd3deac6 tempest-VolumesDeleteCascade-1931691609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.298s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:14 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-ee6ba111-9a08-40cc-becf-3573dd3deac6 tempest-VolumesDeleteCascade-1931691609 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:01:14 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-ee6ba111-9a08-40cc-becf-3573dd3deac6 tempest-VolumesDeleteCascade-1931691609 None] Deleted volume successfully. Jul 30 17:01:14 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ee6ba111-9a08-40cc-becf-3573dd3deac6 tempest-VolumesDeleteCascade-1931691609 None] Lock "cinder-114f44d0-3633-4b82-b396-0829e7dfc1f7-delete_volume" released by "delete_volume" :: held 3.896s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:15 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d737ef0-66db-49ff-b81a-a30daa5c2878 tempest-TestImageHashVerification-1695358243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:01:15 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6d737ef0-66db-49ff-b81a-a30daa5c2878 tempest-TestImageHashVerification-1695358243 None] Flow 'volume_create_manager' (b09dbd43-9557-4c6c-84aa-97707cae907e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:01:15 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6d737ef0-66db-49ff-b81a-a30daa5c2878 tempest-TestImageHashVerification-1695358243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90389384-ec9d-4b80-be88-f82df3fb4356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:15 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6d737ef0-66db-49ff-b81a-a30daa5c2878 tempest-TestImageHashVerification-1695358243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90389384-ec9d-4b80-be88-f82df3fb4356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-601402870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daa9f999-a712-4e19-8079-963614ab67c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bffb84e5945346c1bbb4971bde527295',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:01:15Z,use_quota=True,user_id='8061da1a28d34131bd405349b141cb3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:15 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6d737ef0-66db-49ff-b81a-a30daa5c2878 tempest-TestImageHashVerification-1695358243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (113db357-2404-45c7-8723-290a7a3e59fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:15 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6d737ef0-66db-49ff-b81a-a30daa5c2878 tempest-TestImageHashVerification-1695358243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (113db357-2404-45c7-8723-290a7a3e59fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:15 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6d737ef0-66db-49ff-b81a-a30daa5c2878 tempest-TestImageHashVerification-1695358243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69b0740c-9a78-475b-a03b-11e327472e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:15 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6d737ef0-66db-49ff-b81a-a30daa5c2878 tempest-TestImageHashVerification-1695358243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69b0740c-9a78-475b-a03b-11e327472e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daa9f999-a712-4e19-8079-963614ab67c2', 'volume_name': 'volume-daa9f999-a712-4e19-8079-963614ab67c2', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:15 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6d737ef0-66db-49ff-b81a-a30daa5c2878 tempest-TestImageHashVerification-1695358243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf3ff970-a737-4850-acf8-9fe151945750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:15 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6d737ef0-66db-49ff-b81a-a30daa5c2878 tempest-TestImageHashVerification-1695358243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf3ff970-a737-4850-acf8-9fe151945750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:15 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6d737ef0-66db-49ff-b81a-a30daa5c2878 tempest-TestImageHashVerification-1695358243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b1fbfa3-e154-4ba3-a28a-ed9cd6144898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:15 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-6d737ef0-66db-49ff-b81a-a30daa5c2878 tempest-TestImageHashVerification-1695358243 None] Volume daa9f999-a712-4e19-8079-963614ab67c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daa9f999-a712-4e19-8079-963614ab67c2', 'volume_size': 1} Jul 30 17:01:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-6d737ef0-66db-49ff-b81a-a30daa5c2878 tempest-TestImageHashVerification-1695358243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-6d737ef0-66db-49ff-b81a-a30daa5c2878 tempest-TestImageHashVerification-1695358243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:15 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-6d737ef0-66db-49ff-b81a-a30daa5c2878 tempest-TestImageHashVerification-1695358243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-601402870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daa9f999-a712-4e19-8079-963614ab67c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bffb84e5945346c1bbb4971bde527295',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:01:15Z,use_quota=True,user_id='8061da1a28d34131bd405349b141cb3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:01:15 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-6d737ef0-66db-49ff-b81a-a30daa5c2878 tempest-TestImageHashVerification-1695358243 None] Creating volume daa9f999-a712-4e19-8079-963614ab67c2 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:01:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-6d737ef0-66db-49ff-b81a-a30daa5c2878 tempest-TestImageHashVerification-1695358243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-6d737ef0-66db-49ff-b81a-a30daa5c2878 tempest-TestImageHashVerification-1695358243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:15 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-6d737ef0-66db-49ff-b81a-a30daa5c2878 tempest-TestImageHashVerification-1695358243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:01:15 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-6d737ef0-66db-49ff-b81a-a30daa5c2878 tempest-TestImageHashVerification-1695358243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:01:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-6d737ef0-66db-49ff-b81a-a30daa5c2878 tempest-TestImageHashVerification-1695358243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:15 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-6d737ef0-66db-49ff-b81a-a30daa5c2878 tempest-TestImageHashVerification-1695358243 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:01:15 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-6d737ef0-66db-49ff-b81a-a30daa5c2878 tempest-TestImageHashVerification-1695358243 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:01:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6d737ef0-66db-49ff-b81a-a30daa5c2878 tempest-TestImageHashVerification-1695358243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-daa9f999-a712-4e19-8079-963614ab67c2 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:15 devstack sudo[101705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-daa9f999-a712-4e19-8079-963614ab67c2 1073741824 Jul 30 17:01:15 devstack sudo[101705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:15 devstack sudo[101705]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6d737ef0-66db-49ff-b81a-a30daa5c2878 tempest-TestImageHashVerification-1695358243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-daa9f999-a712-4e19-8079-963614ab67c2 1073741824" returned: 0 in 0.482s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:15 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-e2fb6524-ff05-4acf-a09c-061c4723ffcf tempest-VolumesDeleteCascade-1931691609 None] Acquiring lock "cinder-8682c242-f570-405c-9172-1d6ccd2f7e08-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:15 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-e2fb6524-ff05-4acf-a09c-061c4723ffcf tempest-VolumesDeleteCascade-1931691609 None] Lock "cinder-8682c242-f570-405c-9172-1d6ccd2f7e08-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6d737ef0-66db-49ff-b81a-a30daa5c2878 tempest-TestImageHashVerification-1695358243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-daa9f999-a712-4e19-8079-963614ab67c2 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:15 devstack sudo[101711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-daa9f999-a712-4e19-8079-963614ab67c2 Jul 30 17:01:15 devstack sudo[101711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:15 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-e2fb6524-ff05-4acf-a09c-061c4723ffcf tempest-VolumesDeleteCascade-1931691609 None] Acquiring lock "cinder-quobyte-8682c242-f570-405c-9172-1d6ccd2f7e08" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:15 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-e2fb6524-ff05-4acf-a09c-061c4723ffcf tempest-VolumesDeleteCascade-1931691609 None] Lock "cinder-quobyte-8682c242-f570-405c-9172-1d6ccd2f7e08" acquired by "delete_volume" :: waited 0.024s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:15 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[3559fe55-fc39-472c-aecd-3341a4136427]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e2fb6524-ff05-4acf-a09c-061c4723ffcf tempest-VolumesDeleteCascade-1931691609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8682c242-f570-405c-9172-1d6ccd2f7e08 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:16 devstack sudo[101713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8682c242-f570-405c-9172-1d6ccd2f7e08 Jul 30 17:01:16 devstack sudo[101713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:16 devstack sudo[101711]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:16 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6d737ef0-66db-49ff-b81a-a30daa5c2878 tempest-TestImageHashVerification-1695358243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-daa9f999-a712-4e19-8079-963614ab67c2" returned: 0 in 0.334s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:16 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-6d737ef0-66db-49ff-b81a-a30daa5c2878 tempest-TestImageHashVerification-1695358243 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:01:16 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-6d737ef0-66db-49ff-b81a-a30daa5c2878 tempest-TestImageHashVerification-1695358243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:16 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6d737ef0-66db-49ff-b81a-a30daa5c2878 tempest-TestImageHashVerification-1695358243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b1fbfa3-e154-4ba3-a28a-ed9cd6144898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daa9f999-a712-4e19-8079-963614ab67c2', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:16 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6d737ef0-66db-49ff-b81a-a30daa5c2878 tempest-TestImageHashVerification-1695358243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feb2c792-2755-4c61-93d8-a8be90da76b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:16 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-6d737ef0-66db-49ff-b81a-a30daa5c2878 tempest-TestImageHashVerification-1695358243 None] Volume volume-daa9f999-a712-4e19-8079-963614ab67c2 (daa9f999-a712-4e19-8079-963614ab67c2): created successfully Jul 30 17:01:16 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6d737ef0-66db-49ff-b81a-a30daa5c2878 tempest-TestImageHashVerification-1695358243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feb2c792-2755-4c61-93d8-a8be90da76b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:16 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6d737ef0-66db-49ff-b81a-a30daa5c2878 tempest-TestImageHashVerification-1695358243 None] Flow 'volume_create_manager' (b09dbd43-9557-4c6c-84aa-97707cae907e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:01:16 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-6d737ef0-66db-49ff-b81a-a30daa5c2878 tempest-TestImageHashVerification-1695358243 None] Created volume successfully. Jul 30 17:01:16 devstack sudo[101713]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:16 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e2fb6524-ff05-4acf-a09c-061c4723ffcf tempest-VolumesDeleteCascade-1931691609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8682c242-f570-405c-9172-1d6ccd2f7e08" returned: 0 in 0.434s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:16 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e2fb6524-ff05-4acf-a09c-061c4723ffcf tempest-VolumesDeleteCascade-1931691609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8682c242-f570-405c-9172-1d6ccd2f7e08 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:16 devstack sudo[101720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8682c242-f570-405c-9172-1d6ccd2f7e08 Jul 30 17:01:16 devstack sudo[101720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:16 devstack sudo[101720]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:16 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e2fb6524-ff05-4acf-a09c-061c4723ffcf tempest-VolumesDeleteCascade-1931691609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8682c242-f570-405c-9172-1d6ccd2f7e08" returned: 0 in 0.242s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:16 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-e2fb6524-ff05-4acf-a09c-061c4723ffcf tempest-VolumesDeleteCascade-1931691609 None] Lock "cinder-quobyte-8682c242-f570-405c-9172-1d6ccd2f7e08" released by "delete_volume" :: held 0.742s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:16 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-e2fb6524-ff05-4acf-a09c-061c4723ffcf tempest-VolumesDeleteCascade-1931691609 None] Created reservations ['1b221cad-c0e5-40a8-9bf6-fef778bb5a9c', 'a474b3bb-1eb6-432f-900c-7189d1124299', '9efda8c2-407a-408d-997a-08caa555cae3', '53ba435c-8fa9-4060-ac90-ac8fe328c24b'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:01:16 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-e2fb6524-ff05-4acf-a09c-061c4723ffcf tempest-VolumesDeleteCascade-1931691609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:16 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-e2fb6524-ff05-4acf-a09c-061c4723ffcf tempest-VolumesDeleteCascade-1931691609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:16 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-e2fb6524-ff05-4acf-a09c-061c4723ffcf tempest-VolumesDeleteCascade-1931691609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:01:16 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-e2fb6524-ff05-4acf-a09c-061c4723ffcf tempest-VolumesDeleteCascade-1931691609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:01:16 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-e2fb6524-ff05-4acf-a09c-061c4723ffcf tempest-VolumesDeleteCascade-1931691609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:16 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e2fb6524-ff05-4acf-a09c-061c4723ffcf tempest-VolumesDeleteCascade-1931691609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:16 devstack sudo[101723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:01:16 devstack sudo[101723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:16 devstack sudo[101723]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:16 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e2fb6524-ff05-4acf-a09c-061c4723ffcf tempest-VolumesDeleteCascade-1931691609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.259s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:16 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-e2fb6524-ff05-4acf-a09c-061c4723ffcf tempest-VolumesDeleteCascade-1931691609 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:01:16 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-e2fb6524-ff05-4acf-a09c-061c4723ffcf tempest-VolumesDeleteCascade-1931691609 None] Deleted volume successfully. Jul 30 17:01:16 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-e2fb6524-ff05-4acf-a09c-061c4723ffcf tempest-VolumesDeleteCascade-1931691609 None] Lock "cinder-8682c242-f570-405c-9172-1d6ccd2f7e08-delete_volume" released by "delete_volume" :: held 1.242s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-6b882643-a2d9-41e6-8db1-9fc7c5d29532 tempest-TestImageHashVerification-1695358243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-6b882643-a2d9-41e6-8db1-9fc7c5d29532 tempest-TestImageHashVerification-1695358243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:18 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8d2a20-914d-4219-a97c-055b86a3e95b]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6b882643-a2d9-41e6-8db1-9fc7c5d29532 tempest-TestImageHashVerification-1695358243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-daa9f999-a712-4e19-8079-963614ab67c2 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:18 devstack sudo[101726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-daa9f999-a712-4e19-8079-963614ab67c2 Jul 30 17:01:18 devstack sudo[101726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:18 devstack sudo[101726]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6b882643-a2d9-41e6-8db1-9fc7c5d29532 tempest-TestImageHashVerification-1695358243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-daa9f999-a712-4e19-8079-963614ab67c2" returned: 0 in 0.444s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:18 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a47075b-c46e-4f2d-81ea-645f972a9924]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6b882643-a2d9-41e6-8db1-9fc7c5d29532 tempest-TestImageHashVerification-1695358243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-daa9f999-a712-4e19-8079-963614ab67c2 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:18 devstack sudo[101731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-daa9f999-a712-4e19-8079-963614ab67c2 Jul 30 17:01:18 devstack sudo[101731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:19 devstack sudo[101731]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6b882643-a2d9-41e6-8db1-9fc7c5d29532 tempest-TestImageHashVerification-1695358243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-daa9f999-a712-4e19-8079-963614ab67c2" returned: 0 in 0.463s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6b882643-a2d9-41e6-8db1-9fc7c5d29532 tempest-TestImageHashVerification-1695358243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-daa9f999-a712-4e19-8079-963614ab67c2 /opt/stack/data/cinder/conversion/daa9f999-a712-4e19-8079-963614ab67c2.temp_image.db16db96-4631-4c9c-b98e-0b3f1b8ed892134k29uh.img {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:19 devstack sudo[101736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-daa9f999-a712-4e19-8079-963614ab67c2 /opt/stack/data/cinder/conversion/daa9f999-a712-4e19-8079-963614ab67c2.temp_image.db16db96-4631-4c9c-b98e-0b3f1b8ed892134k29uh.img Jul 30 17:01:19 devstack sudo[101736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:22 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:01:22 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] Flow 'volume_create_manager' (6cb9e6e6-4620-4d21-8d3b-cebd65ecc020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:01:22 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fec8f400-9c81-4290-84a9-fe02240232da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:22 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fec8f400-9c81-4290-84a9-fe02240232da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-426406996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57cb5a35-5215-4e72-865e-60a94dc5d8e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='276004d5c1f2469b92e64704fd287ae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:01:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:01:22Z,use_quota=True,user_id='96a8f40652fe43728a70f6987cbf3adb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:22 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (363dd8b6-b592-4714-a2bf-8b1a359008df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:22 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (363dd8b6-b592-4714-a2bf-8b1a359008df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:22 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad590dbf-982c-4a5c-bfac-13d8939eb9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:22 devstack cinder-volume[88591]: DEBUG cinder.image.glance [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] Creating Keystone auth plugin from conf {{(pid=88591) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 30 17:01:23 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad590dbf-982c-4a5c-bfac-13d8939eb9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '57cb5a35-5215-4e72-865e-60a94dc5d8e9', 'volume_name': 'volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9', 'volume_size': 1, 'image_id': 'fb94d6e3-28d4-406f-8bad-19349d5f8454', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fb94d6e3-28d4-406f-8bad-19349d5f8454', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7e05c21dff7b441db433e2a7736519e9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fb94d6e3-28d4-406f-8bad-19349d5f8454', 'created_at': datetime.datetime(2026, 7, 30, 14, 42, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 42, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fb94d6e3-28d4-406f-8bad-19349d5f8454/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:23 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (234229cc-92cf-4d5b-85f5-44931db47a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:23 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (234229cc-92cf-4d5b-85f5-44931db47a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:23 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04a6412f-693b-423c-a919-0998d333b836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:23 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] Volume 57cb5a35-5215-4e72-865e-60a94dc5d8e9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9', 'volume_size': 1, 'image_id': 'fb94d6e3-28d4-406f-8bad-19349d5f8454', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fb94d6e3-28d4-406f-8bad-19349d5f8454', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7e05c21dff7b441db433e2a7736519e9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fb94d6e3-28d4-406f-8bad-19349d5f8454', 'created_at': datetime.datetime(2026, 7, 30, 14, 42, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 42, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fb94d6e3-28d4-406f-8bad-19349d5f8454/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 30 17:01:23 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] Trying to clone 57cb5a35-5215-4e72-865e-60a94dc5d8e9 from image fb94d6e3-28d4-406f-8bad-19349d5f8454 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fb94d6e3-28d4-406f-8bad-19349d5f8454', 'metadata': {}}]). {{(pid=88591) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 30 17:01:23 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_zf8cdxcydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88591) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 30 17:01:23 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] Image download 20.69 MB at 20.69 MB/s Jul 30 17:01:24 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[704f7eaa-d2d0-4396-bbf9-5815ed726d71]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_zf8cdxcydevstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:24 devstack sudo[101751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_zf8cdxcydevstack@QuobyteHD Jul 30 17:01:24 devstack sudo[101751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:24 devstack sudo[101736]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6b882643-a2d9-41e6-8db1-9fc7c5d29532 tempest-TestImageHashVerification-1695358243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-daa9f999-a712-4e19-8079-963614ab67c2 /opt/stack/data/cinder/conversion/daa9f999-a712-4e19-8079-963614ab67c2.temp_image.db16db96-4631-4c9c-b98e-0b3f1b8ed892134k29uh.img" returned: 0 in 5.501s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:24 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[60902ebc-8740-4604-bf4e-6915b1ca054a]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6b882643-a2d9-41e6-8db1-9fc7c5d29532 tempest-TestImageHashVerification-1695358243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-daa9f999-a712-4e19-8079-963614ab67c2 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:24 devstack sudo[101751]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_zf8cdxcydevstack@QuobyteHD" returned: 0 in 0.672s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:24 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] Temporary image fb94d6e3-28d4-406f-8bad-19349d5f8454 is fetched for user 96a8f40652fe43728a70f6987cbf3adb. {{(pid=88591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 30 17:01:24 devstack sudo[101759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-daa9f999-a712-4e19-8079-963614ab67c2 Jul 30 17:01:24 devstack sudo[101759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:24 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e86420-ece7-47b9-a36c-bd4e9bb82597]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_zf8cdxcydevstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:24 devstack sudo[101761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_zf8cdxcydevstack@QuobyteHD Jul 30 17:01:24 devstack sudo[101761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:25 devstack sudo[101761]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_zf8cdxcydevstack@QuobyteHD" returned: 0 in 0.380s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:25 devstack sudo[101759]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6b882643-a2d9-41e6-8db1-9fc7c5d29532 tempest-TestImageHashVerification-1695358243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-daa9f999-a712-4e19-8079-963614ab67c2" returned: 0 in 0.622s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:25 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-6b882643-a2d9-41e6-8db1-9fc7c5d29532 tempest-TestImageHashVerification-1695358243 None] Image conversion details: src /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-daa9f999-a712-4e19-8079-963614ab67c2, size 1024.00 MB, duration 5.50 sec, destination /opt/stack/data/cinder/conversion/daa9f999-a712-4e19-8079-963614ab67c2.temp_image.db16db96-4631-4c9c-b98e-0b3f1b8ed892134k29uh.img {{(pid=88591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 17:01:25 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-6b882643-a2d9-41e6-8db1-9fc7c5d29532 tempest-TestImageHashVerification-1695358243 None] Converted 1024.00 MB image at 186.10 MB/s Jul 30 17:01:25 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-6b882643-a2d9-41e6-8db1-9fc7c5d29532 tempest-TestImageHashVerification-1695358243 None] db16db96-4631-4c9c-b98e-0b3f1b8ed892 was raw, no need to convert to raw {{(pid=88591) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 30 17:01:28 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-311635cd-b974-4826-9bd9-8c870723929d tempest-VolumesSnapshotTestJSON-1775603194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:01:28 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-311635cd-b974-4826-9bd9-8c870723929d tempest-VolumesSnapshotTestJSON-1775603194 None] Flow 'volume_create_manager' (22f29cc4-5421-4ae3-8f97-7880575d39a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:01:28 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-311635cd-b974-4826-9bd9-8c870723929d tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (131f8169-c31d-4d05-971c-39b18406a615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:28 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-311635cd-b974-4826-9bd9-8c870723929d tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (131f8169-c31d-4d05-971c-39b18406a615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-640742792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceed46bc-e34f-4b07-b786-cee0be9a0c9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a620a5171f04124a32b2f4dee869ebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:01:29Z,use_quota=True,user_id='3b2780b32ed64c058aa90235823c0c74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:28 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-311635cd-b974-4826-9bd9-8c870723929d tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca702c7d-efec-4897-9ece-5de37e84feb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:28 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-311635cd-b974-4826-9bd9-8c870723929d tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca702c7d-efec-4897-9ece-5de37e84feb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:28 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-311635cd-b974-4826-9bd9-8c870723929d tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d67845b-2bbd-4408-8e42-3eb5f81d6cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:28 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-311635cd-b974-4826-9bd9-8c870723929d tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d67845b-2bbd-4408-8e42-3eb5f81d6cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ceed46bc-e34f-4b07-b786-cee0be9a0c9c', 'volume_name': 'volume-ceed46bc-e34f-4b07-b786-cee0be9a0c9c', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:28 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-311635cd-b974-4826-9bd9-8c870723929d tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33fc98f4-c72a-4e07-942a-16f733bc0db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:28 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-311635cd-b974-4826-9bd9-8c870723929d tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33fc98f4-c72a-4e07-942a-16f733bc0db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:28 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-311635cd-b974-4826-9bd9-8c870723929d tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60512e03-b02b-4e5b-a7d4-47a30c7bccc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:28 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-311635cd-b974-4826-9bd9-8c870723929d tempest-VolumesSnapshotTestJSON-1775603194 None] Volume ceed46bc-e34f-4b07-b786-cee0be9a0c9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ceed46bc-e34f-4b07-b786-cee0be9a0c9c', 'volume_size': 1} Jul 30 17:01:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-311635cd-b974-4826-9bd9-8c870723929d tempest-VolumesSnapshotTestJSON-1775603194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:38 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:SELECT=22,cinder:UPDATE=29,cinder:DELETE=2,cinder:INSERT=8 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:01:38 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:SELECT=24,cinder:INSERT=7,cinder:UPDATE=26,cinder:DELETE=2 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:01:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-6b882643-a2d9-41e6-8db1-9fc7c5d29532 tempest-TestImageHashVerification-1695358243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.922s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:44 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6b882643-a2d9-41e6-8db1-9fc7c5d29532 tempest-TestImageHashVerification-1695358243 None] Uploaded volume to glance image-id: db16db96-4631-4c9c-b98e-0b3f1b8ed892. {{(pid=88591) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 30 17:01:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.893s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:44 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-426406996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57cb5a35-5215-4e72-865e-60a94dc5d8e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='276004d5c1f2469b92e64704fd287ae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:01:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:01:22Z,use_quota=True,user_id='96a8f40652fe43728a70f6987cbf3adb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:01:44 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] Creating volume 57cb5a35-5215-4e72-865e-60a94dc5d8e9 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:01:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:44 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:01:44 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:01:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:44 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:01:44 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:01:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:44 devstack sudo[101771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9 1073741824 Jul 30 17:01:44 devstack sudo[101771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:44 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-6b882643-a2d9-41e6-8db1-9fc7c5d29532 tempest-TestImageHashVerification-1695358243 None] Copy volume to image completed successfully. Jul 30 17:01:44 devstack sudo[101771]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9 1073741824" returned: 0 in 0.453s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:44 devstack sudo[101777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9 Jul 30 17:01:44 devstack sudo[101777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:44 devstack sudo[101777]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9" returned: 0 in 0.266s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:44 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:01:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-311635cd-b974-4826-9bd9-8c870723929d tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.039s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:44 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-311635cd-b974-4826-9bd9-8c870723929d tempest-VolumesSnapshotTestJSON-1775603194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-640742792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceed46bc-e34f-4b07-b786-cee0be9a0c9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a620a5171f04124a32b2f4dee869ebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:01:29Z,use_quota=True,user_id='3b2780b32ed64c058aa90235823c0c74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:01:44 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-311635cd-b974-4826-9bd9-8c870723929d tempest-VolumesSnapshotTestJSON-1775603194 None] Creating volume ceed46bc-e34f-4b07-b786-cee0be9a0c9c {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:01:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-311635cd-b974-4826-9bd9-8c870723929d tempest-VolumesSnapshotTestJSON-1775603194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-311635cd-b974-4826-9bd9-8c870723929d tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:44 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-311635cd-b974-4826-9bd9-8c870723929d tempest-VolumesSnapshotTestJSON-1775603194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:01:44 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-311635cd-b974-4826-9bd9-8c870723929d tempest-VolumesSnapshotTestJSON-1775603194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:01:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-311635cd-b974-4826-9bd9-8c870723929d tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:44 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-311635cd-b974-4826-9bd9-8c870723929d tempest-VolumesSnapshotTestJSON-1775603194 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:01:44 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-311635cd-b974-4826-9bd9-8c870723929d tempest-VolumesSnapshotTestJSON-1775603194 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:01:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-311635cd-b974-4826-9bd9-8c870723929d tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ceed46bc-e34f-4b07-b786-cee0be9a0c9c 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:44 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f1540907-f561-4e30-9568-d41656cac61e tempest-TestImageHashVerification-1695358243 None] Acquiring lock "cinder-daa9f999-a712-4e19-8079-963614ab67c2-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:44 devstack sudo[101780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ceed46bc-e34f-4b07-b786-cee0be9a0c9c 1073741824 Jul 30 17:01:44 devstack sudo[101780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:44 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f1540907-f561-4e30-9568-d41656cac61e tempest-TestImageHashVerification-1695358243 None] Lock "cinder-daa9f999-a712-4e19-8079-963614ab67c2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:45 devstack cinder-volume[88591]: DEBUG cinder.volume.volume_utils [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] Attempting download of fb94d6e3-28d4-406f-8bad-19349d5f8454 ((None, [{'url': 'file:///opt/stack/data/glance/images/fb94d6e3-28d4-406f-8bad-19349d5f8454', 'metadata': {}}])) to volume 57cb5a35-5215-4e72-865e-60a94dc5d8e9. {{(pid=88591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 30 17:01:45 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f1540907-f561-4e30-9568-d41656cac61e tempest-TestImageHashVerification-1695358243 None] Acquiring lock "cinder-quobyte-daa9f999-a712-4e19-8079-963614ab67c2" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:45 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f1540907-f561-4e30-9568-d41656cac61e tempest-TestImageHashVerification-1695358243 None] Lock "cinder-quobyte-daa9f999-a712-4e19-8079-963614ab67c2" acquired by "delete_volume" :: waited 0.016s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:45 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[80585a20-5064-4e04-bbc7-9085f1226bf5]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f1540907-f561-4e30-9568-d41656cac61e tempest-TestImageHashVerification-1695358243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-daa9f999-a712-4e19-8079-963614ab67c2 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:45 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[0125eaa2-6205-4964-9d48-2f799eb1aea9]: (4, 'raw') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fb94d6e3-28d4-406f-8bad-19349d5f8454_5oev9u89 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:45 devstack sudo[101782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-daa9f999-a712-4e19-8079-963614ab67c2 Jul 30 17:01:45 devstack sudo[101782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:45 devstack sudo[101783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fb94d6e3-28d4-406f-8bad-19349d5f8454_5oev9u89 Jul 30 17:01:45 devstack sudo[101783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:45 devstack sudo[101780]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-311635cd-b974-4826-9bd9-8c870723929d tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ceed46bc-e34f-4b07-b786-cee0be9a0c9c 1073741824" returned: 0 in 0.462s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:45 devstack sudo[101783]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fb94d6e3-28d4-406f-8bad-19349d5f8454_5oev9u89" returned: 0 in 0.362s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fb94d6e3-28d4-406f-8bad-19349d5f8454_5oev9u89 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:45 devstack sudo[101782]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-311635cd-b974-4826-9bd9-8c870723929d tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ceed46bc-e34f-4b07-b786-cee0be9a0c9c {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f1540907-f561-4e30-9568-d41656cac61e tempest-TestImageHashVerification-1695358243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-daa9f999-a712-4e19-8079-963614ab67c2" returned: 0 in 0.413s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f1540907-f561-4e30-9568-d41656cac61e tempest-TestImageHashVerification-1695358243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-daa9f999-a712-4e19-8079-963614ab67c2 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:45 devstack sudo[101796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ceed46bc-e34f-4b07-b786-cee0be9a0c9c Jul 30 17:01:45 devstack sudo[101796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:45 devstack sudo[101797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-daa9f999-a712-4e19-8079-963614ab67c2 Jul 30 17:01:45 devstack sudo[101797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:45 devstack sudo[101795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fb94d6e3-28d4-406f-8bad-19349d5f8454_5oev9u89 Jul 30 17:01:45 devstack sudo[101795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:45 devstack sudo[101796]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-311635cd-b974-4826-9bd9-8c870723929d tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ceed46bc-e34f-4b07-b786-cee0be9a0c9c" returned: 0 in 0.282s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:45 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-311635cd-b974-4826-9bd9-8c870723929d tempest-VolumesSnapshotTestJSON-1775603194 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:01:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-311635cd-b974-4826-9bd9-8c870723929d tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:45 devstack sudo[101797]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f1540907-f561-4e30-9568-d41656cac61e tempest-TestImageHashVerification-1695358243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-daa9f999-a712-4e19-8079-963614ab67c2" returned: 0 in 0.280s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:45 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-311635cd-b974-4826-9bd9-8c870723929d tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60512e03-b02b-4e5b-a7d4-47a30c7bccc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ceed46bc-e34f-4b07-b786-cee0be9a0c9c', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:45 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-311635cd-b974-4826-9bd9-8c870723929d tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42f78815-da9b-4b2a-a9b7-a609b3da7f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:45 devstack sudo[101795]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:45 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f1540907-f561-4e30-9568-d41656cac61e tempest-TestImageHashVerification-1695358243 None] Lock "cinder-quobyte-daa9f999-a712-4e19-8079-963614ab67c2" released by "delete_volume" :: held 0.752s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fb94d6e3-28d4-406f-8bad-19349d5f8454_5oev9u89" returned: 1 in 0.347s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fb94d6e3-28d4-406f-8bad-19349d5f8454_5oev9u89' failed. Not Retrying. {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 17:01:45 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82bec3e-0acf-4edb-9903-7c63e261286f]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_zf8cdxcydevstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:45 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-311635cd-b974-4826-9bd9-8c870723929d tempest-VolumesSnapshotTestJSON-1775603194 None] Volume volume-ceed46bc-e34f-4b07-b786-cee0be9a0c9c (ceed46bc-e34f-4b07-b786-cee0be9a0c9c): created successfully Jul 30 17:01:45 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-311635cd-b974-4826-9bd9-8c870723929d tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42f78815-da9b-4b2a-a9b7-a609b3da7f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:45 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-311635cd-b974-4826-9bd9-8c870723929d tempest-VolumesSnapshotTestJSON-1775603194 None] Flow 'volume_create_manager' (22f29cc4-5421-4ae3-8f97-7880575d39a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:01:45 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-311635cd-b974-4826-9bd9-8c870723929d tempest-VolumesSnapshotTestJSON-1775603194 None] Created volume successfully. Jul 30 17:01:45 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-f1540907-f561-4e30-9568-d41656cac61e tempest-TestImageHashVerification-1695358243 None] Created reservations ['95d32c6e-d608-424c-811f-2994e0013b93', '3dbc89de-7f2b-4376-898f-c899d500fa8d', '7d281830-720a-46f9-ab26-53cfe96306d8', 'e562131d-849b-4931-bbe3-31e0f9c33e89'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:01:45 devstack sudo[101805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_zf8cdxcydevstack@QuobyteHD Jul 30 17:01:45 devstack sudo[101805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f1540907-f561-4e30-9568-d41656cac61e tempest-TestImageHashVerification-1695358243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f1540907-f561-4e30-9568-d41656cac61e tempest-TestImageHashVerification-1695358243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:45 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f1540907-f561-4e30-9568-d41656cac61e tempest-TestImageHashVerification-1695358243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:01:45 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f1540907-f561-4e30-9568-d41656cac61e tempest-TestImageHashVerification-1695358243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:01:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f1540907-f561-4e30-9568-d41656cac61e tempest-TestImageHashVerification-1695358243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f1540907-f561-4e30-9568-d41656cac61e tempest-TestImageHashVerification-1695358243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:45 devstack sudo[101807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:01:45 devstack sudo[101807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:46 devstack sudo[101805]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_zf8cdxcydevstack@QuobyteHD" returned: 0 in 0.343s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:46 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] fb94d6e3-28d4-406f-8bad-19349d5f8454 was qcow2, converting to qcow2 {{(pid=88591) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 30 17:01:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_zf8cdxcydevstack@QuobyteHD /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:46 devstack sudo[101812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_zf8cdxcydevstack@QuobyteHD /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9 Jul 30 17:01:46 devstack sudo[101812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:46 devstack sudo[101807]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f1540907-f561-4e30-9568-d41656cac61e tempest-TestImageHashVerification-1695358243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.279s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:46 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-f1540907-f561-4e30-9568-d41656cac61e tempest-TestImageHashVerification-1695358243 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:01:46 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-f1540907-f561-4e30-9568-d41656cac61e tempest-TestImageHashVerification-1695358243 None] Deleted volume successfully. Jul 30 17:01:46 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f1540907-f561-4e30-9568-d41656cac61e tempest-TestImageHashVerification-1695358243 None] Lock "cinder-daa9f999-a712-4e19-8079-963614ab67c2-delete_volume" released by "delete_volume" :: held 1.272s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1ab616a8-af48-4db5-9b05-9c9ae0ffd28e tempest-VolumesSnapshotTestJSON-1775603194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1ab616a8-af48-4db5-9b05-9c9ae0ffd28e tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:47 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-1ab616a8-af48-4db5-9b05-9c9ae0ffd28e tempest-VolumesSnapshotTestJSON-1775603194 None] Creating offline snapshot fc8ff687-6ac4-4874-8ae9-1f5731761367 of volume ceed46bc-e34f-4b07-b786-cee0be9a0c9c {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:01:47 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[797784db-8864-4fb4-9587-f03a82766243]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1ab616a8-af48-4db5-9b05-9c9ae0ffd28e tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ceed46bc-e34f-4b07-b786-cee0be9a0c9c {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:47 devstack sudo[101857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ceed46bc-e34f-4b07-b786-cee0be9a0c9c Jul 30 17:01:47 devstack sudo[101857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:47 devstack sudo[101857]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1ab616a8-af48-4db5-9b05-9c9ae0ffd28e tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ceed46bc-e34f-4b07-b786-cee0be9a0c9c" returned: 0 in 0.533s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1ab616a8-af48-4db5-9b05-9c9ae0ffd28e tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ceed46bc-e34f-4b07-b786-cee0be9a0c9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ceed46bc-e34f-4b07-b786-cee0be9a0c9c.fc8ff687-6ac4-4874-8ae9-1f5731761367 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:47 devstack sudo[101863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ceed46bc-e34f-4b07-b786-cee0be9a0c9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ceed46bc-e34f-4b07-b786-cee0be9a0c9c.fc8ff687-6ac4-4874-8ae9-1f5731761367 1G Jul 30 17:01:47 devstack sudo[101863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:48 devstack sudo[101812]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_zf8cdxcydevstack@QuobyteHD /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9" returned: 0 in 2.162s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:48 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_zf8cdxcydevstack@QuobyteHD, size 112.00 MB, duration 2.16 sec, destination /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9 {{(pid=88591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 17:01:48 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] Converted 112.00 MB image at 51.75 MB/s Jul 30 17:01:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:48 devstack sudo[101869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9 1G Jul 30 17:01:48 devstack sudo[101869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:48 devstack sudo[101863]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1ab616a8-af48-4db5-9b05-9c9ae0ffd28e tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ceed46bc-e34f-4b07-b786-cee0be9a0c9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ceed46bc-e34f-4b07-b786-cee0be9a0c9c.fc8ff687-6ac4-4874-8ae9-1f5731761367 1G" returned: 0 in 0.551s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1ab616a8-af48-4db5-9b05-9c9ae0ffd28e tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ceed46bc-e34f-4b07-b786-cee0be9a0c9c -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ceed46bc-e34f-4b07-b786-cee0be9a0c9c.fc8ff687-6ac4-4874-8ae9-1f5731761367 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:48 devstack sudo[101871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ceed46bc-e34f-4b07-b786-cee0be9a0c9c -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ceed46bc-e34f-4b07-b786-cee0be9a0c9c.fc8ff687-6ac4-4874-8ae9-1f5731761367 Jul 30 17:01:48 devstack sudo[101871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:48 devstack sudo[101869]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9 1G" returned: 0 in 0.342s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:48 devstack cinder-volume[88591]: DEBUG cinder.volume.volume_utils [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] Downloaded image fb94d6e3-28d4-406f-8bad-19349d5f8454 ((None, [{'url': 'file:///opt/stack/data/glance/images/fb94d6e3-28d4-406f-8bad-19349d5f8454', 'metadata': {}}])) to volume 57cb5a35-5215-4e72-865e-60a94dc5d8e9 successfully. {{(pid=88591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 30 17:01:48 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] Temporary image fb94d6e3-28d4-406f-8bad-19349d5f8454 for user 96a8f40652fe43728a70f6987cbf3adb is deleted. {{(pid=88591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 30 17:01:48 devstack cinder-volume[88591]: DEBUG cinder.volume.volume_utils [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] Marking volume 57cb5a35-5215-4e72-865e-60a94dc5d8e9 as bootable. {{(pid=88591) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 30 17:01:48 devstack sudo[101871]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1ab616a8-af48-4db5-9b05-9c9ae0ffd28e tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ceed46bc-e34f-4b07-b786-cee0be9a0c9c -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ceed46bc-e34f-4b07-b786-cee0be9a0c9c.fc8ff687-6ac4-4874-8ae9-1f5731761367" returned: 0 in 0.312s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:48 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-1ab616a8-af48-4db5-9b05-9c9ae0ffd28e tempest-VolumesSnapshotTestJSON-1775603194 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ceed46bc-e34f-4b07-b786-cee0be9a0c9c.fc8ff687-6ac4-4874-8ae9-1f5731761367 is being set with open permissions: ugo+rw Jul 30 17:01:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1ab616a8-af48-4db5-9b05-9c9ae0ffd28e tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ceed46bc-e34f-4b07-b786-cee0be9a0c9c.fc8ff687-6ac4-4874-8ae9-1f5731761367 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:48 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] Copying metadata from image fb94d6e3-28d4-406f-8bad-19349d5f8454 to 57cb5a35-5215-4e72-865e-60a94dc5d8e9. {{(pid=88591) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 30 17:01:48 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] Creating volume glance metadata for volume 57cb5a35-5215-4e72-865e-60a94dc5d8e9 backed by image fb94d6e3-28d4-406f-8bad-19349d5f8454 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fb94d6e3-28d4-406f-8bad-19349d5f8454', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88591) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 30 17:01:48 devstack sudo[101880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ceed46bc-e34f-4b07-b786-cee0be9a0c9c.fc8ff687-6ac4-4874-8ae9-1f5731761367 Jul 30 17:01:48 devstack sudo[101880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:48 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04a6412f-693b-423c-a919-0998d333b836) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9', 'volume_size': 1, 'image_id': 'fb94d6e3-28d4-406f-8bad-19349d5f8454', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fb94d6e3-28d4-406f-8bad-19349d5f8454', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7e05c21dff7b441db433e2a7736519e9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fb94d6e3-28d4-406f-8bad-19349d5f8454', 'created_at': datetime.datetime(2026, 7, 30, 14, 42, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 42, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fb94d6e3-28d4-406f-8bad-19349d5f8454/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:48 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d93adc56-ae1f-4bff-9df6-6310e85727e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:48 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] Volume volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9 (57cb5a35-5215-4e72-865e-60a94dc5d8e9): created successfully Jul 30 17:01:48 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d93adc56-ae1f-4bff-9df6-6310e85727e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:48 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] Flow 'volume_create_manager' (6cb9e6e6-4620-4d21-8d3b-cebd65ecc020) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:01:48 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-67144687-99d2-4d49-8c48-c83c4a587f5d tempest-VolumesCloneTest-529609679 None] Created volume successfully. Jul 30 17:01:48 devstack sudo[101880]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1ab616a8-af48-4db5-9b05-9c9ae0ffd28e tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ceed46bc-e34f-4b07-b786-cee0be9a0c9c.fc8ff687-6ac4-4874-8ae9-1f5731761367" returned: 0 in 0.303s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1ab616a8-af48-4db5-9b05-9c9ae0ffd28e tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ceed46bc-e34f-4b07-b786-cee0be9a0c9c.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:49 devstack sudo[101883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ceed46bc-e34f-4b07-b786-cee0be9a0c9c.info Jul 30 17:01:49 devstack sudo[101883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:49 devstack sudo[101883]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1ab616a8-af48-4db5-9b05-9c9ae0ffd28e tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ceed46bc-e34f-4b07-b786-cee0be9a0c9c.info" returned: 0 in 0.323s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:49 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-1ab616a8-af48-4db5-9b05-9c9ae0ffd28e tempest-VolumesSnapshotTestJSON-1775603194 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ceed46bc-e34f-4b07-b786-cee0be9a0c9c.info is being set with open permissions: ugo+rw Jul 30 17:01:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1ab616a8-af48-4db5-9b05-9c9ae0ffd28e tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ceed46bc-e34f-4b07-b786-cee0be9a0c9c.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:49 devstack sudo[101886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ceed46bc-e34f-4b07-b786-cee0be9a0c9c.info Jul 30 17:01:49 devstack sudo[101886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:49 devstack sudo[101886]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1ab616a8-af48-4db5-9b05-9c9ae0ffd28e tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ceed46bc-e34f-4b07-b786-cee0be9a0c9c.info" returned: 0 in 0.250s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1ab616a8-af48-4db5-9b05-9c9ae0ffd28e tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.373s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:49 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-1ab616a8-af48-4db5-9b05-9c9ae0ffd28e tempest-VolumesSnapshotTestJSON-1775603194 None] Create snapshot completed successfully Jul 30 17:01:50 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:01:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] Flow 'volume_create_manager' (7e4448ae-1b7a-4a54-a22b-a49627af5256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:01:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aa22223-0693-4244-8096-438ed9d24edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:50 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-2ed3a923-9cc2-419a-a0ae-63db5a789933 tempest-VolumesSnapshotTestJSON-1775603194 None] Acquiring lock "cinder-fc8ff687-6ac4-4874-8ae9-1f5731761367-delete_snapshot" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aa22223-0693-4244-8096-438ed9d24edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1517821620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b0083b4-3711-4180-8888-a96d4bd86fbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='276004d5c1f2469b92e64704fd287ae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:01:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=57cb5a35-5215-4e72-865e-60a94dc5d8e9,status='creating',terminated_at=None,updated_at=2026-07-30T15:01:50Z,use_quota=True,user_id='96a8f40652fe43728a70f6987cbf3adb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6502e5cb-7aa8-4d1c-80e2-d2d693ae97f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6502e5cb-7aa8-4d1c-80e2-d2d693ae97f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f6f7d01-a78e-484b-b201-ac0efd243750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:50 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-2ed3a923-9cc2-419a-a0ae-63db5a789933 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "cinder-fc8ff687-6ac4-4874-8ae9-1f5731761367-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f6f7d01-a78e-484b-b201-ac0efd243750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '9b0083b4-3711-4180-8888-a96d4bd86fbb', 'volume_name': 'volume-9b0083b4-3711-4180-8888-a96d4bd86fbb', 'volume_size': 1, 'source_volid': '57cb5a35-5215-4e72-865e-60a94dc5d8e9', 'source_volstatus': 'available'}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8597701d-ded5-4c9f-9b60-b8f8e6fa5632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8597701d-ded5-4c9f-9b60-b8f8e6fa5632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d0d23d6-507e-4193-b5b0-355defbe6407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:50 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] Volume 9b0083b4-3711-4180-8888-a96d4bd86fbb: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-9b0083b4-3711-4180-8888-a96d4bd86fbb', 'volume_size': 1, 'source_volid': '57cb5a35-5215-4e72-865e-60a94dc5d8e9', 'source_volstatus': 'available'} Jul 30 17:01:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:50 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] Cloning volume 57cb5a35-5215-4e72-865e-60a94dc5d8e9 to volume 9b0083b4-3711-4180-8888-a96d4bd86fbb Jul 30 17:01:50 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-2ed3a923-9cc2-419a-a0ae-63db5a789933 tempest-VolumesSnapshotTestJSON-1775603194 None] Acquiring lock "cinder-quobyte-ceed46bc-e34f-4b07-b786-cee0be9a0c9c" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:50 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] Creating offline snapshot 87c4cf8b-ecf0-49ac-8ba0-3c1f2fdb5b9c of volume 57cb5a35-5215-4e72-865e-60a94dc5d8e9 {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:01:50 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-2ed3a923-9cc2-419a-a0ae-63db5a789933 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "cinder-quobyte-ceed46bc-e34f-4b07-b786-cee0be9a0c9c" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:50 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-2ed3a923-9cc2-419a-a0ae-63db5a789933 tempest-VolumesSnapshotTestJSON-1775603194 None] Acquiring lock "cinder-quobyte-fc8ff687-6ac4-4874-8ae9-1f5731761367" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:50 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb73536-4d34-4118-94f1-0e32dc3bf74b]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:50 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-2ed3a923-9cc2-419a-a0ae-63db5a789933 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "cinder-quobyte-fc8ff687-6ac4-4874-8ae9-1f5731761367" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:50 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-2ed3a923-9cc2-419a-a0ae-63db5a789933 tempest-VolumesSnapshotTestJSON-1775603194 None] Deleting offline snapshot fc8ff687-6ac4-4874-8ae9-1f5731761367 of volume ceed46bc-e34f-4b07-b786-cee0be9a0c9c {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:01:50 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-2ed3a923-9cc2-419a-a0ae-63db5a789933 tempest-VolumesSnapshotTestJSON-1775603194 None] snapshot_file for this snap is: volume-ceed46bc-e34f-4b07-b786-cee0be9a0c9c.fc8ff687-6ac4-4874-8ae9-1f5731761367 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:01:50 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cce31aa-55a4-4789-aba5-d410f104f972]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2ed3a923-9cc2-419a-a0ae-63db5a789933 tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ceed46bc-e34f-4b07-b786-cee0be9a0c9c.fc8ff687-6ac4-4874-8ae9-1f5731761367 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:50 devstack sudo[101896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9 Jul 30 17:01:50 devstack sudo[101896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:50 devstack sudo[101897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ceed46bc-e34f-4b07-b786-cee0be9a0c9c.fc8ff687-6ac4-4874-8ae9-1f5731761367 Jul 30 17:01:50 devstack sudo[101897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:51 devstack sudo[101896]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9" returned: 0 in 0.456s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9.87c4cf8b-ecf0-49ac-8ba0-3c1f2fdb5b9c 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:51 devstack sudo[101897]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2ed3a923-9cc2-419a-a0ae-63db5a789933 tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ceed46bc-e34f-4b07-b786-cee0be9a0c9c.fc8ff687-6ac4-4874-8ae9-1f5731761367" returned: 0 in 0.410s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:51 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-2ed3a923-9cc2-419a-a0ae-63db5a789933 tempest-VolumesSnapshotTestJSON-1775603194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ceed46bc-e34f-4b07-b786-cee0be9a0c9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:01:51 devstack sudo[101907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9.87c4cf8b-ecf0-49ac-8ba0-3c1f2fdb5b9c 1G Jul 30 17:01:51 devstack sudo[101907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:51 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[128e8196-347a-4302-8a40-b3f46d8106b9]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2ed3a923-9cc2-419a-a0ae-63db5a789933 tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ceed46bc-e34f-4b07-b786-cee0be9a0c9c {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:51 devstack sudo[101909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ceed46bc-e34f-4b07-b786-cee0be9a0c9c Jul 30 17:01:51 devstack sudo[101909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:51 devstack sudo[101909]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2ed3a923-9cc2-419a-a0ae-63db5a789933 tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ceed46bc-e34f-4b07-b786-cee0be9a0c9c" returned: 0 in 0.433s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2ed3a923-9cc2-419a-a0ae-63db5a789933 tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ceed46bc-e34f-4b07-b786-cee0be9a0c9c.fc8ff687-6ac4-4874-8ae9-1f5731761367 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:51 devstack sudo[101919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ceed46bc-e34f-4b07-b786-cee0be9a0c9c.fc8ff687-6ac4-4874-8ae9-1f5731761367 Jul 30 17:01:51 devstack sudo[101907]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:51 devstack sudo[101919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9.87c4cf8b-ecf0-49ac-8ba0-3c1f2fdb5b9c 1G" returned: 0 in 0.513s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9.87c4cf8b-ecf0-49ac-8ba0-3c1f2fdb5b9c {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:51 devstack sudo[101921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9.87c4cf8b-ecf0-49ac-8ba0-3c1f2fdb5b9c Jul 30 17:01:51 devstack sudo[101921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:52 devstack sudo[101921]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9.87c4cf8b-ecf0-49ac-8ba0-3c1f2fdb5b9c" returned: 0 in 0.359s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:52 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9.87c4cf8b-ecf0-49ac-8ba0-3c1f2fdb5b9c is being set with open permissions: ugo+rw Jul 30 17:01:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9.87c4cf8b-ecf0-49ac-8ba0-3c1f2fdb5b9c {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:52 devstack sudo[101930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9.87c4cf8b-ecf0-49ac-8ba0-3c1f2fdb5b9c Jul 30 17:01:52 devstack sudo[101930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:52 devstack sudo[101919]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2ed3a923-9cc2-419a-a0ae-63db5a789933 tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ceed46bc-e34f-4b07-b786-cee0be9a0c9c.fc8ff687-6ac4-4874-8ae9-1f5731761367" returned: 0 in 0.434s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2ed3a923-9cc2-419a-a0ae-63db5a789933 tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ceed46bc-e34f-4b07-b786-cee0be9a0c9c.fc8ff687-6ac4-4874-8ae9-1f5731761367 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:52 devstack sudo[101933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ceed46bc-e34f-4b07-b786-cee0be9a0c9c.fc8ff687-6ac4-4874-8ae9-1f5731761367 Jul 30 17:01:52 devstack sudo[101933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:52 devstack sudo[101930]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9.87c4cf8b-ecf0-49ac-8ba0-3c1f2fdb5b9c" returned: 0 in 0.277s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:52 devstack sudo[101933]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2ed3a923-9cc2-419a-a0ae-63db5a789933 tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ceed46bc-e34f-4b07-b786-cee0be9a0c9c.fc8ff687-6ac4-4874-8ae9-1f5731761367" returned: 0 in 0.281s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:52 devstack sudo[101937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9.info Jul 30 17:01:52 devstack sudo[101937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:52 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-2ed3a923-9cc2-419a-a0ae-63db5a789933 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "cinder-quobyte-fc8ff687-6ac4-4874-8ae9-1f5731761367" released by "_delete_snapshot" :: held 1.684s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:52 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-2ed3a923-9cc2-419a-a0ae-63db5a789933 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "cinder-quobyte-ceed46bc-e34f-4b07-b786-cee0be9a0c9c" released by "delete_snapshot" :: held 1.717s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:52 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-2ed3a923-9cc2-419a-a0ae-63db5a789933 tempest-VolumesSnapshotTestJSON-1775603194 None] Created reservations ['4cf42dbe-8a6a-4455-877a-ef67ac924f55', '6f9796a3-f7f0-40b0-a292-2cec5a1a469f', '4bb4c0f8-d975-4a7c-a782-8d24730fd34c', '881129fd-9a3c-4071-adb4-8da2ce121b2d'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:01:52 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-2ed3a923-9cc2-419a-a0ae-63db5a789933 tempest-VolumesSnapshotTestJSON-1775603194 None] Delete snapshot completed successfully. Jul 30 17:01:52 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-2ed3a923-9cc2-419a-a0ae-63db5a789933 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "cinder-fc8ff687-6ac4-4874-8ae9-1f5731761367-delete_snapshot" released by "delete_snapshot" :: held 1.998s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:52 devstack sudo[101937]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9.info" returned: 0 in 0.287s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:52 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9.info is being set with open permissions: ugo+rw Jul 30 17:01:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:52 devstack sudo[101940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9.info Jul 30 17:01:52 devstack sudo[101940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:52 devstack sudo[101940]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9.info" returned: 0 in 0.297s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:52 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] Acquiring lock "cinder-quobyte-9b0083b4-3711-4180-8888-a96d4bd86fbb" by "_copy_volume_from_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:53 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] Lock "cinder-quobyte-9b0083b4-3711-4180-8888-a96d4bd86fbb" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:53 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] snapshot: 87c4cf8b-ecf0-49ac-8ba0-3c1f2fdb5b9c, volume: 9b0083b4-3711-4180-8888-a96d4bd86fbb, {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 17:01:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:53 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:01:53 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:01:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:53 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d427e72-dde1-438c-9c80-879849231d4f]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9.87c4cf8b-ecf0-49ac-8ba0-3c1f2fdb5b9c {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:53 devstack sudo[101943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9.87c4cf8b-ecf0-49ac-8ba0-3c1f2fdb5b9c Jul 30 17:01:53 devstack sudo[101943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:53 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bd37d0c-f73b-4d7c-a9fd-0709c10c9999 tempest-VolumesSnapshotTestJSON-1775603194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:01:53 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-9bd37d0c-f73b-4d7c-a9fd-0709c10c9999 tempest-VolumesSnapshotTestJSON-1775603194 None] Flow 'volume_create_manager' (e6e4126a-5b03-4ea9-a5c8-78592ecb2d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:01:53 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-9bd37d0c-f73b-4d7c-a9fd-0709c10c9999 tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (341dae79-2705-41b1-b792-4fa09fb2d3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:53 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-9bd37d0c-f73b-4d7c-a9fd-0709c10c9999 tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (341dae79-2705-41b1-b792-4fa09fb2d3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-971072182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c790660-85aa-4348-8154-cc34d1ac3999,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a620a5171f04124a32b2f4dee869ebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:01:53Z,use_quota=True,user_id='3b2780b32ed64c058aa90235823c0c74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:53 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-9bd37d0c-f73b-4d7c-a9fd-0709c10c9999 tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15f67eff-87ed-4f81-86a5-510c415630d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:53 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-9bd37d0c-f73b-4d7c-a9fd-0709c10c9999 tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15f67eff-87ed-4f81-86a5-510c415630d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:53 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-9bd37d0c-f73b-4d7c-a9fd-0709c10c9999 tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56d16c90-05e2-469d-95d2-4646c0cca16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:53 devstack sudo[101943]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:53 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-9bd37d0c-f73b-4d7c-a9fd-0709c10c9999 tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56d16c90-05e2-469d-95d2-4646c0cca16c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c790660-85aa-4348-8154-cc34d1ac3999', 'volume_name': 'volume-8c790660-85aa-4348-8154-cc34d1ac3999', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:53 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-9bd37d0c-f73b-4d7c-a9fd-0709c10c9999 tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab0c55da-d0fd-4ac6-80ea-2394a1f4d2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:53 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-9bd37d0c-f73b-4d7c-a9fd-0709c10c9999 tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab0c55da-d0fd-4ac6-80ea-2394a1f4d2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:53 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-9bd37d0c-f73b-4d7c-a9fd-0709c10c9999 tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4aa466d-0bb0-4de9-8d5d-52989ddebc75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:53 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-9bd37d0c-f73b-4d7c-a9fd-0709c10c9999 tempest-VolumesSnapshotTestJSON-1775603194 None] Volume 8c790660-85aa-4348-8154-cc34d1ac3999: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c790660-85aa-4348-8154-cc34d1ac3999', 'volume_size': 1} Jul 30 17:01:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-9bd37d0c-f73b-4d7c-a9fd-0709c10c9999 tempest-VolumesSnapshotTestJSON-1775603194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9.87c4cf8b-ecf0-49ac-8ba0-3c1f2fdb5b9c" returned: 0 in 0.421s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:53 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:01:53 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e63e675-c9f4-4260-bda7-de92b5c1ec54]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:53 devstack sudo[101948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9 Jul 30 17:01:53 devstack sudo[101948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:53 devstack sudo[101948]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9" returned: 0 in 0.435s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:53 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] will copy from snapshot at /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9 {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 17:01:53 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] Creating direct copy from snapshot {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 17:01:53 devstack cinder-volume[88591]: DEBUG cinder.utils [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] Path /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9b0083b4-3711-4180-8888-a96d4bd86fbb not found in is_blk_device check {{(pid=88591) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 17:01:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9b0083b4-3711-4180-8888-a96d4bd86fbb {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:53 devstack sudo[101954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9b0083b4-3711-4180-8888-a96d4bd86fbb Jul 30 17:01:53 devstack sudo[101954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:55 devstack sudo[101954]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9b0083b4-3711-4180-8888-a96d4bd86fbb" returned: 0 in 1.367s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:55 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] Image conversion details: src /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9, size 1024.00 MB, duration 1.37 sec, destination /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9b0083b4-3711-4180-8888-a96d4bd86fbb {{(pid=88591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 17:01:55 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] Converted 1024.00 MB image at 747.63 MB/s Jul 30 17:01:55 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9b0083b4-3711-4180-8888-a96d4bd86fbb is being set with open permissions: ugo+rw Jul 30 17:01:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9b0083b4-3711-4180-8888-a96d4bd86fbb {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:55 devstack sudo[101962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9b0083b4-3711-4180-8888-a96d4bd86fbb Jul 30 17:01:55 devstack sudo[101962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:55 devstack sudo[101962]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9b0083b4-3711-4180-8888-a96d4bd86fbb" returned: 0 in 0.267s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:55 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] Lock "cinder-quobyte-9b0083b4-3711-4180-8888-a96d4bd86fbb" released by "_copy_volume_from_snapshot" :: held 2.620s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:55 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] Acquiring lock "cinder-quobyte-87c4cf8b-ecf0-49ac-8ba0-3c1f2fdb5b9c" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:55 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] Lock "cinder-quobyte-87c4cf8b-ecf0-49ac-8ba0-3c1f2fdb5b9c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:55 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] Deleting offline snapshot 87c4cf8b-ecf0-49ac-8ba0-3c1f2fdb5b9c of volume 57cb5a35-5215-4e72-865e-60a94dc5d8e9 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:01:55 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] snapshot_file for this snap is: volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9.87c4cf8b-ecf0-49ac-8ba0-3c1f2fdb5b9c {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:01:55 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5192ce-1061-40b3-b529-052cc5b7110a]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9.87c4cf8b-ecf0-49ac-8ba0-3c1f2fdb5b9c {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:55 devstack sudo[101965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9.87c4cf8b-ecf0-49ac-8ba0-3c1f2fdb5b9c Jul 30 17:01:55 devstack sudo[101965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:56 devstack sudo[101965]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9.87c4cf8b-ecf0-49ac-8ba0-3c1f2fdb5b9c" returned: 0 in 0.406s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:56 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:01:56 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[052aeafd-9b2b-46d3-878c-673cfcf9886b]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:56 devstack sudo[101970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9 Jul 30 17:01:56 devstack sudo[101970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:56 devstack sudo[101970]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9" returned: 0 in 0.377s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9.87c4cf8b-ecf0-49ac-8ba0-3c1f2fdb5b9c {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:56 devstack sudo[101976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9.87c4cf8b-ecf0-49ac-8ba0-3c1f2fdb5b9c Jul 30 17:01:56 devstack sudo[101976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:56 devstack sudo[101976]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9.87c4cf8b-ecf0-49ac-8ba0-3c1f2fdb5b9c" returned: 0 in 0.365s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9.87c4cf8b-ecf0-49ac-8ba0-3c1f2fdb5b9c {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:56 devstack sudo[101981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9.87c4cf8b-ecf0-49ac-8ba0-3c1f2fdb5b9c Jul 30 17:01:56 devstack sudo[101981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:57 devstack sudo[101981]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9.87c4cf8b-ecf0-49ac-8ba0-3c1f2fdb5b9c" returned: 0 in 0.257s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:57 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] Lock "cinder-quobyte-87c4cf8b-ecf0-49ac-8ba0-3c1f2fdb5b9c" released by "_delete_snapshot" :: held 1.522s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 6.580s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:57 devstack cinder-volume[88591]: DEBUG cinder.volume.volume_utils [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] Marking volume 9b0083b4-3711-4180-8888-a96d4bd86fbb as bootable. {{(pid=88591) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 30 17:01:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-9bd37d0c-f73b-4d7c-a9fd-0709c10c9999 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.717s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:57 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-9bd37d0c-f73b-4d7c-a9fd-0709c10c9999 tempest-VolumesSnapshotTestJSON-1775603194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-971072182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c790660-85aa-4348-8154-cc34d1ac3999,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a620a5171f04124a32b2f4dee869ebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:01:53Z,use_quota=True,user_id='3b2780b32ed64c058aa90235823c0c74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:01:57 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-9bd37d0c-f73b-4d7c-a9fd-0709c10c9999 tempest-VolumesSnapshotTestJSON-1775603194 None] Creating volume 8c790660-85aa-4348-8154-cc34d1ac3999 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:01:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-9bd37d0c-f73b-4d7c-a9fd-0709c10c9999 tempest-VolumesSnapshotTestJSON-1775603194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-9bd37d0c-f73b-4d7c-a9fd-0709c10c9999 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:57 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-9bd37d0c-f73b-4d7c-a9fd-0709c10c9999 tempest-VolumesSnapshotTestJSON-1775603194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:01:57 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-9bd37d0c-f73b-4d7c-a9fd-0709c10c9999 tempest-VolumesSnapshotTestJSON-1775603194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:01:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-9bd37d0c-f73b-4d7c-a9fd-0709c10c9999 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:57 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-9bd37d0c-f73b-4d7c-a9fd-0709c10c9999 tempest-VolumesSnapshotTestJSON-1775603194 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:01:57 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-9bd37d0c-f73b-4d7c-a9fd-0709c10c9999 tempest-VolumesSnapshotTestJSON-1775603194 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:01:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9bd37d0c-f73b-4d7c-a9fd-0709c10c9999 tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c790660-85aa-4348-8154-cc34d1ac3999 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:57 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] Copying metadata from source volume 57cb5a35-5215-4e72-865e-60a94dc5d8e9 to 9b0083b4-3711-4180-8888-a96d4bd86fbb. {{(pid=88591) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:438}} Jul 30 17:01:57 devstack sudo[101984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c790660-85aa-4348-8154-cc34d1ac3999 1073741824 Jul 30 17:01:57 devstack sudo[101984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:57 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d0d23d6-507e-4193-b5b0-355defbe6407) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b0083b4-3711-4180-8888-a96d4bd86fbb', 'volume_size': 1, 'source_volid': '57cb5a35-5215-4e72-865e-60a94dc5d8e9', 'source_volstatus': 'available'}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:57 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02786085-6cdc-45e2-b5d3-7a574989db72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:57 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] Volume volume-9b0083b4-3711-4180-8888-a96d4bd86fbb (9b0083b4-3711-4180-8888-a96d4bd86fbb): created successfully Jul 30 17:01:57 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02786085-6cdc-45e2-b5d3-7a574989db72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:57 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] Flow 'volume_create_manager' (7e4448ae-1b7a-4a54-a22b-a49627af5256) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:01:57 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-d403ed47-3f40-4f86-a1bb-85c6c8b07d6b tempest-VolumesCloneTest-529609679 None] Created volume successfully. Jul 30 17:01:57 devstack sudo[101984]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9bd37d0c-f73b-4d7c-a9fd-0709c10c9999 tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c790660-85aa-4348-8154-cc34d1ac3999 1073741824" returned: 0 in 0.482s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9bd37d0c-f73b-4d7c-a9fd-0709c10c9999 tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c790660-85aa-4348-8154-cc34d1ac3999 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:57 devstack sudo[101990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c790660-85aa-4348-8154-cc34d1ac3999 Jul 30 17:01:57 devstack sudo[101990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:58 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d1259daf-1e57-415a-b7a0-8b4e0b147c7b tempest-VolumesCloneTest-529609679 None] Acquiring lock "cinder-9b0083b4-3711-4180-8888-a96d4bd86fbb-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:58 devstack sudo[101990]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9bd37d0c-f73b-4d7c-a9fd-0709c10c9999 tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c790660-85aa-4348-8154-cc34d1ac3999" returned: 0 in 0.305s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:58 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-9bd37d0c-f73b-4d7c-a9fd-0709c10c9999 tempest-VolumesSnapshotTestJSON-1775603194 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:01:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-9bd37d0c-f73b-4d7c-a9fd-0709c10c9999 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:58 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d1259daf-1e57-415a-b7a0-8b4e0b147c7b tempest-VolumesCloneTest-529609679 None] Lock "cinder-9b0083b4-3711-4180-8888-a96d4bd86fbb-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-9bd37d0c-f73b-4d7c-a9fd-0709c10c9999 tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4aa466d-0bb0-4de9-8d5d-52989ddebc75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c790660-85aa-4348-8154-cc34d1ac3999', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-9bd37d0c-f73b-4d7c-a9fd-0709c10c9999 tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (827bce59-ae98-4abf-b1b8-6f487e98042f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:01:58 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-9bd37d0c-f73b-4d7c-a9fd-0709c10c9999 tempest-VolumesSnapshotTestJSON-1775603194 None] Volume volume-8c790660-85aa-4348-8154-cc34d1ac3999 (8c790660-85aa-4348-8154-cc34d1ac3999): created successfully Jul 30 17:01:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-9bd37d0c-f73b-4d7c-a9fd-0709c10c9999 tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (827bce59-ae98-4abf-b1b8-6f487e98042f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:01:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-9bd37d0c-f73b-4d7c-a9fd-0709c10c9999 tempest-VolumesSnapshotTestJSON-1775603194 None] Flow 'volume_create_manager' (e6e4126a-5b03-4ea9-a5c8-78592ecb2d0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:01:58 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-9bd37d0c-f73b-4d7c-a9fd-0709c10c9999 tempest-VolumesSnapshotTestJSON-1775603194 None] Created volume successfully. Jul 30 17:01:58 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d1259daf-1e57-415a-b7a0-8b4e0b147c7b tempest-VolumesCloneTest-529609679 None] Acquiring lock "cinder-quobyte-9b0083b4-3711-4180-8888-a96d4bd86fbb" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:58 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d1259daf-1e57-415a-b7a0-8b4e0b147c7b tempest-VolumesCloneTest-529609679 None] Lock "cinder-quobyte-9b0083b4-3711-4180-8888-a96d4bd86fbb" acquired by "delete_volume" :: waited 0.017s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:58 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e844fe2-a75f-4101-9a18-cf8adbe69b08]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d1259daf-1e57-415a-b7a0-8b4e0b147c7b tempest-VolumesCloneTest-529609679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9b0083b4-3711-4180-8888-a96d4bd86fbb {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:58 devstack sudo[101993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9b0083b4-3711-4180-8888-a96d4bd86fbb Jul 30 17:01:58 devstack sudo[101993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:58 devstack sudo[101993]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d1259daf-1e57-415a-b7a0-8b4e0b147c7b tempest-VolumesCloneTest-529609679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9b0083b4-3711-4180-8888-a96d4bd86fbb" returned: 0 in 0.394s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d1259daf-1e57-415a-b7a0-8b4e0b147c7b tempest-VolumesCloneTest-529609679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9b0083b4-3711-4180-8888-a96d4bd86fbb {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:58 devstack sudo[101998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9b0083b4-3711-4180-8888-a96d4bd86fbb Jul 30 17:01:58 devstack sudo[101998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-6d0f362b-bef6-43db-accd-8a4c25ad58e2 tempest-VolumesSnapshotTestJSON-1775603194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-6d0f362b-bef6-43db-accd-8a4c25ad58e2 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:58 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-6d0f362b-bef6-43db-accd-8a4c25ad58e2 tempest-VolumesSnapshotTestJSON-1775603194 None] Creating offline snapshot 11cfbbc9-7d89-4373-a84f-2c38ffba4839 of volume 8c790660-85aa-4348-8154-cc34d1ac3999 {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:01:58 devstack sudo[101998]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d1259daf-1e57-415a-b7a0-8b4e0b147c7b tempest-VolumesCloneTest-529609679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9b0083b4-3711-4180-8888-a96d4bd86fbb" returned: 0 in 0.291s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:58 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a90d6de-e835-49d5-ba7f-e2d85e5f10e8]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6d0f362b-bef6-43db-accd-8a4c25ad58e2 tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c790660-85aa-4348-8154-cc34d1ac3999 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:58 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d1259daf-1e57-415a-b7a0-8b4e0b147c7b tempest-VolumesCloneTest-529609679 None] Lock "cinder-quobyte-9b0083b4-3711-4180-8888-a96d4bd86fbb" released by "delete_volume" :: held 0.746s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:58 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-d1259daf-1e57-415a-b7a0-8b4e0b147c7b tempest-VolumesCloneTest-529609679 None] Created reservations ['886b0a91-d83d-4923-81fb-21ee0e906095', '7132b1cb-f8a3-4d36-b515-3402255e72d6', 'ad18422a-1ec9-4138-b012-7798a91aaafc', 'b9042cf6-16c2-4e29-aa3b-4f76e32cb4da'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:01:59 devstack sudo[102001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c790660-85aa-4348-8154-cc34d1ac3999 Jul 30 17:01:59 devstack sudo[102001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d1259daf-1e57-415a-b7a0-8b4e0b147c7b tempest-VolumesCloneTest-529609679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:01:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d1259daf-1e57-415a-b7a0-8b4e0b147c7b tempest-VolumesCloneTest-529609679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:01:59 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d1259daf-1e57-415a-b7a0-8b4e0b147c7b tempest-VolumesCloneTest-529609679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:01:59 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d1259daf-1e57-415a-b7a0-8b4e0b147c7b tempest-VolumesCloneTest-529609679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:01:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d1259daf-1e57-415a-b7a0-8b4e0b147c7b tempest-VolumesCloneTest-529609679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:01:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d1259daf-1e57-415a-b7a0-8b4e0b147c7b tempest-VolumesCloneTest-529609679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:59 devstack sudo[102003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:01:59 devstack sudo[102003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:59 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-15756579-2c04-4a9a-89f6-84b776ac4a2a tempest-VolumesCloneTest-529609679 None] Acquiring lock "cinder-57cb5a35-5215-4e72-865e-60a94dc5d8e9-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:59 devstack sudo[102003]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:59 devstack sudo[102001]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d1259daf-1e57-415a-b7a0-8b4e0b147c7b tempest-VolumesCloneTest-529609679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.324s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:59 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-d1259daf-1e57-415a-b7a0-8b4e0b147c7b tempest-VolumesCloneTest-529609679 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:01:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6d0f362b-bef6-43db-accd-8a4c25ad58e2 tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c790660-85aa-4348-8154-cc34d1ac3999" returned: 0 in 0.508s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6d0f362b-bef6-43db-accd-8a4c25ad58e2 tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c790660-85aa-4348-8154-cc34d1ac3999,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c790660-85aa-4348-8154-cc34d1ac3999.11cfbbc9-7d89-4373-a84f-2c38ffba4839 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:59 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-d1259daf-1e57-415a-b7a0-8b4e0b147c7b tempest-VolumesCloneTest-529609679 None] Deleted volume successfully. Jul 30 17:01:59 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-15756579-2c04-4a9a-89f6-84b776ac4a2a tempest-VolumesCloneTest-529609679 None] Lock "cinder-57cb5a35-5215-4e72-865e-60a94dc5d8e9-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:59 devstack sudo[102009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c790660-85aa-4348-8154-cc34d1ac3999,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c790660-85aa-4348-8154-cc34d1ac3999.11cfbbc9-7d89-4373-a84f-2c38ffba4839 1G Jul 30 17:01:59 devstack sudo[102009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:59 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d1259daf-1e57-415a-b7a0-8b4e0b147c7b tempest-VolumesCloneTest-529609679 None] Lock "cinder-9b0083b4-3711-4180-8888-a96d4bd86fbb-delete_volume" released by "delete_volume" :: held 1.404s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:01:59 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-15756579-2c04-4a9a-89f6-84b776ac4a2a tempest-VolumesCloneTest-529609679 None] Acquiring lock "cinder-quobyte-57cb5a35-5215-4e72-865e-60a94dc5d8e9" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:01:59 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-15756579-2c04-4a9a-89f6-84b776ac4a2a tempest-VolumesCloneTest-529609679 None] Lock "cinder-quobyte-57cb5a35-5215-4e72-865e-60a94dc5d8e9" acquired by "delete_volume" :: waited 0.016s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:01:59 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e02757d-e5db-430b-807a-93fc85239505]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:01:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-15756579-2c04-4a9a-89f6-84b776ac4a2a tempest-VolumesCloneTest-529609679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:59 devstack sudo[102011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9 Jul 30 17:01:59 devstack sudo[102011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:59 devstack sudo[102009]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6d0f362b-bef6-43db-accd-8a4c25ad58e2 tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c790660-85aa-4348-8154-cc34d1ac3999,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c790660-85aa-4348-8154-cc34d1ac3999.11cfbbc9-7d89-4373-a84f-2c38ffba4839 1G" returned: 0 in 0.472s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6d0f362b-bef6-43db-accd-8a4c25ad58e2 tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c790660-85aa-4348-8154-cc34d1ac3999 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c790660-85aa-4348-8154-cc34d1ac3999.11cfbbc9-7d89-4373-a84f-2c38ffba4839 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:59 devstack sudo[102019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c790660-85aa-4348-8154-cc34d1ac3999 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c790660-85aa-4348-8154-cc34d1ac3999.11cfbbc9-7d89-4373-a84f-2c38ffba4839 Jul 30 17:01:59 devstack sudo[102019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:01:59 devstack sudo[102011]: pam_unix(sudo:session): session closed for user root Jul 30 17:01:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-15756579-2c04-4a9a-89f6-84b776ac4a2a tempest-VolumesCloneTest-529609679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9" returned: 0 in 0.413s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:01:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-15756579-2c04-4a9a-89f6-84b776ac4a2a tempest-VolumesCloneTest-529609679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:01:59 devstack sudo[102022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9 Jul 30 17:01:59 devstack sudo[102022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:00 devstack sudo[102019]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6d0f362b-bef6-43db-accd-8a4c25ad58e2 tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c790660-85aa-4348-8154-cc34d1ac3999 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c790660-85aa-4348-8154-cc34d1ac3999.11cfbbc9-7d89-4373-a84f-2c38ffba4839" returned: 0 in 0.329s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:00 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-6d0f362b-bef6-43db-accd-8a4c25ad58e2 tempest-VolumesSnapshotTestJSON-1775603194 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c790660-85aa-4348-8154-cc34d1ac3999.11cfbbc9-7d89-4373-a84f-2c38ffba4839 is being set with open permissions: ugo+rw Jul 30 17:02:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6d0f362b-bef6-43db-accd-8a4c25ad58e2 tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c790660-85aa-4348-8154-cc34d1ac3999.11cfbbc9-7d89-4373-a84f-2c38ffba4839 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:00 devstack sudo[102022]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-15756579-2c04-4a9a-89f6-84b776ac4a2a tempest-VolumesCloneTest-529609679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-57cb5a35-5215-4e72-865e-60a94dc5d8e9" returned: 0 in 0.268s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:00 devstack sudo[102032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c790660-85aa-4348-8154-cc34d1ac3999.11cfbbc9-7d89-4373-a84f-2c38ffba4839 Jul 30 17:02:00 devstack sudo[102032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:00 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-15756579-2c04-4a9a-89f6-84b776ac4a2a tempest-VolumesCloneTest-529609679 None] Lock "cinder-quobyte-57cb5a35-5215-4e72-865e-60a94dc5d8e9" released by "delete_volume" :: held 0.745s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:00 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-15756579-2c04-4a9a-89f6-84b776ac4a2a tempest-VolumesCloneTest-529609679 None] Created reservations ['518b2065-44d3-4a1c-a9b8-934012e7aaa5', '731637b7-4b08-40bb-8ce6-77c2bac664c5', 'bad75c75-b753-40a0-a9df-23244f32bb29', '8ee8e9c2-f059-47aa-9570-957d6f059444'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:02:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-15756579-2c04-4a9a-89f6-84b776ac4a2a tempest-VolumesCloneTest-529609679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-15756579-2c04-4a9a-89f6-84b776ac4a2a tempest-VolumesCloneTest-529609679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:00 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-15756579-2c04-4a9a-89f6-84b776ac4a2a tempest-VolumesCloneTest-529609679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:02:00 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-15756579-2c04-4a9a-89f6-84b776ac4a2a tempest-VolumesCloneTest-529609679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:02:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-15756579-2c04-4a9a-89f6-84b776ac4a2a tempest-VolumesCloneTest-529609679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-15756579-2c04-4a9a-89f6-84b776ac4a2a tempest-VolumesCloneTest-529609679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:00 devstack sudo[102034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:02:00 devstack sudo[102034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:00 devstack sudo[102032]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6d0f362b-bef6-43db-accd-8a4c25ad58e2 tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c790660-85aa-4348-8154-cc34d1ac3999.11cfbbc9-7d89-4373-a84f-2c38ffba4839" returned: 0 in 0.327s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6d0f362b-bef6-43db-accd-8a4c25ad58e2 tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c790660-85aa-4348-8154-cc34d1ac3999.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:00 devstack sudo[102037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c790660-85aa-4348-8154-cc34d1ac3999.info Jul 30 17:02:00 devstack sudo[102037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:00 devstack sudo[102034]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-15756579-2c04-4a9a-89f6-84b776ac4a2a tempest-VolumesCloneTest-529609679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.297s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:00 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-15756579-2c04-4a9a-89f6-84b776ac4a2a tempest-VolumesCloneTest-529609679 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:02:00 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-15756579-2c04-4a9a-89f6-84b776ac4a2a tempest-VolumesCloneTest-529609679 None] Deleted volume successfully. Jul 30 17:02:00 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-15756579-2c04-4a9a-89f6-84b776ac4a2a tempest-VolumesCloneTest-529609679 None] Lock "cinder-57cb5a35-5215-4e72-865e-60a94dc5d8e9-delete_volume" released by "delete_volume" :: held 1.282s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:00 devstack sudo[102037]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6d0f362b-bef6-43db-accd-8a4c25ad58e2 tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c790660-85aa-4348-8154-cc34d1ac3999.info" returned: 0 in 0.328s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:00 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-6d0f362b-bef6-43db-accd-8a4c25ad58e2 tempest-VolumesSnapshotTestJSON-1775603194 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c790660-85aa-4348-8154-cc34d1ac3999.info is being set with open permissions: ugo+rw Jul 30 17:02:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6d0f362b-bef6-43db-accd-8a4c25ad58e2 tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c790660-85aa-4348-8154-cc34d1ac3999.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:00 devstack sudo[102041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c790660-85aa-4348-8154-cc34d1ac3999.info Jul 30 17:02:00 devstack sudo[102041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:01 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-451498ff-0ca8-45e0-8e69-f5bd96a427ec tempest-VolumesCloneTest-529609679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:02:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-451498ff-0ca8-45e0-8e69-f5bd96a427ec tempest-VolumesCloneTest-529609679 None] Flow 'volume_create_manager' (053dfc21-34b9-4801-922b-4d340a9f8ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:02:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-451498ff-0ca8-45e0-8e69-f5bd96a427ec tempest-VolumesCloneTest-529609679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfdeb013-df63-4fdb-ba7c-2c37165cc1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:01 devstack sudo[102041]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-451498ff-0ca8-45e0-8e69-f5bd96a427ec tempest-VolumesCloneTest-529609679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfdeb013-df63-4fdb-ba7c-2c37165cc1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:02:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1711492699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='276004d5c1f2469b92e64704fd287ae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:02:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:02:01Z,use_quota=True,user_id='96a8f40652fe43728a70f6987cbf3adb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-451498ff-0ca8-45e0-8e69-f5bd96a427ec tempest-VolumesCloneTest-529609679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aced8c8-bedf-45ff-99ca-c8a57cb5142c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-451498ff-0ca8-45e0-8e69-f5bd96a427ec tempest-VolumesCloneTest-529609679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aced8c8-bedf-45ff-99ca-c8a57cb5142c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-451498ff-0ca8-45e0-8e69-f5bd96a427ec tempest-VolumesCloneTest-529609679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff042347-7ae9-4fc7-818a-84482806f616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-451498ff-0ca8-45e0-8e69-f5bd96a427ec tempest-VolumesCloneTest-529609679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff042347-7ae9-4fc7-818a-84482806f616) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c', 'volume_name': 'volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-451498ff-0ca8-45e0-8e69-f5bd96a427ec tempest-VolumesCloneTest-529609679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd29a6ba-6356-4b41-bfce-9d47ee33c5eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-451498ff-0ca8-45e0-8e69-f5bd96a427ec tempest-VolumesCloneTest-529609679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd29a6ba-6356-4b41-bfce-9d47ee33c5eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-451498ff-0ca8-45e0-8e69-f5bd96a427ec tempest-VolumesCloneTest-529609679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7c1ae78-7a49-412c-8114-2e4d016e82ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:01 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-451498ff-0ca8-45e0-8e69-f5bd96a427ec tempest-VolumesCloneTest-529609679 None] Volume 3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c', 'volume_size': 1} Jul 30 17:02:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-451498ff-0ca8-45e0-8e69-f5bd96a427ec tempest-VolumesCloneTest-529609679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6d0f362b-bef6-43db-accd-8a4c25ad58e2 tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c790660-85aa-4348-8154-cc34d1ac3999.info" returned: 0 in 0.382s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-6d0f362b-bef6-43db-accd-8a4c25ad58e2 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.455s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-451498ff-0ca8-45e0-8e69-f5bd96a427ec tempest-VolumesCloneTest-529609679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.031s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:01 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-451498ff-0ca8-45e0-8e69-f5bd96a427ec tempest-VolumesCloneTest-529609679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:02:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1711492699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='276004d5c1f2469b92e64704fd287ae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:02:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:02:01Z,use_quota=True,user_id='96a8f40652fe43728a70f6987cbf3adb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:02:01 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-451498ff-0ca8-45e0-8e69-f5bd96a427ec tempest-VolumesCloneTest-529609679 None] Creating volume 3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:02:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-451498ff-0ca8-45e0-8e69-f5bd96a427ec tempest-VolumesCloneTest-529609679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-451498ff-0ca8-45e0-8e69-f5bd96a427ec tempest-VolumesCloneTest-529609679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:01 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-451498ff-0ca8-45e0-8e69-f5bd96a427ec tempest-VolumesCloneTest-529609679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:02:01 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-451498ff-0ca8-45e0-8e69-f5bd96a427ec tempest-VolumesCloneTest-529609679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:02:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-451498ff-0ca8-45e0-8e69-f5bd96a427ec tempest-VolumesCloneTest-529609679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:01 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-451498ff-0ca8-45e0-8e69-f5bd96a427ec tempest-VolumesCloneTest-529609679 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:02:01 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-451498ff-0ca8-45e0-8e69-f5bd96a427ec tempest-VolumesCloneTest-529609679 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:02:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-451498ff-0ca8-45e0-8e69-f5bd96a427ec tempest-VolumesCloneTest-529609679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:01 devstack sudo[102044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c 1073741824 Jul 30 17:02:01 devstack sudo[102044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:01 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-6d0f362b-bef6-43db-accd-8a4c25ad58e2 tempest-VolumesSnapshotTestJSON-1775603194 None] Create snapshot completed successfully Jul 30 17:02:01 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:02:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Flow 'volume_create_manager' (95e103d3-8807-4d7e-8cb8-11ee16f1961f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:02:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f61a696f-12f2-4114-8607-d4b1b3c11110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f61a696f-12f2-4114-8607-d4b1b3c11110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:02:01Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99ba024c-ed54-4872-a429-5efb4e78020a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='229d5719b07743b1910c471c634eb39b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:02:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:02:01Z,use_quota=True,user_id='415b4456c46840dfb1ca008ccfae6cb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e81fe8b9-ab7e-4df5-9797-fe3e84ef831d),volume_type_id=e81fe8b9-ab7e-4df5-9797-fe3e84ef831d)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83d6fed5-a53a-4c13-849e-0d23d6642261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83d6fed5-a53a-4c13-849e-0d23d6642261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bcd2071-802b-462a-a93a-7b76657282f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:01 devstack cinder-volume[88591]: DEBUG cinder.image.glance [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Creating Keystone auth plugin from conf {{(pid=88591) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 30 17:02:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bcd2071-802b-462a-a93a-7b76657282f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '99ba024c-ed54-4872-a429-5efb4e78020a', 'volume_name': 'volume-99ba024c-ed54-4872-a429-5efb4e78020a', 'volume_size': 1, 'image_id': 'd065ec06-3879-4539-b706-ace3f5af77ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d065ec06-3879-4539-b706-ace3f5af77ca', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '30d3568b8c3f8514d4f3cf0c77701cf6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '229d5719b07743b1910c471c634eb39b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f5c72122c3a82eab6f12f93328cec1baec49884cc68d1551c0bf68a77a24ab5d76e31b84d0931da71b2ffd6f3772603ada8fcbd869d9d518a143cc28d78470bb', 'id': 'd065ec06-3879-4539-b706-ace3f5af77ca', 'created_at': datetime.datetime(2026, 7, 30, 15, 1, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 15, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d065ec06-3879-4539-b706-ace3f5af77ca/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c10e560-b796-493d-8b8c-a11ca693ddec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c10e560-b796-493d-8b8c-a11ca693ddec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb296a99-b855-48f3-af45-fb2bf3bc04f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:01 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Volume 99ba024c-ed54-4872-a429-5efb4e78020a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-99ba024c-ed54-4872-a429-5efb4e78020a', 'volume_size': 1, 'image_id': 'd065ec06-3879-4539-b706-ace3f5af77ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d065ec06-3879-4539-b706-ace3f5af77ca', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '30d3568b8c3f8514d4f3cf0c77701cf6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '229d5719b07743b1910c471c634eb39b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f5c72122c3a82eab6f12f93328cec1baec49884cc68d1551c0bf68a77a24ab5d76e31b84d0931da71b2ffd6f3772603ada8fcbd869d9d518a143cc28d78470bb', 'id': 'd065ec06-3879-4539-b706-ace3f5af77ca', 'created_at': datetime.datetime(2026, 7, 30, 15, 1, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 15, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d065ec06-3879-4539-b706-ace3f5af77ca/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 30 17:02:01 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Trying to clone 99ba024c-ed54-4872-a429-5efb4e78020a from image d065ec06-3879-4539-b706-ace3f5af77ca at location (None, [{'url': 'file:///opt/stack/data/glance/images/d065ec06-3879-4539-b706-ace3f5af77ca', 'metadata': {}}]). {{(pid=88591) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 30 17:02:01 devstack sudo[102044]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-451498ff-0ca8-45e0-8e69-f5bd96a427ec tempest-VolumesCloneTest-529609679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c 1073741824" returned: 0 in 0.475s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-451498ff-0ca8-45e0-8e69-f5bd96a427ec tempest-VolumesCloneTest-529609679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:01 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d065ec06-3879-4539-b706-ace3f5af77ca_wbd93_khdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88591) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 30 17:02:01 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Image download 0.00 MB at 0.00 MB/s Jul 30 17:02:01 devstack sudo[102050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c Jul 30 17:02:01 devstack sudo[102050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:01 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0624c15-b498-44f2-b702-394e273e1626]: (4, 'raw') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d065ec06-3879-4539-b706-ace3f5af77ca_wbd93_khdevstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:02 devstack sudo[102052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d065ec06-3879-4539-b706-ace3f5af77ca_wbd93_khdevstack@QuobyteHD Jul 30 17:02:02 devstack sudo[102052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:02 devstack sudo[102050]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-451498ff-0ca8-45e0-8e69-f5bd96a427ec tempest-VolumesCloneTest-529609679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c" returned: 0 in 0.315s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:02 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-451498ff-0ca8-45e0-8e69-f5bd96a427ec tempest-VolumesCloneTest-529609679 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:02:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-451498ff-0ca8-45e0-8e69-f5bd96a427ec tempest-VolumesCloneTest-529609679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-451498ff-0ca8-45e0-8e69-f5bd96a427ec tempest-VolumesCloneTest-529609679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7c1ae78-7a49-412c-8114-2e4d016e82ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-451498ff-0ca8-45e0-8e69-f5bd96a427ec tempest-VolumesCloneTest-529609679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3144a8e-27f8-4261-a3dc-691deb1bde1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:02 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-451498ff-0ca8-45e0-8e69-f5bd96a427ec tempest-VolumesCloneTest-529609679 None] Volume volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c (3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c): created successfully Jul 30 17:02:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-451498ff-0ca8-45e0-8e69-f5bd96a427ec tempest-VolumesCloneTest-529609679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3144a8e-27f8-4261-a3dc-691deb1bde1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-451498ff-0ca8-45e0-8e69-f5bd96a427ec tempest-VolumesCloneTest-529609679 None] Flow 'volume_create_manager' (053dfc21-34b9-4801-922b-4d340a9f8ed3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:02:02 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-451498ff-0ca8-45e0-8e69-f5bd96a427ec tempest-VolumesCloneTest-529609679 None] Created volume successfully. Jul 30 17:02:02 devstack sudo[102052]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d065ec06-3879-4539-b706-ace3f5af77ca_wbd93_khdevstack@QuobyteHD" returned: 0 in 0.401s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d065ec06-3879-4539-b706-ace3f5af77ca_wbd93_khdevstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:02 devstack sudo[102058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d065ec06-3879-4539-b706-ace3f5af77ca_wbd93_khdevstack@QuobyteHD Jul 30 17:02:02 devstack sudo[102058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:02 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-73c58102-9247-4849-b48b-4448d41912c1 tempest-VolumesSnapshotTestJSON-1775603194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:02:02 devstack sudo[102058]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d065ec06-3879-4539-b706-ace3f5af77ca_wbd93_khdevstack@QuobyteHD" returned: 1 in 0.356s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d065ec06-3879-4539-b706-ace3f5af77ca_wbd93_khdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 17:02:02 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Temporary image d065ec06-3879-4539-b706-ace3f5af77ca is fetched for user 415b4456c46840dfb1ca008ccfae6cb3. {{(pid=88591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 30 17:02:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-73c58102-9247-4849-b48b-4448d41912c1 tempest-VolumesSnapshotTestJSON-1775603194 None] Flow 'volume_create_manager' (a66130b7-f651-4323-96c1-fbbb9de5ef89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:02:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-73c58102-9247-4849-b48b-4448d41912c1 tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0622dc6-f656-4590-99d2-a9fd3ee8b691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-73c58102-9247-4849-b48b-4448d41912c1 tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0622dc6-f656-4590-99d2-a9fd3ee8b691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:02:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1441709700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15c53062-51f0-47e8-8758-e0e35f2eeb38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a620a5171f04124a32b2f4dee869ebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:02:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=11cfbbc9-7d89-4373-a84f-2c38ffba4839,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:02:03Z,use_quota=True,user_id='3b2780b32ed64c058aa90235823c0c74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-73c58102-9247-4849-b48b-4448d41912c1 tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0a74f0f-3376-4c74-ac12-1d208c737290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-73c58102-9247-4849-b48b-4448d41912c1 tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0a74f0f-3376-4c74-ac12-1d208c737290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-73c58102-9247-4849-b48b-4448d41912c1 tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df09e51b-3bc7-4cd4-8def-c347c0ec2dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-73c58102-9247-4849-b48b-4448d41912c1 tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df09e51b-3bc7-4cd4-8def-c347c0ec2dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '15c53062-51f0-47e8-8758-e0e35f2eeb38', 'volume_name': 'volume-15c53062-51f0-47e8-8758-e0e35f2eeb38', 'volume_size': 2, 'snapshot_id': '11cfbbc9-7d89-4373-a84f-2c38ffba4839'}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-73c58102-9247-4849-b48b-4448d41912c1 tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd485cff-dabd-46a1-a048-4f90e017f9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-73c58102-9247-4849-b48b-4448d41912c1 tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd485cff-dabd-46a1-a048-4f90e017f9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:02 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-73c58102-9247-4849-b48b-4448d41912c1 tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6df9ab5-474a-4e67-aa44-9745d1335b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:02 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-73c58102-9247-4849-b48b-4448d41912c1 tempest-VolumesSnapshotTestJSON-1775603194 None] Volume 15c53062-51f0-47e8-8758-e0e35f2eeb38: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-15c53062-51f0-47e8-8758-e0e35f2eeb38', 'volume_size': 2, 'snapshot_id': '11cfbbc9-7d89-4373-a84f-2c38ffba4839'} Jul 30 17:02:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-73c58102-9247-4849-b48b-4448d41912c1 tempest-VolumesSnapshotTestJSON-1775603194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-73c58102-9247-4849-b48b-4448d41912c1 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:02 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-73c58102-9247-4849-b48b-4448d41912c1 tempest-VolumesSnapshotTestJSON-1775603194 None] Acquiring lock "cinder-quobyte-11cfbbc9-7d89-4373-a84f-2c38ffba4839-15c53062-51f0-47e8-8758-e0e35f2eeb38" by "_create_volume_from_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:02 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-73c58102-9247-4849-b48b-4448d41912c1 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "cinder-quobyte-11cfbbc9-7d89-4373-a84f-2c38ffba4839-15c53062-51f0-47e8-8758-e0e35f2eeb38" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:02 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-73c58102-9247-4849-b48b-4448d41912c1 tempest-VolumesSnapshotTestJSON-1775603194 None] Creating volume 15c53062-51f0-47e8-8758-e0e35f2eeb38 from snapshot 11cfbbc9-7d89-4373-a84f-2c38ffba4839 {{(pid=88591) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 30 17:02:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-73c58102-9247-4849-b48b-4448d41912c1 tempest-VolumesSnapshotTestJSON-1775603194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-73c58102-9247-4849-b48b-4448d41912c1 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:02 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-73c58102-9247-4849-b48b-4448d41912c1 tempest-VolumesSnapshotTestJSON-1775603194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:02:02 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-73c58102-9247-4849-b48b-4448d41912c1 tempest-VolumesSnapshotTestJSON-1775603194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:02:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-73c58102-9247-4849-b48b-4448d41912c1 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:02 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-73c58102-9247-4849-b48b-4448d41912c1 tempest-VolumesSnapshotTestJSON-1775603194 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:02:02 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-73c58102-9247-4849-b48b-4448d41912c1 tempest-VolumesSnapshotTestJSON-1775603194 None] Acquiring lock "cinder-quobyte-15c53062-51f0-47e8-8758-e0e35f2eeb38" by "_copy_volume_from_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:02 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b21c3a5-cde5-40b1-a207-3c47b0f07a49]: (4, 'raw') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d065ec06-3879-4539-b706-ace3f5af77ca_wbd93_khdevstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:02 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-73c58102-9247-4849-b48b-4448d41912c1 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "cinder-quobyte-15c53062-51f0-47e8-8758-e0e35f2eeb38" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:02 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-73c58102-9247-4849-b48b-4448d41912c1 tempest-VolumesSnapshotTestJSON-1775603194 None] snapshot: 11cfbbc9-7d89-4373-a84f-2c38ffba4839, volume: 15c53062-51f0-47e8-8758-e0e35f2eeb38, {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 17:02:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-73c58102-9247-4849-b48b-4448d41912c1 tempest-VolumesSnapshotTestJSON-1775603194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-73c58102-9247-4849-b48b-4448d41912c1 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:02 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-73c58102-9247-4849-b48b-4448d41912c1 tempest-VolumesSnapshotTestJSON-1775603194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:02:02 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-73c58102-9247-4849-b48b-4448d41912c1 tempest-VolumesSnapshotTestJSON-1775603194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:02:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-73c58102-9247-4849-b48b-4448d41912c1 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:02 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[007dcfe6-df95-4f1f-958f-25c629860607]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-73c58102-9247-4849-b48b-4448d41912c1 tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c790660-85aa-4348-8154-cc34d1ac3999.11cfbbc9-7d89-4373-a84f-2c38ffba4839 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:02 devstack sudo[102063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d065ec06-3879-4539-b706-ace3f5af77ca_wbd93_khdevstack@QuobyteHD Jul 30 17:02:02 devstack sudo[102063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:03 devstack sudo[102064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c790660-85aa-4348-8154-cc34d1ac3999.11cfbbc9-7d89-4373-a84f-2c38ffba4839 Jul 30 17:02:03 devstack sudo[102064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:03 devstack sudo[102063]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d065ec06-3879-4539-b706-ace3f5af77ca_wbd93_khdevstack@QuobyteHD" returned: 0 in 0.360s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d065ec06-3879-4539-b706-ace3f5af77ca_wbd93_khdevstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:03 devstack sudo[102064]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-73c58102-9247-4849-b48b-4448d41912c1 tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c790660-85aa-4348-8154-cc34d1ac3999.11cfbbc9-7d89-4373-a84f-2c38ffba4839" returned: 0 in 0.391s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:03 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-73c58102-9247-4849-b48b-4448d41912c1 tempest-VolumesSnapshotTestJSON-1775603194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c790660-85aa-4348-8154-cc34d1ac3999(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:02:03 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8514cd-0b3e-497d-b805-4a721ccc62df]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-73c58102-9247-4849-b48b-4448d41912c1 tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c790660-85aa-4348-8154-cc34d1ac3999 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:03 devstack sudo[102069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d065ec06-3879-4539-b706-ace3f5af77ca_wbd93_khdevstack@QuobyteHD Jul 30 17:02:03 devstack sudo[102069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:03 devstack sudo[102073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c790660-85aa-4348-8154-cc34d1ac3999 Jul 30 17:02:03 devstack sudo[102073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:03 devstack sudo[102069]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d065ec06-3879-4539-b706-ace3f5af77ca_wbd93_khdevstack@QuobyteHD" returned: 1 in 0.376s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d065ec06-3879-4539-b706-ace3f5af77ca_wbd93_khdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 17:02:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:03 devstack sudo[102073]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-73c58102-9247-4849-b48b-4448d41912c1 tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c790660-85aa-4348-8154-cc34d1ac3999" returned: 0 in 0.442s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:03 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-73c58102-9247-4849-b48b-4448d41912c1 tempest-VolumesSnapshotTestJSON-1775603194 None] will copy from snapshot at /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c790660-85aa-4348-8154-cc34d1ac3999 {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 17:02:03 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-73c58102-9247-4849-b48b-4448d41912c1 tempest-VolumesSnapshotTestJSON-1775603194 None] Creating direct copy from snapshot {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 17:02:03 devstack cinder-volume[88591]: DEBUG cinder.utils [None req-73c58102-9247-4849-b48b-4448d41912c1 tempest-VolumesSnapshotTestJSON-1775603194 None] Path /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-15c53062-51f0-47e8-8758-e0e35f2eeb38 not found in is_blk_device check {{(pid=88591) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 17:02:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-73c58102-9247-4849-b48b-4448d41912c1 tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c790660-85aa-4348-8154-cc34d1ac3999 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-15c53062-51f0-47e8-8758-e0e35f2eeb38 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:03 devstack sudo[102082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c790660-85aa-4348-8154-cc34d1ac3999 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-15c53062-51f0-47e8-8758-e0e35f2eeb38 Jul 30 17:02:03 devstack sudo[102082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:03 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:02:03 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] Flow 'volume_create_manager' (15bf7bfc-c964-47a0-b139-df7967824675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:02:03 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed9d2c02-d953-4ea9-8ac8-eaf072f7e8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:03 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed9d2c02-d953-4ea9-8ac8-eaf072f7e8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1907854707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87db68b6-80c0-4680-a3ad-2f606748b9f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='276004d5c1f2469b92e64704fd287ae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:02:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c,status='creating',terminated_at=None,updated_at=2026-07-30T15:02:04Z,use_quota=True,user_id='96a8f40652fe43728a70f6987cbf3adb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:03 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bb5a78d-addd-4d1c-8dd3-df2b4d04ef3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:03 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bb5a78d-addd-4d1c-8dd3-df2b4d04ef3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:03 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b54be22-91c0-426a-9d0c-6f7c5c144dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:03 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b54be22-91c0-426a-9d0c-6f7c5c144dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '87db68b6-80c0-4680-a3ad-2f606748b9f7', 'volume_name': 'volume-87db68b6-80c0-4680-a3ad-2f606748b9f7', 'volume_size': 2, 'source_volid': '3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c', 'source_volstatus': 'available'}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:03 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4365967b-5667-45da-96cc-a82c1a5ffca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:03 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4365967b-5667-45da-96cc-a82c1a5ffca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:03 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87bfc8be-5413-4d9a-be3d-52c4b713c5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:03 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] Volume 87db68b6-80c0-4680-a3ad-2f606748b9f7: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-87db68b6-80c0-4680-a3ad-2f606748b9f7', 'volume_size': 2, 'source_volid': '3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c', 'source_volstatus': 'available'} Jul 30 17:02:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:07 devstack sudo[102082]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-73c58102-9247-4849-b48b-4448d41912c1 tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c790660-85aa-4348-8154-cc34d1ac3999 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-15c53062-51f0-47e8-8758-e0e35f2eeb38" returned: 0 in 4.170s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:07 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-73c58102-9247-4849-b48b-4448d41912c1 tempest-VolumesSnapshotTestJSON-1775603194 None] Image conversion details: src /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c790660-85aa-4348-8154-cc34d1ac3999, size 1024.00 MB, duration 4.17 sec, destination /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-15c53062-51f0-47e8-8758-e0e35f2eeb38 {{(pid=88591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 17:02:07 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-73c58102-9247-4849-b48b-4448d41912c1 tempest-VolumesSnapshotTestJSON-1775603194 None] Converted 1024.00 MB image at 245.50 MB/s Jul 30 17:02:07 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-73c58102-9247-4849-b48b-4448d41912c1 tempest-VolumesSnapshotTestJSON-1775603194 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-15c53062-51f0-47e8-8758-e0e35f2eeb38 is being set with open permissions: ugo+rw Jul 30 17:02:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-73c58102-9247-4849-b48b-4448d41912c1 tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-15c53062-51f0-47e8-8758-e0e35f2eeb38 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:07 devstack sudo[102094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-15c53062-51f0-47e8-8758-e0e35f2eeb38 Jul 30 17:02:07 devstack sudo[102094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:08 devstack sudo[102094]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-73c58102-9247-4849-b48b-4448d41912c1 tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-15c53062-51f0-47e8-8758-e0e35f2eeb38" returned: 0 in 0.251s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:08 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-73c58102-9247-4849-b48b-4448d41912c1 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "cinder-quobyte-15c53062-51f0-47e8-8758-e0e35f2eeb38" released by "_copy_volume_from_snapshot" :: held 5.342s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:08 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-73c58102-9247-4849-b48b-4448d41912c1 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "cinder-quobyte-11cfbbc9-7d89-4373-a84f-2c38ffba4839-15c53062-51f0-47e8-8758-e0e35f2eeb38" released by "_create_volume_from_snapshot" :: held 5.422s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-73c58102-9247-4849-b48b-4448d41912c1 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.446s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.659s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:08 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:02:01Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99ba024c-ed54-4872-a429-5efb4e78020a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='229d5719b07743b1910c471c634eb39b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:02:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:02:01Z,use_quota=True,user_id='415b4456c46840dfb1ca008ccfae6cb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e81fe8b9-ab7e-4df5-9797-fe3e84ef831d),volume_type_id=e81fe8b9-ab7e-4df5-9797-fe3e84ef831d)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:02:08 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Creating volume 99ba024c-ed54-4872-a429-5efb4e78020a {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:02:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:08 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:02:08 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:02:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:08 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:02:08 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:02:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-99ba024c-ed54-4872-a429-5efb4e78020a 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:08 devstack sudo[102097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-99ba024c-ed54-4872-a429-5efb4e78020a 1073741824 Jul 30 17:02:08 devstack sudo[102097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:08 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-73c58102-9247-4849-b48b-4448d41912c1 tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6df9ab5-474a-4e67-aa44-9745d1335b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15c53062-51f0-47e8-8758-e0e35f2eeb38', 'volume_size': 2, 'snapshot_id': '11cfbbc9-7d89-4373-a84f-2c38ffba4839'}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:08 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-73c58102-9247-4849-b48b-4448d41912c1 tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f8ffa07-c4c5-4898-a13c-a771488f139d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:08 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-73c58102-9247-4849-b48b-4448d41912c1 tempest-VolumesSnapshotTestJSON-1775603194 None] Volume volume-15c53062-51f0-47e8-8758-e0e35f2eeb38 (15c53062-51f0-47e8-8758-e0e35f2eeb38): created successfully Jul 30 17:02:08 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-73c58102-9247-4849-b48b-4448d41912c1 tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f8ffa07-c4c5-4898-a13c-a771488f139d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:08 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-73c58102-9247-4849-b48b-4448d41912c1 tempest-VolumesSnapshotTestJSON-1775603194 None] Flow 'volume_create_manager' (a66130b7-f651-4323-96c1-fbbb9de5ef89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:02:08 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-73c58102-9247-4849-b48b-4448d41912c1 tempest-VolumesSnapshotTestJSON-1775603194 None] Created volume successfully. Jul 30 17:02:08 devstack sudo[102097]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-99ba024c-ed54-4872-a429-5efb4e78020a 1073741824" returned: 0 in 0.408s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-99ba024c-ed54-4872-a429-5efb4e78020a {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:08 devstack sudo[102102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-99ba024c-ed54-4872-a429-5efb4e78020a Jul 30 17:02:08 devstack sudo[102102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:08 devstack sudo[102102]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-99ba024c-ed54-4872-a429-5efb4e78020a" returned: 0 in 0.256s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:08 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:02:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 4.987s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:08 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] Cloning volume 3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c to volume 87db68b6-80c0-4680-a3ad-2f606748b9f7 Jul 30 17:02:08 devstack cinder-volume[88591]: DEBUG cinder.volume.volume_utils [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Attempting download of d065ec06-3879-4539-b706-ace3f5af77ca ((None, [{'url': 'file:///opt/stack/data/glance/images/d065ec06-3879-4539-b706-ace3f5af77ca', 'metadata': {}}])) to volume 99ba024c-ed54-4872-a429-5efb4e78020a. {{(pid=88591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 30 17:02:08 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] Creating offline snapshot ba1431bf-08f6-484a-98dd-0c7218625c59 of volume 3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:02:09 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[47bb350b-d205-4158-a2d3-d7ed70c7c45a]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:09 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[2949dd56-c0a2-4f61-8462-c3f5c33a103d]: (4, 'raw') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d065ec06-3879-4539-b706-ace3f5af77ca_2yzpmrzb {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:09 devstack sudo[102105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c Jul 30 17:02:09 devstack sudo[102105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:09 devstack sudo[102106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d065ec06-3879-4539-b706-ace3f5af77ca_2yzpmrzb Jul 30 17:02:09 devstack sudo[102106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:09 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-deacfa3b-ec1d-4fb1-ac0d-892580415f2d tempest-VolumesSnapshotTestJSON-1775603194 None] Acquiring lock "cinder-15c53062-51f0-47e8-8758-e0e35f2eeb38-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:09 devstack sudo[102106]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d065ec06-3879-4539-b706-ace3f5af77ca_2yzpmrzb" returned: 0 in 0.358s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d065ec06-3879-4539-b706-ace3f5af77ca_2yzpmrzb {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:09 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-deacfa3b-ec1d-4fb1-ac0d-892580415f2d tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "cinder-15c53062-51f0-47e8-8758-e0e35f2eeb38-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:09 devstack sudo[102105]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c" returned: 0 in 0.424s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c.ba1431bf-08f6-484a-98dd-0c7218625c59 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:09 devstack sudo[102115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c.ba1431bf-08f6-484a-98dd-0c7218625c59 1G Jul 30 17:02:09 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-deacfa3b-ec1d-4fb1-ac0d-892580415f2d tempest-VolumesSnapshotTestJSON-1775603194 None] Acquiring lock "cinder-quobyte-15c53062-51f0-47e8-8758-e0e35f2eeb38" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:09 devstack sudo[102115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:09 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-deacfa3b-ec1d-4fb1-ac0d-892580415f2d tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "cinder-quobyte-15c53062-51f0-47e8-8758-e0e35f2eeb38" acquired by "delete_volume" :: waited 0.020s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:09 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58f7bd0-3f58-4f6a-9fe0-1d21e07b3400]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-deacfa3b-ec1d-4fb1-ac0d-892580415f2d tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-15c53062-51f0-47e8-8758-e0e35f2eeb38 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:09 devstack sudo[102114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d065ec06-3879-4539-b706-ace3f5af77ca_2yzpmrzb Jul 30 17:02:09 devstack sudo[102114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:09 devstack sudo[102117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-15c53062-51f0-47e8-8758-e0e35f2eeb38 Jul 30 17:02:09 devstack sudo[102117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:09 devstack sudo[102114]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d065ec06-3879-4539-b706-ace3f5af77ca_2yzpmrzb" returned: 1 in 0.361s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d065ec06-3879-4539-b706-ace3f5af77ca_2yzpmrzb' failed. Not Retrying. {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 17:02:09 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35f4240-b3eb-4462-94f4-1816b2047538]: (4, 'raw') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d065ec06-3879-4539-b706-ace3f5af77ca_wbd93_khdevstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:09 devstack sudo[102115]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c.ba1431bf-08f6-484a-98dd-0c7218625c59 1G" returned: 0 in 0.425s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c.ba1431bf-08f6-484a-98dd-0c7218625c59 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:09 devstack sudo[102125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d065ec06-3879-4539-b706-ace3f5af77ca_wbd93_khdevstack@QuobyteHD Jul 30 17:02:09 devstack sudo[102125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:09 devstack sudo[102129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c.ba1431bf-08f6-484a-98dd-0c7218625c59 Jul 30 17:02:09 devstack sudo[102129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:09 devstack sudo[102117]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-deacfa3b-ec1d-4fb1-ac0d-892580415f2d tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-15c53062-51f0-47e8-8758-e0e35f2eeb38" returned: 0 in 0.398s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-deacfa3b-ec1d-4fb1-ac0d-892580415f2d tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-15c53062-51f0-47e8-8758-e0e35f2eeb38 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:09 devstack sudo[102132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-15c53062-51f0-47e8-8758-e0e35f2eeb38 Jul 30 17:02:09 devstack sudo[102132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:10 devstack sudo[102125]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d065ec06-3879-4539-b706-ace3f5af77ca_wbd93_khdevstack@QuobyteHD" returned: 0 in 0.346s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d065ec06-3879-4539-b706-ace3f5af77ca_wbd93_khdevstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:10 devstack sudo[102129]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c.ba1431bf-08f6-484a-98dd-0c7218625c59" returned: 0 in 0.327s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:10 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c.ba1431bf-08f6-484a-98dd-0c7218625c59 is being set with open permissions: ugo+rw Jul 30 17:02:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c.ba1431bf-08f6-484a-98dd-0c7218625c59 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:10 devstack sudo[102132]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-deacfa3b-ec1d-4fb1-ac0d-892580415f2d tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-15c53062-51f0-47e8-8758-e0e35f2eeb38" returned: 0 in 0.287s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:10 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-deacfa3b-ec1d-4fb1-ac0d-892580415f2d tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "cinder-quobyte-15c53062-51f0-47e8-8758-e0e35f2eeb38" released by "delete_volume" :: held 0.738s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:10 devstack sudo[102142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c.ba1431bf-08f6-484a-98dd-0c7218625c59 Jul 30 17:02:10 devstack sudo[102142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:10 devstack sudo[102139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d065ec06-3879-4539-b706-ace3f5af77ca_wbd93_khdevstack@QuobyteHD Jul 30 17:02:10 devstack sudo[102139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:10 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-deacfa3b-ec1d-4fb1-ac0d-892580415f2d tempest-VolumesSnapshotTestJSON-1775603194 None] Created reservations ['e7c3fb12-c0dd-42f2-b39f-d3fc19a231f6', 'a0f59181-bb99-4ade-98a1-6850161d9c74', '79938d31-168b-46c4-9d11-7a458a8ca56a', '6ed28c01-60dc-44d9-a31d-0d2444aa3a9a'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:02:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-deacfa3b-ec1d-4fb1-ac0d-892580415f2d tempest-VolumesSnapshotTestJSON-1775603194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-deacfa3b-ec1d-4fb1-ac0d-892580415f2d tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:10 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-deacfa3b-ec1d-4fb1-ac0d-892580415f2d tempest-VolumesSnapshotTestJSON-1775603194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:02:10 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-deacfa3b-ec1d-4fb1-ac0d-892580415f2d tempest-VolumesSnapshotTestJSON-1775603194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:02:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-deacfa3b-ec1d-4fb1-ac0d-892580415f2d tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-deacfa3b-ec1d-4fb1-ac0d-892580415f2d tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:10 devstack sudo[102145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:02:10 devstack sudo[102145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:10 devstack sudo[102139]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:10 devstack sudo[102142]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c.ba1431bf-08f6-484a-98dd-0c7218625c59" returned: 0 in 0.287s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d065ec06-3879-4539-b706-ace3f5af77ca_wbd93_khdevstack@QuobyteHD" returned: 1 in 0.374s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d065ec06-3879-4539-b706-ace3f5af77ca_wbd93_khdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 17:02:10 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] d065ec06-3879-4539-b706-ace3f5af77ca was raw, converting to qcow2 {{(pid=88591) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 30 17:02:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d065ec06-3879-4539-b706-ace3f5af77ca_wbd93_khdevstack@QuobyteHD /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-99ba024c-ed54-4872-a429-5efb4e78020a {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:10 devstack sudo[102151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d065ec06-3879-4539-b706-ace3f5af77ca_wbd93_khdevstack@QuobyteHD /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-99ba024c-ed54-4872-a429-5efb4e78020a Jul 30 17:02:10 devstack sudo[102151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:10 devstack sudo[102153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c.info Jul 30 17:02:10 devstack sudo[102153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:10 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-18f383c9-7eb9-4090-a159-501152dde361 tempest-VolumesSnapshotTestJSON-1775603194 None] Acquiring lock "cinder-11cfbbc9-7d89-4373-a84f-2c38ffba4839-delete_snapshot" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:10 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-18f383c9-7eb9-4090-a159-501152dde361 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "cinder-11cfbbc9-7d89-4373-a84f-2c38ffba4839-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:10 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-18f383c9-7eb9-4090-a159-501152dde361 tempest-VolumesSnapshotTestJSON-1775603194 None] Acquiring lock "cinder-quobyte-8c790660-85aa-4348-8154-cc34d1ac3999" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:10 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-18f383c9-7eb9-4090-a159-501152dde361 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "cinder-quobyte-8c790660-85aa-4348-8154-cc34d1ac3999" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:10 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-18f383c9-7eb9-4090-a159-501152dde361 tempest-VolumesSnapshotTestJSON-1775603194 None] Acquiring lock "cinder-quobyte-11cfbbc9-7d89-4373-a84f-2c38ffba4839" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:10 devstack sudo[102145]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-deacfa3b-ec1d-4fb1-ac0d-892580415f2d tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.304s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:10 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-deacfa3b-ec1d-4fb1-ac0d-892580415f2d tempest-VolumesSnapshotTestJSON-1775603194 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:02:10 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-18f383c9-7eb9-4090-a159-501152dde361 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "cinder-quobyte-11cfbbc9-7d89-4373-a84f-2c38ffba4839" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:10 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-18f383c9-7eb9-4090-a159-501152dde361 tempest-VolumesSnapshotTestJSON-1775603194 None] Deleting offline snapshot 11cfbbc9-7d89-4373-a84f-2c38ffba4839 of volume 8c790660-85aa-4348-8154-cc34d1ac3999 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:02:10 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-18f383c9-7eb9-4090-a159-501152dde361 tempest-VolumesSnapshotTestJSON-1775603194 None] snapshot_file for this snap is: volume-8c790660-85aa-4348-8154-cc34d1ac3999.11cfbbc9-7d89-4373-a84f-2c38ffba4839 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:02:10 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-deacfa3b-ec1d-4fb1-ac0d-892580415f2d tempest-VolumesSnapshotTestJSON-1775603194 None] Deleted volume successfully. Jul 30 17:02:10 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac725fe-0743-4991-ae7d-29a61ab07f42]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-18f383c9-7eb9-4090-a159-501152dde361 tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c790660-85aa-4348-8154-cc34d1ac3999.11cfbbc9-7d89-4373-a84f-2c38ffba4839 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:10 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-deacfa3b-ec1d-4fb1-ac0d-892580415f2d tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "cinder-15c53062-51f0-47e8-8758-e0e35f2eeb38-delete_volume" released by "delete_volume" :: held 1.338s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:10 devstack sudo[102157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c790660-85aa-4348-8154-cc34d1ac3999.11cfbbc9-7d89-4373-a84f-2c38ffba4839 Jul 30 17:02:10 devstack sudo[102157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:10 devstack sudo[102153]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c.info" returned: 0 in 0.350s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:10 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c.info is being set with open permissions: ugo+rw Jul 30 17:02:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:10 devstack sudo[102162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c.info Jul 30 17:02:10 devstack sudo[102162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:11 devstack sudo[102151]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d065ec06-3879-4539-b706-ace3f5af77ca_wbd93_khdevstack@QuobyteHD /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-99ba024c-ed54-4872-a429-5efb4e78020a" returned: 0 in 0.529s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:11 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d065ec06-3879-4539-b706-ace3f5af77ca_wbd93_khdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-99ba024c-ed54-4872-a429-5efb4e78020a {{(pid=88591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 17:02:11 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Converted 0.00 MB image at 0.00 MB/s Jul 30 17:02:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-99ba024c-ed54-4872-a429-5efb4e78020a 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:11 devstack sudo[102164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-99ba024c-ed54-4872-a429-5efb4e78020a 1G Jul 30 17:02:11 devstack sudo[102164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:11 devstack sudo[102157]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-18f383c9-7eb9-4090-a159-501152dde361 tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c790660-85aa-4348-8154-cc34d1ac3999.11cfbbc9-7d89-4373-a84f-2c38ffba4839" returned: 0 in 0.431s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:11 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-18f383c9-7eb9-4090-a159-501152dde361 tempest-VolumesSnapshotTestJSON-1775603194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c790660-85aa-4348-8154-cc34d1ac3999(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:02:11 devstack sudo[102162]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c.info" returned: 0 in 0.290s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:11 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] Acquiring lock "cinder-quobyte-87db68b6-80c0-4680-a3ad-2f606748b9f7" by "_copy_volume_from_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:11 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3c308e-cbc9-4114-bb4c-ada1f480caa0]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-18f383c9-7eb9-4090-a159-501152dde361 tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c790660-85aa-4348-8154-cc34d1ac3999 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:11 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] Lock "cinder-quobyte-87db68b6-80c0-4680-a3ad-2f606748b9f7" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:11 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] snapshot: ba1431bf-08f6-484a-98dd-0c7218625c59, volume: 87db68b6-80c0-4680-a3ad-2f606748b9f7, {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 17:02:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:11 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:02:11 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:02:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:11 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7450c2-3664-4993-bc00-c3264d8af5e6]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c.ba1431bf-08f6-484a-98dd-0c7218625c59 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:11 devstack sudo[102170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c790660-85aa-4348-8154-cc34d1ac3999 Jul 30 17:02:11 devstack sudo[102170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:11 devstack sudo[102164]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-99ba024c-ed54-4872-a429-5efb4e78020a 1G" returned: 0 in 0.339s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:11 devstack cinder-volume[88591]: DEBUG cinder.volume.volume_utils [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Downloaded image d065ec06-3879-4539-b706-ace3f5af77ca ((None, [{'url': 'file:///opt/stack/data/glance/images/d065ec06-3879-4539-b706-ace3f5af77ca', 'metadata': {}}])) to volume 99ba024c-ed54-4872-a429-5efb4e78020a successfully. {{(pid=88591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 30 17:02:11 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Temporary image d065ec06-3879-4539-b706-ace3f5af77ca for user 415b4456c46840dfb1ca008ccfae6cb3 is deleted. {{(pid=88591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 30 17:02:11 devstack cinder-volume[88591]: DEBUG cinder.volume.volume_utils [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Marking volume 99ba024c-ed54-4872-a429-5efb4e78020a as bootable. {{(pid=88591) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 30 17:02:11 devstack sudo[102172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c.ba1431bf-08f6-484a-98dd-0c7218625c59 Jul 30 17:02:11 devstack sudo[102172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:11 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Copying metadata from image d065ec06-3879-4539-b706-ace3f5af77ca to 99ba024c-ed54-4872-a429-5efb4e78020a. {{(pid=88591) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 30 17:02:11 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Creating volume glance metadata for volume 99ba024c-ed54-4872-a429-5efb4e78020a backed by image d065ec06-3879-4539-b706-ace3f5af77ca with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'd065ec06-3879-4539-b706-ace3f5af77ca', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '30d3568b8c3f8514d4f3cf0c77701cf6', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88591) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 30 17:02:11 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb296a99-b855-48f3-af45-fb2bf3bc04f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99ba024c-ed54-4872-a429-5efb4e78020a', 'volume_size': 1, 'image_id': 'd065ec06-3879-4539-b706-ace3f5af77ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d065ec06-3879-4539-b706-ace3f5af77ca', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '30d3568b8c3f8514d4f3cf0c77701cf6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '229d5719b07743b1910c471c634eb39b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f5c72122c3a82eab6f12f93328cec1baec49884cc68d1551c0bf68a77a24ab5d76e31b84d0931da71b2ffd6f3772603ada8fcbd869d9d518a143cc28d78470bb', 'id': 'd065ec06-3879-4539-b706-ace3f5af77ca', 'created_at': datetime.datetime(2026, 7, 30, 15, 1, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 15, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d065ec06-3879-4539-b706-ace3f5af77ca/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:11 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5c9b16c-a9ac-4a95-9534-e5f58495a778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:11 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Volume volume-99ba024c-ed54-4872-a429-5efb4e78020a (99ba024c-ed54-4872-a429-5efb4e78020a): created successfully Jul 30 17:02:11 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5c9b16c-a9ac-4a95-9534-e5f58495a778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:11 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Flow 'volume_create_manager' (95e103d3-8807-4d7e-8cb8-11ee16f1961f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:02:11 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-fddd8631-9568-42a0-b2b1-acc587d6d9ae tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Created volume successfully. Jul 30 17:02:11 devstack sudo[102172]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c.ba1431bf-08f6-484a-98dd-0c7218625c59" returned: 0 in 0.399s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:11 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:02:11 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2a945d-cfc1-44b4-b2d2-cd12fb274d00]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:11 devstack sudo[102182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c Jul 30 17:02:11 devstack sudo[102182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:11 devstack sudo[102170]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-18f383c9-7eb9-4090-a159-501152dde361 tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c790660-85aa-4348-8154-cc34d1ac3999" returned: 0 in 0.620s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-18f383c9-7eb9-4090-a159-501152dde361 tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c790660-85aa-4348-8154-cc34d1ac3999.11cfbbc9-7d89-4373-a84f-2c38ffba4839 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:11 devstack sudo[102185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c790660-85aa-4348-8154-cc34d1ac3999.11cfbbc9-7d89-4373-a84f-2c38ffba4839 Jul 30 17:02:11 devstack sudo[102185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:12 devstack sudo[102182]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c" returned: 0 in 0.373s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] will copy from snapshot at /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 17:02:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] Creating direct copy from snapshot {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 17:02:12 devstack cinder-volume[88591]: DEBUG cinder.utils [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] Path /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-87db68b6-80c0-4680-a3ad-2f606748b9f7 not found in is_blk_device check {{(pid=88591) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 17:02:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-87db68b6-80c0-4680-a3ad-2f606748b9f7 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:12 devstack sudo[102192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-87db68b6-80c0-4680-a3ad-2f606748b9f7 Jul 30 17:02:12 devstack sudo[102192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:12 devstack sudo[102185]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-18f383c9-7eb9-4090-a159-501152dde361 tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c790660-85aa-4348-8154-cc34d1ac3999.11cfbbc9-7d89-4373-a84f-2c38ffba4839" returned: 0 in 0.352s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-18f383c9-7eb9-4090-a159-501152dde361 tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c790660-85aa-4348-8154-cc34d1ac3999.11cfbbc9-7d89-4373-a84f-2c38ffba4839 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:12 devstack sudo[102196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c790660-85aa-4348-8154-cc34d1ac3999.11cfbbc9-7d89-4373-a84f-2c38ffba4839 Jul 30 17:02:12 devstack sudo[102196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:12 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9e807613-fceb-4214-b3fd-ef77bcadfb11 tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Acquiring lock "cinder-99ba024c-ed54-4872-a429-5efb4e78020a-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:12 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9e807613-fceb-4214-b3fd-ef77bcadfb11 tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Lock "cinder-99ba024c-ed54-4872-a429-5efb4e78020a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:12 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9e807613-fceb-4214-b3fd-ef77bcadfb11 tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Acquiring lock "cinder-quobyte-99ba024c-ed54-4872-a429-5efb4e78020a" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:12 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9e807613-fceb-4214-b3fd-ef77bcadfb11 tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Lock "cinder-quobyte-99ba024c-ed54-4872-a429-5efb4e78020a" acquired by "delete_volume" :: waited 0.017s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:12 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d34280-fa04-41d7-9ba4-e10607d6acb5]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9e807613-fceb-4214-b3fd-ef77bcadfb11 tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-99ba024c-ed54-4872-a429-5efb4e78020a {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:12 devstack sudo[102196]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-18f383c9-7eb9-4090-a159-501152dde361 tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c790660-85aa-4348-8154-cc34d1ac3999.11cfbbc9-7d89-4373-a84f-2c38ffba4839" returned: 0 in 0.297s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:12 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-18f383c9-7eb9-4090-a159-501152dde361 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "cinder-quobyte-11cfbbc9-7d89-4373-a84f-2c38ffba4839" released by "_delete_snapshot" :: held 1.837s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:12 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-18f383c9-7eb9-4090-a159-501152dde361 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "cinder-quobyte-8c790660-85aa-4348-8154-cc34d1ac3999" released by "delete_snapshot" :: held 1.869s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:12 devstack sudo[102202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-99ba024c-ed54-4872-a429-5efb4e78020a Jul 30 17:02:12 devstack sudo[102202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:12 devstack cinder-volume[88591]: DEBUG oslo_service.periodic_task [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 17:02:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:02:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:02:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:12 devstack sudo[102206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:02:12 devstack sudo[102206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:12 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-18f383c9-7eb9-4090-a159-501152dde361 tempest-VolumesSnapshotTestJSON-1775603194 None] Created reservations ['e0263872-0f76-4fe6-a8bb-768092fcd933', 'cfa1d57f-dcf7-41dc-b32f-ddcc1f63b250', '0b3c7b22-615d-4c14-bfa0-5cb8722ee0fa', '1fa74fa8-4996-45fe-946c-26cd32ab50ff'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:02:12 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-18f383c9-7eb9-4090-a159-501152dde361 tempest-VolumesSnapshotTestJSON-1775603194 None] Delete snapshot completed successfully. Jul 30 17:02:12 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-18f383c9-7eb9-4090-a159-501152dde361 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "cinder-11cfbbc9-7d89-4373-a84f-2c38ffba4839-delete_snapshot" released by "delete_snapshot" :: held 2.100s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:12 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-0ef21102-826d-48b7-85b0-f18a46de560f tempest-VolumesSnapshotTestJSON-1775603194 None] Acquiring lock "cinder-8c790660-85aa-4348-8154-cc34d1ac3999-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:13 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-0ef21102-826d-48b7-85b0-f18a46de560f tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "cinder-8c790660-85aa-4348-8154-cc34d1ac3999-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:13 devstack sudo[102202]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9e807613-fceb-4214-b3fd-ef77bcadfb11 tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-99ba024c-ed54-4872-a429-5efb4e78020a" returned: 0 in 0.690s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9e807613-fceb-4214-b3fd-ef77bcadfb11 tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-99ba024c-ed54-4872-a429-5efb4e78020a {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:13 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-0ef21102-826d-48b7-85b0-f18a46de560f tempest-VolumesSnapshotTestJSON-1775603194 None] Acquiring lock "cinder-quobyte-8c790660-85aa-4348-8154-cc34d1ac3999" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:13 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-0ef21102-826d-48b7-85b0-f18a46de560f tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "cinder-quobyte-8c790660-85aa-4348-8154-cc34d1ac3999" acquired by "delete_volume" :: waited 0.060s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:13 devstack sudo[102216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-99ba024c-ed54-4872-a429-5efb4e78020a Jul 30 17:02:13 devstack sudo[102216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:13 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b490f4-17f0-4dfd-8214-597750b4d55f]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0ef21102-826d-48b7-85b0-f18a46de560f tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c790660-85aa-4348-8154-cc34d1ac3999 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:13 devstack sudo[102206]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 1.064s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:13 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:02:13 devstack cinder-volume[88591]: DEBUG oslo_service.periodic_task [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running periodic task VolumeManager._thread_info {{(pid=88591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 17:02:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] thread count: 28 {{(pid=88591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 17:02:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] thread info: [<_MainThread(MainThread, started 140677178003584)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 17:02:13 devstack sudo[102216]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9e807613-fceb-4214-b3fd-ef77bcadfb11 tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-99ba024c-ed54-4872-a429-5efb4e78020a" returned: 0 in 0.595s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:13 devstack sudo[102219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c790660-85aa-4348-8154-cc34d1ac3999 Jul 30 17:02:13 devstack sudo[102219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:13 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9e807613-fceb-4214-b3fd-ef77bcadfb11 tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Lock "cinder-quobyte-99ba024c-ed54-4872-a429-5efb4e78020a" released by "delete_volume" :: held 1.341s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:13 devstack cinder-volume[88591]: WARNING cinder.quota [None req-9e807613-fceb-4214-b3fd-ef77bcadfb11 tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 30 17:02:13 devstack cinder-volume[88591]: WARNING cinder.quota [None req-9e807613-fceb-4214-b3fd-ef77bcadfb11 tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 30 17:02:13 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-9e807613-fceb-4214-b3fd-ef77bcadfb11 tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Created reservations ['913dfe31-546e-45c2-9709-a2ae44799e4c', 'bb7b6e1b-bc53-4f91-872c-a52c99543201', 'ad8a3248-a1e9-490a-b99d-6972af568a3e', '2196630b-433c-4b51-8242-ab2dc58062b4'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:02:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-9e807613-fceb-4214-b3fd-ef77bcadfb11 tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-9e807613-fceb-4214-b3fd-ef77bcadfb11 tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:14 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-9e807613-fceb-4214-b3fd-ef77bcadfb11 tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:02:14 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-9e807613-fceb-4214-b3fd-ef77bcadfb11 tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:02:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-9e807613-fceb-4214-b3fd-ef77bcadfb11 tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9e807613-fceb-4214-b3fd-ef77bcadfb11 tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:14 devstack sudo[102224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:02:14 devstack sudo[102224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:14 devstack sudo[102219]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0ef21102-826d-48b7-85b0-f18a46de560f tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c790660-85aa-4348-8154-cc34d1ac3999" returned: 0 in 1.099s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0ef21102-826d-48b7-85b0-f18a46de560f tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c790660-85aa-4348-8154-cc34d1ac3999 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:14 devstack sudo[102229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c790660-85aa-4348-8154-cc34d1ac3999 Jul 30 17:02:14 devstack sudo[102229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:14 devstack sudo[102224]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9e807613-fceb-4214-b3fd-ef77bcadfb11 tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.539s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:14 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-9e807613-fceb-4214-b3fd-ef77bcadfb11 tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:02:14 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-9e807613-fceb-4214-b3fd-ef77bcadfb11 tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Deleted volume successfully. Jul 30 17:02:14 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9e807613-fceb-4214-b3fd-ef77bcadfb11 tempest-VolumeAndVolumeTypeFromImageTest-485561827 None] Lock "cinder-99ba024c-ed54-4872-a429-5efb4e78020a-delete_volume" released by "delete_volume" :: held 2.490s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:14 devstack sudo[102229]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0ef21102-826d-48b7-85b0-f18a46de560f tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8c790660-85aa-4348-8154-cc34d1ac3999" returned: 0 in 0.505s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:15 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-0ef21102-826d-48b7-85b0-f18a46de560f tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "cinder-quobyte-8c790660-85aa-4348-8154-cc34d1ac3999" released by "delete_volume" :: held 1.789s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:15 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-0ef21102-826d-48b7-85b0-f18a46de560f tempest-VolumesSnapshotTestJSON-1775603194 None] Created reservations ['46b3067c-244d-47de-9be4-5bfba50fa786', '4d51bb97-807a-4f04-8c1b-7f4f8b046a7d', '3351eb8a-63ed-4007-ac95-39fb1bec05e6', 'db0af463-f075-4b35-a8f8-12249ae843e2'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:02:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0ef21102-826d-48b7-85b0-f18a46de560f tempest-VolumesSnapshotTestJSON-1775603194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0ef21102-826d-48b7-85b0-f18a46de560f tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:15 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-0ef21102-826d-48b7-85b0-f18a46de560f tempest-VolumesSnapshotTestJSON-1775603194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:02:15 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-0ef21102-826d-48b7-85b0-f18a46de560f tempest-VolumesSnapshotTestJSON-1775603194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:02:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0ef21102-826d-48b7-85b0-f18a46de560f tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0ef21102-826d-48b7-85b0-f18a46de560f tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:15 devstack sudo[102233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:02:15 devstack sudo[102233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:16 devstack sudo[102233]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:16 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0ef21102-826d-48b7-85b0-f18a46de560f tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.611s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:16 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-0ef21102-826d-48b7-85b0-f18a46de560f tempest-VolumesSnapshotTestJSON-1775603194 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:02:16 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-0ef21102-826d-48b7-85b0-f18a46de560f tempest-VolumesSnapshotTestJSON-1775603194 None] Deleted volume successfully. Jul 30 17:02:16 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-0ef21102-826d-48b7-85b0-f18a46de560f tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "cinder-8c790660-85aa-4348-8154-cc34d1ac3999-delete_volume" released by "delete_volume" :: held 3.187s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:16 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3cfd0d8-bcb8-4543-8220-e29d73718ff4 tempest-VolumesSnapshotTestJSON-1775603194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:02:16 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c3cfd0d8-bcb8-4543-8220-e29d73718ff4 tempest-VolumesSnapshotTestJSON-1775603194 None] Flow 'volume_create_manager' (3c2b171d-2a5e-469f-a75a-b88340bc5671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:02:16 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c3cfd0d8-bcb8-4543-8220-e29d73718ff4 tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28d6be99-3508-458a-aa36-5184067c65cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:16 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c3cfd0d8-bcb8-4543-8220-e29d73718ff4 tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28d6be99-3508-458a-aa36-5184067c65cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:02:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-485606746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76c218fa-b01f-4165-9253-32b6c272a4f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a620a5171f04124a32b2f4dee869ebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:02:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:02:17Z,use_quota=True,user_id='3b2780b32ed64c058aa90235823c0c74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:16 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c3cfd0d8-bcb8-4543-8220-e29d73718ff4 tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a75d68fa-7105-48e7-8079-06c272910e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:16 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c3cfd0d8-bcb8-4543-8220-e29d73718ff4 tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a75d68fa-7105-48e7-8079-06c272910e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:16 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c3cfd0d8-bcb8-4543-8220-e29d73718ff4 tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7a0e2c9-f7b7-4ef9-8982-e11cda0e299c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:16 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c3cfd0d8-bcb8-4543-8220-e29d73718ff4 tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7a0e2c9-f7b7-4ef9-8982-e11cda0e299c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76c218fa-b01f-4165-9253-32b6c272a4f8', 'volume_name': 'volume-76c218fa-b01f-4165-9253-32b6c272a4f8', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:16 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c3cfd0d8-bcb8-4543-8220-e29d73718ff4 tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc2f2051-e6a2-4d51-a47e-50f6e541b7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:16 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c3cfd0d8-bcb8-4543-8220-e29d73718ff4 tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc2f2051-e6a2-4d51-a47e-50f6e541b7dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:16 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c3cfd0d8-bcb8-4543-8220-e29d73718ff4 tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28b68058-2ed9-414e-9244-4d6ae4ae137a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:16 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-c3cfd0d8-bcb8-4543-8220-e29d73718ff4 tempest-VolumesSnapshotTestJSON-1775603194 None] Volume 76c218fa-b01f-4165-9253-32b6c272a4f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76c218fa-b01f-4165-9253-32b6c272a4f8', 'volume_size': 1} Jul 30 17:02:16 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c3cfd0d8-bcb8-4543-8220-e29d73718ff4 tempest-VolumesSnapshotTestJSON-1775603194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:17 devstack sudo[102192]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-87db68b6-80c0-4680-a3ad-2f606748b9f7" returned: 0 in 5.770s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:17 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] Image conversion details: src /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c, size 1024.00 MB, duration 5.77 sec, destination /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-87db68b6-80c0-4680-a3ad-2f606748b9f7 {{(pid=88591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 17:02:17 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] Converted 1024.00 MB image at 177.45 MB/s Jul 30 17:02:17 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-87db68b6-80c0-4680-a3ad-2f606748b9f7 is being set with open permissions: ugo+rw Jul 30 17:02:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-87db68b6-80c0-4680-a3ad-2f606748b9f7 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:17 devstack sudo[102236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-87db68b6-80c0-4680-a3ad-2f606748b9f7 Jul 30 17:02:17 devstack sudo[102236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:18 devstack sudo[102236]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-87db68b6-80c0-4680-a3ad-2f606748b9f7" returned: 0 in 0.253s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:18 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] Lock "cinder-quobyte-87db68b6-80c0-4680-a3ad-2f606748b9f7" released by "_copy_volume_from_snapshot" :: held 6.864s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:18 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] Acquiring lock "cinder-quobyte-ba1431bf-08f6-484a-98dd-0c7218625c59" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:18 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] Lock "cinder-quobyte-ba1431bf-08f6-484a-98dd-0c7218625c59" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:18 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] Deleting offline snapshot ba1431bf-08f6-484a-98dd-0c7218625c59 of volume 3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:02:18 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] snapshot_file for this snap is: volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c.ba1431bf-08f6-484a-98dd-0c7218625c59 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:02:18 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56df470-24a3-4061-9a27-73d965f86a6c]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c.ba1431bf-08f6-484a-98dd-0c7218625c59 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:18 devstack sudo[102239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c.ba1431bf-08f6-484a-98dd-0c7218625c59 Jul 30 17:02:18 devstack sudo[102239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:18 devstack sudo[102239]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c.ba1431bf-08f6-484a-98dd-0c7218625c59" returned: 0 in 0.371s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:18 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:02:18 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e4619d-8945-48f0-a9d1-c276d5d2e68d]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:18 devstack sudo[102244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c Jul 30 17:02:18 devstack sudo[102244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:19 devstack sudo[102244]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c" returned: 0 in 0.585s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c.ba1431bf-08f6-484a-98dd-0c7218625c59 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:19 devstack sudo[102249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c.ba1431bf-08f6-484a-98dd-0c7218625c59 Jul 30 17:02:19 devstack sudo[102249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:19 devstack sudo[102249]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c.ba1431bf-08f6-484a-98dd-0c7218625c59" returned: 0 in 0.361s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c.ba1431bf-08f6-484a-98dd-0c7218625c59 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:19 devstack sudo[102254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c.ba1431bf-08f6-484a-98dd-0c7218625c59 Jul 30 17:02:19 devstack sudo[102254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:19 devstack sudo[102254]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c.ba1431bf-08f6-484a-98dd-0c7218625c59" returned: 0 in 0.250s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:19 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] Lock "cinder-quobyte-ba1431bf-08f6-484a-98dd-0c7218625c59" released by "_delete_snapshot" :: held 1.668s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.918s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c3cfd0d8-bcb8-4543-8220-e29d73718ff4 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.085s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:19 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-c3cfd0d8-bcb8-4543-8220-e29d73718ff4 tempest-VolumesSnapshotTestJSON-1775603194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:02:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-485606746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76c218fa-b01f-4165-9253-32b6c272a4f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a620a5171f04124a32b2f4dee869ebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:02:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:02:17Z,use_quota=True,user_id='3b2780b32ed64c058aa90235823c0c74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:02:19 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-c3cfd0d8-bcb8-4543-8220-e29d73718ff4 tempest-VolumesSnapshotTestJSON-1775603194 None] Creating volume 76c218fa-b01f-4165-9253-32b6c272a4f8 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:02:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c3cfd0d8-bcb8-4543-8220-e29d73718ff4 tempest-VolumesSnapshotTestJSON-1775603194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c3cfd0d8-bcb8-4543-8220-e29d73718ff4 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:19 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-c3cfd0d8-bcb8-4543-8220-e29d73718ff4 tempest-VolumesSnapshotTestJSON-1775603194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:02:19 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-c3cfd0d8-bcb8-4543-8220-e29d73718ff4 tempest-VolumesSnapshotTestJSON-1775603194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:02:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c3cfd0d8-bcb8-4543-8220-e29d73718ff4 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:19 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-c3cfd0d8-bcb8-4543-8220-e29d73718ff4 tempest-VolumesSnapshotTestJSON-1775603194 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:02:19 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-c3cfd0d8-bcb8-4543-8220-e29d73718ff4 tempest-VolumesSnapshotTestJSON-1775603194 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:02:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c3cfd0d8-bcb8-4543-8220-e29d73718ff4 tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-76c218fa-b01f-4165-9253-32b6c272a4f8 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:19 devstack sudo[102257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-76c218fa-b01f-4165-9253-32b6c272a4f8 1073741824 Jul 30 17:02:19 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87bfc8be-5413-4d9a-be3d-52c4b713c5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87db68b6-80c0-4680-a3ad-2f606748b9f7', 'volume_size': 2, 'source_volid': '3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c', 'source_volstatus': 'available'}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:19 devstack sudo[102257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:19 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54bebeb4-0076-403b-a3ed-18b95da162ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:19 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] Volume volume-87db68b6-80c0-4680-a3ad-2f606748b9f7 (87db68b6-80c0-4680-a3ad-2f606748b9f7): created successfully Jul 30 17:02:19 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54bebeb4-0076-403b-a3ed-18b95da162ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:19 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] Flow 'volume_create_manager' (15bf7bfc-c964-47a0-b139-df7967824675) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:02:19 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-7803df3e-1250-4e12-8b98-2773c7959f43 tempest-VolumesCloneTest-529609679 None] Created volume successfully. Jul 30 17:02:20 devstack sudo[102257]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c3cfd0d8-bcb8-4543-8220-e29d73718ff4 tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-76c218fa-b01f-4165-9253-32b6c272a4f8 1073741824" returned: 0 in 0.458s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c3cfd0d8-bcb8-4543-8220-e29d73718ff4 tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-76c218fa-b01f-4165-9253-32b6c272a4f8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:20 devstack sudo[102262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-76c218fa-b01f-4165-9253-32b6c272a4f8 Jul 30 17:02:20 devstack sudo[102262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:20 devstack sudo[102262]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c3cfd0d8-bcb8-4543-8220-e29d73718ff4 tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-76c218fa-b01f-4165-9253-32b6c272a4f8" returned: 0 in 0.256s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:20 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-c3cfd0d8-bcb8-4543-8220-e29d73718ff4 tempest-VolumesSnapshotTestJSON-1775603194 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:02:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c3cfd0d8-bcb8-4543-8220-e29d73718ff4 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:20 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c3cfd0d8-bcb8-4543-8220-e29d73718ff4 tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28b68058-2ed9-414e-9244-4d6ae4ae137a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76c218fa-b01f-4165-9253-32b6c272a4f8', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:20 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c3cfd0d8-bcb8-4543-8220-e29d73718ff4 tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed8cffeb-b58f-4c10-bc4a-9b34cd353d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:20 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-c3cfd0d8-bcb8-4543-8220-e29d73718ff4 tempest-VolumesSnapshotTestJSON-1775603194 None] Volume volume-76c218fa-b01f-4165-9253-32b6c272a4f8 (76c218fa-b01f-4165-9253-32b6c272a4f8): created successfully Jul 30 17:02:20 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c3cfd0d8-bcb8-4543-8220-e29d73718ff4 tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed8cffeb-b58f-4c10-bc4a-9b34cd353d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:20 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c3cfd0d8-bcb8-4543-8220-e29d73718ff4 tempest-VolumesSnapshotTestJSON-1775603194 None] Flow 'volume_create_manager' (3c2b171d-2a5e-469f-a75a-b88340bc5671) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:02:20 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-c3cfd0d8-bcb8-4543-8220-e29d73718ff4 tempest-VolumesSnapshotTestJSON-1775603194 None] Created volume successfully. Jul 30 17:02:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-731b8049-25aa-4e25-891c-df7c62a3761a tempest-VolumesSnapshotTestJSON-1775603194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-731b8049-25aa-4e25-891c-df7c62a3761a tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:21 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-731b8049-25aa-4e25-891c-df7c62a3761a tempest-VolumesSnapshotTestJSON-1775603194 None] Creating offline snapshot f69475ab-d1f5-4ccc-bff0-73a3db46e391 of volume 76c218fa-b01f-4165-9253-32b6c272a4f8 {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:02:21 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2512856-031d-4265-ba0f-f202bfa029fd]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-731b8049-25aa-4e25-891c-df7c62a3761a tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-76c218fa-b01f-4165-9253-32b6c272a4f8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:21 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ddc85a89-7ccb-41ef-bf35-7b88b8f1035e tempest-VolumesCloneTest-529609679 None] Acquiring lock "cinder-87db68b6-80c0-4680-a3ad-2f606748b9f7-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:21 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfbb7cd4-ad27-457c-a957-fb656e08cc47 tempest-VolumeDependencyTests-893333359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:02:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-dfbb7cd4-ad27-457c-a957-fb656e08cc47 tempest-VolumeDependencyTests-893333359 None] Flow 'volume_create_manager' (6d196d28-4427-40ad-a28b-813ac1861ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:02:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-dfbb7cd4-ad27-457c-a957-fb656e08cc47 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (175580ce-abf0-4844-bc04-7764ed76ec77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-dfbb7cd4-ad27-457c-a957-fb656e08cc47 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (175580ce-abf0-4844-bc04-7764ed76ec77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:02:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1250018568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fac817aa-2523-4c4c-a5bd-0078fb2f0e4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1142be8cf434dc9b1a32ef12a92e88b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:02:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:02:21Z,use_quota=True,user_id='db3e9fa2901f4abe9034e8c4a4f63fb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-dfbb7cd4-ad27-457c-a957-fb656e08cc47 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61abb767-6f43-41a9-9d61-385c1a016d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-dfbb7cd4-ad27-457c-a957-fb656e08cc47 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61abb767-6f43-41a9-9d61-385c1a016d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-dfbb7cd4-ad27-457c-a957-fb656e08cc47 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b0b1cc7-f5b8-45de-957a-49116e9a7a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-dfbb7cd4-ad27-457c-a957-fb656e08cc47 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b0b1cc7-f5b8-45de-957a-49116e9a7a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fac817aa-2523-4c4c-a5bd-0078fb2f0e4d', 'volume_name': 'volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-dfbb7cd4-ad27-457c-a957-fb656e08cc47 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee644bd5-4c79-417b-9f7e-496d4902e589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-dfbb7cd4-ad27-457c-a957-fb656e08cc47 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee644bd5-4c79-417b-9f7e-496d4902e589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-dfbb7cd4-ad27-457c-a957-fb656e08cc47 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbd42aa1-2e22-4c78-8821-a578e63b9638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:21 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-dfbb7cd4-ad27-457c-a957-fb656e08cc47 tempest-VolumeDependencyTests-893333359 None] Volume fac817aa-2523-4c4c-a5bd-0078fb2f0e4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d', 'volume_size': 1} Jul 30 17:02:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-dfbb7cd4-ad27-457c-a957-fb656e08cc47 tempest-VolumeDependencyTests-893333359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:21 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ddc85a89-7ccb-41ef-bf35-7b88b8f1035e tempest-VolumesCloneTest-529609679 None] Lock "cinder-87db68b6-80c0-4680-a3ad-2f606748b9f7-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:21 devstack sudo[102266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-76c218fa-b01f-4165-9253-32b6c272a4f8 Jul 30 17:02:21 devstack sudo[102266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:21 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ddc85a89-7ccb-41ef-bf35-7b88b8f1035e tempest-VolumesCloneTest-529609679 None] Acquiring lock "cinder-quobyte-87db68b6-80c0-4680-a3ad-2f606748b9f7" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:21 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ddc85a89-7ccb-41ef-bf35-7b88b8f1035e tempest-VolumesCloneTest-529609679 None] Lock "cinder-quobyte-87db68b6-80c0-4680-a3ad-2f606748b9f7" acquired by "delete_volume" :: waited 0.014s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:21 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a82117-fa14-45c0-b54a-03440f87c470]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ddc85a89-7ccb-41ef-bf35-7b88b8f1035e tempest-VolumesCloneTest-529609679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-87db68b6-80c0-4680-a3ad-2f606748b9f7 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:21 devstack sudo[102268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-87db68b6-80c0-4680-a3ad-2f606748b9f7 Jul 30 17:02:21 devstack sudo[102268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:21 devstack sudo[102266]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-731b8049-25aa-4e25-891c-df7c62a3761a tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-76c218fa-b01f-4165-9253-32b6c272a4f8" returned: 0 in 0.380s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-731b8049-25aa-4e25-891c-df7c62a3761a tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-76c218fa-b01f-4165-9253-32b6c272a4f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-76c218fa-b01f-4165-9253-32b6c272a4f8.f69475ab-d1f5-4ccc-bff0-73a3db46e391 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:21 devstack sudo[102273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-76c218fa-b01f-4165-9253-32b6c272a4f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-76c218fa-b01f-4165-9253-32b6c272a4f8.f69475ab-d1f5-4ccc-bff0-73a3db46e391 1G Jul 30 17:02:21 devstack sudo[102273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:21 devstack sudo[102268]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ddc85a89-7ccb-41ef-bf35-7b88b8f1035e tempest-VolumesCloneTest-529609679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-87db68b6-80c0-4680-a3ad-2f606748b9f7" returned: 0 in 0.381s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ddc85a89-7ccb-41ef-bf35-7b88b8f1035e tempest-VolumesCloneTest-529609679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-87db68b6-80c0-4680-a3ad-2f606748b9f7 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:21 devstack sudo[102278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-87db68b6-80c0-4680-a3ad-2f606748b9f7 Jul 30 17:02:21 devstack sudo[102278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:21 devstack sudo[102273]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-731b8049-25aa-4e25-891c-df7c62a3761a tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-76c218fa-b01f-4165-9253-32b6c272a4f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-76c218fa-b01f-4165-9253-32b6c272a4f8.f69475ab-d1f5-4ccc-bff0-73a3db46e391 1G" returned: 0 in 0.403s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-731b8049-25aa-4e25-891c-df7c62a3761a tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76c218fa-b01f-4165-9253-32b6c272a4f8 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-76c218fa-b01f-4165-9253-32b6c272a4f8.f69475ab-d1f5-4ccc-bff0-73a3db46e391 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:21 devstack sudo[102285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76c218fa-b01f-4165-9253-32b6c272a4f8 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-76c218fa-b01f-4165-9253-32b6c272a4f8.f69475ab-d1f5-4ccc-bff0-73a3db46e391 Jul 30 17:02:21 devstack sudo[102285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:22 devstack sudo[102278]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ddc85a89-7ccb-41ef-bf35-7b88b8f1035e tempest-VolumesCloneTest-529609679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-87db68b6-80c0-4680-a3ad-2f606748b9f7" returned: 0 in 0.270s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:22 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ddc85a89-7ccb-41ef-bf35-7b88b8f1035e tempest-VolumesCloneTest-529609679 None] Lock "cinder-quobyte-87db68b6-80c0-4680-a3ad-2f606748b9f7" released by "delete_volume" :: held 0.705s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:22 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-ddc85a89-7ccb-41ef-bf35-7b88b8f1035e tempest-VolumesCloneTest-529609679 None] Created reservations ['c3caa35f-95b2-4fe3-9c86-c880ea625428', '933bda64-29ad-461c-b262-7aa17d88e9ac', 'b3195359-774b-44e7-9d10-0c5680e18b4e', '06f52698-b0d0-4dc4-95ae-0a902bbaa693'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:02:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ddc85a89-7ccb-41ef-bf35-7b88b8f1035e tempest-VolumesCloneTest-529609679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ddc85a89-7ccb-41ef-bf35-7b88b8f1035e tempest-VolumesCloneTest-529609679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:22 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ddc85a89-7ccb-41ef-bf35-7b88b8f1035e tempest-VolumesCloneTest-529609679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:02:22 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ddc85a89-7ccb-41ef-bf35-7b88b8f1035e tempest-VolumesCloneTest-529609679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:02:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ddc85a89-7ccb-41ef-bf35-7b88b8f1035e tempest-VolumesCloneTest-529609679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ddc85a89-7ccb-41ef-bf35-7b88b8f1035e tempest-VolumesCloneTest-529609679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:22 devstack sudo[102289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:02:22 devstack sudo[102289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:22 devstack sudo[102285]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-731b8049-25aa-4e25-891c-df7c62a3761a tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76c218fa-b01f-4165-9253-32b6c272a4f8 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-76c218fa-b01f-4165-9253-32b6c272a4f8.f69475ab-d1f5-4ccc-bff0-73a3db46e391" returned: 0 in 0.325s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:22 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-731b8049-25aa-4e25-891c-df7c62a3761a tempest-VolumesSnapshotTestJSON-1775603194 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-76c218fa-b01f-4165-9253-32b6c272a4f8.f69475ab-d1f5-4ccc-bff0-73a3db46e391 is being set with open permissions: ugo+rw Jul 30 17:02:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-731b8049-25aa-4e25-891c-df7c62a3761a tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-76c218fa-b01f-4165-9253-32b6c272a4f8.f69475ab-d1f5-4ccc-bff0-73a3db46e391 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:22 devstack sudo[102294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-76c218fa-b01f-4165-9253-32b6c272a4f8.f69475ab-d1f5-4ccc-bff0-73a3db46e391 Jul 30 17:02:22 devstack sudo[102294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:22 devstack sudo[102289]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ddc85a89-7ccb-41ef-bf35-7b88b8f1035e tempest-VolumesCloneTest-529609679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.262s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:22 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-ddc85a89-7ccb-41ef-bf35-7b88b8f1035e tempest-VolumesCloneTest-529609679 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:02:22 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-ddc85a89-7ccb-41ef-bf35-7b88b8f1035e tempest-VolumesCloneTest-529609679 None] Deleted volume successfully. Jul 30 17:02:22 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-168466bc-c730-43a1-860f-1d775c769714 tempest-VolumesCloneTest-529609679 None] Acquiring lock "cinder-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:22 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-168466bc-c730-43a1-860f-1d775c769714 tempest-VolumesCloneTest-529609679 None] Lock "cinder-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:22 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ddc85a89-7ccb-41ef-bf35-7b88b8f1035e tempest-VolumesCloneTest-529609679 None] Lock "cinder-87db68b6-80c0-4680-a3ad-2f606748b9f7-delete_volume" released by "delete_volume" :: held 1.180s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:22 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-168466bc-c730-43a1-860f-1d775c769714 tempest-VolumesCloneTest-529609679 None] Acquiring lock "cinder-quobyte-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:22 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-168466bc-c730-43a1-860f-1d775c769714 tempest-VolumesCloneTest-529609679 None] Lock "cinder-quobyte-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c" acquired by "delete_volume" :: waited 0.017s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:22 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a03910-dc59-439a-b899-ef43ee19160a]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-168466bc-c730-43a1-860f-1d775c769714 tempest-VolumesCloneTest-529609679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:22 devstack sudo[102294]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-731b8049-25aa-4e25-891c-df7c62a3761a tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-76c218fa-b01f-4165-9253-32b6c272a4f8.f69475ab-d1f5-4ccc-bff0-73a3db46e391" returned: 0 in 0.295s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-731b8049-25aa-4e25-891c-df7c62a3761a tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-76c218fa-b01f-4165-9253-32b6c272a4f8.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:22 devstack sudo[102299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-76c218fa-b01f-4165-9253-32b6c272a4f8.info Jul 30 17:02:22 devstack sudo[102299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:22 devstack sudo[102298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c Jul 30 17:02:22 devstack sudo[102298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:22 devstack sudo[102299]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-731b8049-25aa-4e25-891c-df7c62a3761a tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-76c218fa-b01f-4165-9253-32b6c272a4f8.info" returned: 0 in 0.264s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:22 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-731b8049-25aa-4e25-891c-df7c62a3761a tempest-VolumesSnapshotTestJSON-1775603194 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-76c218fa-b01f-4165-9253-32b6c272a4f8.info is being set with open permissions: ugo+rw Jul 30 17:02:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-731b8049-25aa-4e25-891c-df7c62a3761a tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-76c218fa-b01f-4165-9253-32b6c272a4f8.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:22 devstack sudo[102306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-76c218fa-b01f-4165-9253-32b6c272a4f8.info Jul 30 17:02:22 devstack sudo[102306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:22 devstack sudo[102298]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-168466bc-c730-43a1-860f-1d775c769714 tempest-VolumesCloneTest-529609679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c" returned: 0 in 0.369s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-168466bc-c730-43a1-860f-1d775c769714 tempest-VolumesCloneTest-529609679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:22 devstack sudo[102308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c Jul 30 17:02:22 devstack sudo[102308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:23 devstack sudo[102306]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-731b8049-25aa-4e25-891c-df7c62a3761a tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-76c218fa-b01f-4165-9253-32b6c272a4f8.info" returned: 0 in 0.269s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-731b8049-25aa-4e25-891c-df7c62a3761a tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.046s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-dfbb7cd4-ad27-457c-a957-fb656e08cc47 tempest-VolumeDependencyTests-893333359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.894s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:23 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-dfbb7cd4-ad27-457c-a957-fb656e08cc47 tempest-VolumeDependencyTests-893333359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:02:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1250018568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fac817aa-2523-4c4c-a5bd-0078fb2f0e4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1142be8cf434dc9b1a32ef12a92e88b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:02:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:02:21Z,use_quota=True,user_id='db3e9fa2901f4abe9034e8c4a4f63fb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:02:23 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-dfbb7cd4-ad27-457c-a957-fb656e08cc47 tempest-VolumeDependencyTests-893333359 None] Creating volume fac817aa-2523-4c4c-a5bd-0078fb2f0e4d {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:02:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-dfbb7cd4-ad27-457c-a957-fb656e08cc47 tempest-VolumeDependencyTests-893333359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-dfbb7cd4-ad27-457c-a957-fb656e08cc47 tempest-VolumeDependencyTests-893333359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:23 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-dfbb7cd4-ad27-457c-a957-fb656e08cc47 tempest-VolumeDependencyTests-893333359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:02:23 devstack sudo[102308]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:23 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-dfbb7cd4-ad27-457c-a957-fb656e08cc47 tempest-VolumeDependencyTests-893333359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:02:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-dfbb7cd4-ad27-457c-a957-fb656e08cc47 tempest-VolumeDependencyTests-893333359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:23 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-dfbb7cd4-ad27-457c-a957-fb656e08cc47 tempest-VolumeDependencyTests-893333359 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:02:23 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-dfbb7cd4-ad27-457c-a957-fb656e08cc47 tempest-VolumeDependencyTests-893333359 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:02:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dfbb7cd4-ad27-457c-a957-fb656e08cc47 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-168466bc-c730-43a1-860f-1d775c769714 tempest-VolumesCloneTest-529609679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c" returned: 0 in 0.269s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:23 devstack sudo[102312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d 1073741824 Jul 30 17:02:23 devstack sudo[102312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:23 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-168466bc-c730-43a1-860f-1d775c769714 tempest-VolumesCloneTest-529609679 None] Lock "cinder-quobyte-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c" released by "delete_volume" :: held 0.709s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:23 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-731b8049-25aa-4e25-891c-df7c62a3761a tempest-VolumesSnapshotTestJSON-1775603194 None] Create snapshot completed successfully Jul 30 17:02:23 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-168466bc-c730-43a1-860f-1d775c769714 tempest-VolumesCloneTest-529609679 None] Created reservations ['15c0fda9-8209-4b7b-8fb7-7b20c17bb2ce', '5efd6a57-b2a6-4f49-b2e2-8b00456b2ddc', '5a1fdd50-ccc6-4717-9d6b-25b6371f1f51', 'fba15feb-9a76-481d-b41f-2c33efb67df6'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:02:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-168466bc-c730-43a1-860f-1d775c769714 tempest-VolumesCloneTest-529609679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-168466bc-c730-43a1-860f-1d775c769714 tempest-VolumesCloneTest-529609679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:23 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-168466bc-c730-43a1-860f-1d775c769714 tempest-VolumesCloneTest-529609679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:02:23 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-168466bc-c730-43a1-860f-1d775c769714 tempest-VolumesCloneTest-529609679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:02:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-168466bc-c730-43a1-860f-1d775c769714 tempest-VolumesCloneTest-529609679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-168466bc-c730-43a1-860f-1d775c769714 tempest-VolumesCloneTest-529609679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:23 devstack sudo[102314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:02:23 devstack sudo[102314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:23 devstack sudo[102312]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dfbb7cd4-ad27-457c-a957-fb656e08cc47 tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d 1073741824" returned: 0 in 0.456s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:23 devstack sudo[102314]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-168466bc-c730-43a1-860f-1d775c769714 tempest-VolumesCloneTest-529609679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.308s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:23 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-168466bc-c730-43a1-860f-1d775c769714 tempest-VolumesCloneTest-529609679 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:02:23 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-168466bc-c730-43a1-860f-1d775c769714 tempest-VolumesCloneTest-529609679 None] Deleted volume successfully. Jul 30 17:02:23 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-168466bc-c730-43a1-860f-1d775c769714 tempest-VolumesCloneTest-529609679 None] Lock "cinder-3658f00e-aa9f-4eb4-b8ce-5a51bd78b75c-delete_volume" released by "delete_volume" :: held 1.227s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dfbb7cd4-ad27-457c-a957-fb656e08cc47 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:23 devstack sudo[102320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d Jul 30 17:02:23 devstack sudo[102320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:23 devstack sudo[102320]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dfbb7cd4-ad27-457c-a957-fb656e08cc47 tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d" returned: 0 in 0.263s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:23 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-dfbb7cd4-ad27-457c-a957-fb656e08cc47 tempest-VolumeDependencyTests-893333359 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:02:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-dfbb7cd4-ad27-457c-a957-fb656e08cc47 tempest-VolumeDependencyTests-893333359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:23 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-dfbb7cd4-ad27-457c-a957-fb656e08cc47 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbd42aa1-2e22-4c78-8821-a578e63b9638) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:23 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-dfbb7cd4-ad27-457c-a957-fb656e08cc47 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5558c797-dda2-4c35-be92-4e6c6f7b2aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:23 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-dfbb7cd4-ad27-457c-a957-fb656e08cc47 tempest-VolumeDependencyTests-893333359 None] Volume volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d (fac817aa-2523-4c4c-a5bd-0078fb2f0e4d): created successfully Jul 30 17:02:23 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-dfbb7cd4-ad27-457c-a957-fb656e08cc47 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5558c797-dda2-4c35-be92-4e6c6f7b2aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:23 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-dfbb7cd4-ad27-457c-a957-fb656e08cc47 tempest-VolumeDependencyTests-893333359 None] Flow 'volume_create_manager' (6d196d28-4427-40ad-a28b-813ac1861ceb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:02:24 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-dfbb7cd4-ad27-457c-a957-fb656e08cc47 tempest-VolumeDependencyTests-893333359 None] Created volume successfully. Jul 30 17:02:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2ddbf675-0c52-404d-832d-b5bbe2922f5d tempest-VolumeDependencyTests-893333359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2ddbf675-0c52-404d-832d-b5bbe2922f5d tempest-VolumeDependencyTests-893333359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:24 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-2ddbf675-0c52-404d-832d-b5bbe2922f5d tempest-VolumeDependencyTests-893333359 None] Creating offline snapshot dbb2ae2a-a000-40bf-91e9-2ebc0705d1c4 of volume fac817aa-2523-4c4c-a5bd-0078fb2f0e4d {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:02:24 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[0941d904-2b03-4a08-a133-7cc52bd45ee6]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2ddbf675-0c52-404d-832d-b5bbe2922f5d tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:24 devstack sudo[102325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d Jul 30 17:02:24 devstack sudo[102325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:24 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bbfdbe4-73a4-4aa6-b5fa-97c462c60ff9 tempest-VolumesSnapshotTestJSON-1775603194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:02:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1bbfdbe4-73a4-4aa6-b5fa-97c462c60ff9 tempest-VolumesSnapshotTestJSON-1775603194 None] Flow 'volume_create_manager' (2c1a9d70-30d7-46e7-928e-07c9a2e2bb2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:02:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1bbfdbe4-73a4-4aa6-b5fa-97c462c60ff9 tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45fb2db2-5d14-4b3a-b277-e4cd531981a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1bbfdbe4-73a4-4aa6-b5fa-97c462c60ff9 tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45fb2db2-5d14-4b3a-b277-e4cd531981a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2099453208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ac1ec64-2c81-4f26-83c9-2acc6eed9176,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a620a5171f04124a32b2f4dee869ebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f69475ab-d1f5-4ccc-bff0-73a3db46e391,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:02:25Z,use_quota=True,user_id='3b2780b32ed64c058aa90235823c0c74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1bbfdbe4-73a4-4aa6-b5fa-97c462c60ff9 tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db88cf28-47ea-4348-a999-cef29f0961f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1bbfdbe4-73a4-4aa6-b5fa-97c462c60ff9 tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db88cf28-47ea-4348-a999-cef29f0961f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1bbfdbe4-73a4-4aa6-b5fa-97c462c60ff9 tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81259cae-9308-4b2e-9a84-a9366c5bbeea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1bbfdbe4-73a4-4aa6-b5fa-97c462c60ff9 tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81259cae-9308-4b2e-9a84-a9366c5bbeea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3ac1ec64-2c81-4f26-83c9-2acc6eed9176', 'volume_name': 'volume-3ac1ec64-2c81-4f26-83c9-2acc6eed9176', 'volume_size': 1, 'snapshot_id': 'f69475ab-d1f5-4ccc-bff0-73a3db46e391'}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1bbfdbe4-73a4-4aa6-b5fa-97c462c60ff9 tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (941bfa40-115a-4903-82c2-e95f1039d694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1bbfdbe4-73a4-4aa6-b5fa-97c462c60ff9 tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (941bfa40-115a-4903-82c2-e95f1039d694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1bbfdbe4-73a4-4aa6-b5fa-97c462c60ff9 tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (013471d2-237a-4784-96c9-6230e52fd137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:24 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-1bbfdbe4-73a4-4aa6-b5fa-97c462c60ff9 tempest-VolumesSnapshotTestJSON-1775603194 None] Volume 3ac1ec64-2c81-4f26-83c9-2acc6eed9176: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3ac1ec64-2c81-4f26-83c9-2acc6eed9176', 'volume_size': 1, 'snapshot_id': 'f69475ab-d1f5-4ccc-bff0-73a3db46e391'} Jul 30 17:02:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1bbfdbe4-73a4-4aa6-b5fa-97c462c60ff9 tempest-VolumesSnapshotTestJSON-1775603194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:24 devstack sudo[102325]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2ddbf675-0c52-404d-832d-b5bbe2922f5d tempest-VolumeDependencyTests-893333359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d" returned: 0 in 0.423s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2ddbf675-0c52-404d-832d-b5bbe2922f5d tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d.dbb2ae2a-a000-40bf-91e9-2ebc0705d1c4 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:24 devstack sudo[102330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d.dbb2ae2a-a000-40bf-91e9-2ebc0705d1c4 1G Jul 30 17:02:24 devstack sudo[102330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:25 devstack sudo[102330]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2ddbf675-0c52-404d-832d-b5bbe2922f5d tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d.dbb2ae2a-a000-40bf-91e9-2ebc0705d1c4 1G" returned: 0 in 0.467s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2ddbf675-0c52-404d-832d-b5bbe2922f5d tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d.dbb2ae2a-a000-40bf-91e9-2ebc0705d1c4 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:25 devstack sudo[102336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d.dbb2ae2a-a000-40bf-91e9-2ebc0705d1c4 Jul 30 17:02:25 devstack sudo[102336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:25 devstack sudo[102336]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2ddbf675-0c52-404d-832d-b5bbe2922f5d tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d.dbb2ae2a-a000-40bf-91e9-2ebc0705d1c4" returned: 0 in 0.306s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:25 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-2ddbf675-0c52-404d-832d-b5bbe2922f5d tempest-VolumeDependencyTests-893333359 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d.dbb2ae2a-a000-40bf-91e9-2ebc0705d1c4 is being set with open permissions: ugo+rw Jul 30 17:02:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2ddbf675-0c52-404d-832d-b5bbe2922f5d tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d.dbb2ae2a-a000-40bf-91e9-2ebc0705d1c4 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:25 devstack sudo[102341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d.dbb2ae2a-a000-40bf-91e9-2ebc0705d1c4 Jul 30 17:02:25 devstack sudo[102341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:25 devstack sudo[102341]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2ddbf675-0c52-404d-832d-b5bbe2922f5d tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d.dbb2ae2a-a000-40bf-91e9-2ebc0705d1c4" returned: 0 in 0.256s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2ddbf675-0c52-404d-832d-b5bbe2922f5d tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:26 devstack sudo[102344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d.info Jul 30 17:02:26 devstack sudo[102344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:26 devstack sudo[102344]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2ddbf675-0c52-404d-832d-b5bbe2922f5d tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d.info" returned: 0 in 0.271s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:26 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-2ddbf675-0c52-404d-832d-b5bbe2922f5d tempest-VolumeDependencyTests-893333359 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d.info is being set with open permissions: ugo+rw Jul 30 17:02:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2ddbf675-0c52-404d-832d-b5bbe2922f5d tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:26 devstack sudo[102347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d.info Jul 30 17:02:26 devstack sudo[102347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:26 devstack sudo[102347]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2ddbf675-0c52-404d-832d-b5bbe2922f5d tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d.info" returned: 0 in 0.270s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2ddbf675-0c52-404d-832d-b5bbe2922f5d tempest-VolumeDependencyTests-893333359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.098s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1bbfdbe4-73a4-4aa6-b5fa-97c462c60ff9 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.669s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:26 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-1bbfdbe4-73a4-4aa6-b5fa-97c462c60ff9 tempest-VolumesSnapshotTestJSON-1775603194 None] Acquiring lock "cinder-quobyte-f69475ab-d1f5-4ccc-bff0-73a3db46e391-3ac1ec64-2c81-4f26-83c9-2acc6eed9176" by "_create_volume_from_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:26 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-1bbfdbe4-73a4-4aa6-b5fa-97c462c60ff9 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "cinder-quobyte-f69475ab-d1f5-4ccc-bff0-73a3db46e391-3ac1ec64-2c81-4f26-83c9-2acc6eed9176" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:26 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-1bbfdbe4-73a4-4aa6-b5fa-97c462c60ff9 tempest-VolumesSnapshotTestJSON-1775603194 None] Creating volume 3ac1ec64-2c81-4f26-83c9-2acc6eed9176 from snapshot f69475ab-d1f5-4ccc-bff0-73a3db46e391 {{(pid=88591) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 30 17:02:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1bbfdbe4-73a4-4aa6-b5fa-97c462c60ff9 tempest-VolumesSnapshotTestJSON-1775603194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1bbfdbe4-73a4-4aa6-b5fa-97c462c60ff9 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:26 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-1bbfdbe4-73a4-4aa6-b5fa-97c462c60ff9 tempest-VolumesSnapshotTestJSON-1775603194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:02:26 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-1bbfdbe4-73a4-4aa6-b5fa-97c462c60ff9 tempest-VolumesSnapshotTestJSON-1775603194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:02:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1bbfdbe4-73a4-4aa6-b5fa-97c462c60ff9 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:26 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-1bbfdbe4-73a4-4aa6-b5fa-97c462c60ff9 tempest-VolumesSnapshotTestJSON-1775603194 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:02:26 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-1bbfdbe4-73a4-4aa6-b5fa-97c462c60ff9 tempest-VolumesSnapshotTestJSON-1775603194 None] Acquiring lock "cinder-quobyte-3ac1ec64-2c81-4f26-83c9-2acc6eed9176" by "_copy_volume_from_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:26 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-2ddbf675-0c52-404d-832d-b5bbe2922f5d tempest-VolumeDependencyTests-893333359 None] Create snapshot completed successfully Jul 30 17:02:26 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-1bbfdbe4-73a4-4aa6-b5fa-97c462c60ff9 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "cinder-quobyte-3ac1ec64-2c81-4f26-83c9-2acc6eed9176" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:26 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-1bbfdbe4-73a4-4aa6-b5fa-97c462c60ff9 tempest-VolumesSnapshotTestJSON-1775603194 None] snapshot: f69475ab-d1f5-4ccc-bff0-73a3db46e391, volume: 3ac1ec64-2c81-4f26-83c9-2acc6eed9176, {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 17:02:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1bbfdbe4-73a4-4aa6-b5fa-97c462c60ff9 tempest-VolumesSnapshotTestJSON-1775603194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1bbfdbe4-73a4-4aa6-b5fa-97c462c60ff9 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:26 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-1bbfdbe4-73a4-4aa6-b5fa-97c462c60ff9 tempest-VolumesSnapshotTestJSON-1775603194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:02:26 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-1bbfdbe4-73a4-4aa6-b5fa-97c462c60ff9 tempest-VolumesSnapshotTestJSON-1775603194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:02:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1bbfdbe4-73a4-4aa6-b5fa-97c462c60ff9 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:26 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[574b6b70-dbde-4b3d-ac89-8fcdee349eee]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1bbfdbe4-73a4-4aa6-b5fa-97c462c60ff9 tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-76c218fa-b01f-4165-9253-32b6c272a4f8.f69475ab-d1f5-4ccc-bff0-73a3db46e391 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:26 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a91936d-54f4-45ec-8150-99b83be2e648 tempest-VolumesGetTest-1118799669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:02:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2a91936d-54f4-45ec-8150-99b83be2e648 tempest-VolumesGetTest-1118799669 None] Flow 'volume_create_manager' (d39b67d4-a76d-4583-a031-5ff5979390e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:02:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2a91936d-54f4-45ec-8150-99b83be2e648 tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf5b90dd-788d-4d44-bc37-fd3122363b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2a91936d-54f4-45ec-8150-99b83be2e648 tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf5b90dd-788d-4d44-bc37-fd3122363b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1682333213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5547110b-4be7-4c47-b568-faca8e3833d9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='19c6e94e27fa4ce98248b491a048f03e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:02:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:02:27Z,use_quota=True,user_id='58b251ff552e40e38310aedc71e0c3f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:26 devstack sudo[102350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-76c218fa-b01f-4165-9253-32b6c272a4f8.f69475ab-d1f5-4ccc-bff0-73a3db46e391 Jul 30 17:02:26 devstack sudo[102350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2a91936d-54f4-45ec-8150-99b83be2e648 tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9b4363b-063a-4ec4-a8f3-1ca3577e8566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2a91936d-54f4-45ec-8150-99b83be2e648 tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9b4363b-063a-4ec4-a8f3-1ca3577e8566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2a91936d-54f4-45ec-8150-99b83be2e648 tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc2593ca-f2a7-4d4b-b41f-1f92da90c6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2a91936d-54f4-45ec-8150-99b83be2e648 tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc2593ca-f2a7-4d4b-b41f-1f92da90c6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5547110b-4be7-4c47-b568-faca8e3833d9', 'volume_name': 'volume-5547110b-4be7-4c47-b568-faca8e3833d9', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2a91936d-54f4-45ec-8150-99b83be2e648 tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74bf9a79-82af-4259-9b0e-471f4fd27996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2a91936d-54f4-45ec-8150-99b83be2e648 tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74bf9a79-82af-4259-9b0e-471f4fd27996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2a91936d-54f4-45ec-8150-99b83be2e648 tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4630d4ce-fbb0-4fb6-a4bd-78d2bb3c7d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:26 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-2a91936d-54f4-45ec-8150-99b83be2e648 tempest-VolumesGetTest-1118799669 None] Volume 5547110b-4be7-4c47-b568-faca8e3833d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5547110b-4be7-4c47-b568-faca8e3833d9', 'volume_size': 1} Jul 30 17:02:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2a91936d-54f4-45ec-8150-99b83be2e648 tempest-VolumesGetTest-1118799669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:27 devstack sudo[102350]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1bbfdbe4-73a4-4aa6-b5fa-97c462c60ff9 tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-76c218fa-b01f-4165-9253-32b6c272a4f8.f69475ab-d1f5-4ccc-bff0-73a3db46e391" returned: 0 in 0.366s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:27 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-1bbfdbe4-73a4-4aa6-b5fa-97c462c60ff9 tempest-VolumesSnapshotTestJSON-1775603194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76c218fa-b01f-4165-9253-32b6c272a4f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:02:27 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8547aa-1008-40ce-b059-1b781c8e8b17]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1bbfdbe4-73a4-4aa6-b5fa-97c462c60ff9 tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-76c218fa-b01f-4165-9253-32b6c272a4f8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:27 devstack sudo[102355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-76c218fa-b01f-4165-9253-32b6c272a4f8 Jul 30 17:02:27 devstack sudo[102355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:27 devstack sudo[102355]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1bbfdbe4-73a4-4aa6-b5fa-97c462c60ff9 tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-76c218fa-b01f-4165-9253-32b6c272a4f8" returned: 0 in 0.346s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:27 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-1bbfdbe4-73a4-4aa6-b5fa-97c462c60ff9 tempest-VolumesSnapshotTestJSON-1775603194 None] will copy from snapshot at /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-76c218fa-b01f-4165-9253-32b6c272a4f8 {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 17:02:27 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-1bbfdbe4-73a4-4aa6-b5fa-97c462c60ff9 tempest-VolumesSnapshotTestJSON-1775603194 None] Creating direct copy from snapshot {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 17:02:27 devstack cinder-volume[88591]: DEBUG cinder.utils [None req-1bbfdbe4-73a4-4aa6-b5fa-97c462c60ff9 tempest-VolumesSnapshotTestJSON-1775603194 None] Path /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3ac1ec64-2c81-4f26-83c9-2acc6eed9176 not found in is_blk_device check {{(pid=88591) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 17:02:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1bbfdbe4-73a4-4aa6-b5fa-97c462c60ff9 tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-76c218fa-b01f-4165-9253-32b6c272a4f8 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3ac1ec64-2c81-4f26-83c9-2acc6eed9176 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:27 devstack sudo[102361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-76c218fa-b01f-4165-9253-32b6c272a4f8 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3ac1ec64-2c81-4f26-83c9-2acc6eed9176 Jul 30 17:02:27 devstack sudo[102361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:28 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-557fb00a-f96b-4718-8ef4-ee4a2234fb05 tempest-VolumeDependencyTests-893333359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:02:28 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-557fb00a-f96b-4718-8ef4-ee4a2234fb05 tempest-VolumeDependencyTests-893333359 None] Flow 'volume_create_manager' (bdc6135e-aa49-46aa-a774-9b36df264eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:02:28 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-557fb00a-f96b-4718-8ef4-ee4a2234fb05 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18796050-0981-468c-92f0-e96976475fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:28 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-557fb00a-f96b-4718-8ef4-ee4a2234fb05 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18796050-0981-468c-92f0-e96976475fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:02:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1026240466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d55803e-4e1c-458e-aafc-3df1ad81de23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1142be8cf434dc9b1a32ef12a92e88b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:02:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=dbb2ae2a-a000-40bf-91e9-2ebc0705d1c4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:02:29Z,use_quota=True,user_id='db3e9fa2901f4abe9034e8c4a4f63fb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:28 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-557fb00a-f96b-4718-8ef4-ee4a2234fb05 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb1ef290-aab0-4699-a658-c93e037e706f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:28 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-557fb00a-f96b-4718-8ef4-ee4a2234fb05 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb1ef290-aab0-4699-a658-c93e037e706f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:28 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-557fb00a-f96b-4718-8ef4-ee4a2234fb05 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fed39ca8-cadc-4e2c-8118-3e7697d9fc43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:28 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-557fb00a-f96b-4718-8ef4-ee4a2234fb05 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fed39ca8-cadc-4e2c-8118-3e7697d9fc43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0d55803e-4e1c-458e-aafc-3df1ad81de23', 'volume_name': 'volume-0d55803e-4e1c-458e-aafc-3df1ad81de23', 'volume_size': 1, 'snapshot_id': 'dbb2ae2a-a000-40bf-91e9-2ebc0705d1c4'}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:28 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-557fb00a-f96b-4718-8ef4-ee4a2234fb05 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce110c92-5fb9-4326-b812-bcd413d232a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:29 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-557fb00a-f96b-4718-8ef4-ee4a2234fb05 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce110c92-5fb9-4326-b812-bcd413d232a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:29 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-557fb00a-f96b-4718-8ef4-ee4a2234fb05 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f976b8eb-ad3f-424c-a4a5-5718702eacff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:29 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-557fb00a-f96b-4718-8ef4-ee4a2234fb05 tempest-VolumeDependencyTests-893333359 None] Volume 0d55803e-4e1c-458e-aafc-3df1ad81de23: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0d55803e-4e1c-458e-aafc-3df1ad81de23', 'volume_size': 1, 'snapshot_id': 'dbb2ae2a-a000-40bf-91e9-2ebc0705d1c4'} Jul 30 17:02:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-557fb00a-f96b-4718-8ef4-ee4a2234fb05 tempest-VolumeDependencyTests-893333359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:31 devstack sudo[102361]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1bbfdbe4-73a4-4aa6-b5fa-97c462c60ff9 tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-76c218fa-b01f-4165-9253-32b6c272a4f8 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3ac1ec64-2c81-4f26-83c9-2acc6eed9176" returned: 0 in 4.359s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:31 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-1bbfdbe4-73a4-4aa6-b5fa-97c462c60ff9 tempest-VolumesSnapshotTestJSON-1775603194 None] Image conversion details: src /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-76c218fa-b01f-4165-9253-32b6c272a4f8, size 1024.00 MB, duration 4.36 sec, destination /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3ac1ec64-2c81-4f26-83c9-2acc6eed9176 {{(pid=88591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 17:02:31 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-1bbfdbe4-73a4-4aa6-b5fa-97c462c60ff9 tempest-VolumesSnapshotTestJSON-1775603194 None] Converted 1024.00 MB image at 234.87 MB/s Jul 30 17:02:31 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-1bbfdbe4-73a4-4aa6-b5fa-97c462c60ff9 tempest-VolumesSnapshotTestJSON-1775603194 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3ac1ec64-2c81-4f26-83c9-2acc6eed9176 is being set with open permissions: ugo+rw Jul 30 17:02:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1bbfdbe4-73a4-4aa6-b5fa-97c462c60ff9 tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3ac1ec64-2c81-4f26-83c9-2acc6eed9176 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:31 devstack sudo[102374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3ac1ec64-2c81-4f26-83c9-2acc6eed9176 Jul 30 17:02:31 devstack sudo[102374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:31 devstack sudo[102374]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1bbfdbe4-73a4-4aa6-b5fa-97c462c60ff9 tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3ac1ec64-2c81-4f26-83c9-2acc6eed9176" returned: 0 in 0.240s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:32 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-1bbfdbe4-73a4-4aa6-b5fa-97c462c60ff9 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "cinder-quobyte-3ac1ec64-2c81-4f26-83c9-2acc6eed9176" released by "_copy_volume_from_snapshot" :: held 5.389s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:32 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-1bbfdbe4-73a4-4aa6-b5fa-97c462c60ff9 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "cinder-quobyte-f69475ab-d1f5-4ccc-bff0-73a3db46e391-3ac1ec64-2c81-4f26-83c9-2acc6eed9176" released by "_create_volume_from_snapshot" :: held 5.457s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1bbfdbe4-73a4-4aa6-b5fa-97c462c60ff9 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.489s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2a91936d-54f4-45ec-8150-99b83be2e648 tempest-VolumesGetTest-1118799669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.226s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:32 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-2a91936d-54f4-45ec-8150-99b83be2e648 tempest-VolumesGetTest-1118799669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1682333213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5547110b-4be7-4c47-b568-faca8e3833d9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='19c6e94e27fa4ce98248b491a048f03e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:02:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:02:27Z,use_quota=True,user_id='58b251ff552e40e38310aedc71e0c3f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:02:32 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-2a91936d-54f4-45ec-8150-99b83be2e648 tempest-VolumesGetTest-1118799669 None] Creating volume 5547110b-4be7-4c47-b568-faca8e3833d9 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:02:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2a91936d-54f4-45ec-8150-99b83be2e648 tempest-VolumesGetTest-1118799669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2a91936d-54f4-45ec-8150-99b83be2e648 tempest-VolumesGetTest-1118799669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:32 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-2a91936d-54f4-45ec-8150-99b83be2e648 tempest-VolumesGetTest-1118799669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:02:32 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-2a91936d-54f4-45ec-8150-99b83be2e648 tempest-VolumesGetTest-1118799669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:02:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2a91936d-54f4-45ec-8150-99b83be2e648 tempest-VolumesGetTest-1118799669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:32 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-2a91936d-54f4-45ec-8150-99b83be2e648 tempest-VolumesGetTest-1118799669 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:02:32 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-2a91936d-54f4-45ec-8150-99b83be2e648 tempest-VolumesGetTest-1118799669 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:02:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2a91936d-54f4-45ec-8150-99b83be2e648 tempest-VolumesGetTest-1118799669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5547110b-4be7-4c47-b568-faca8e3833d9 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:32 devstack sudo[102377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5547110b-4be7-4c47-b568-faca8e3833d9 1073741824 Jul 30 17:02:32 devstack sudo[102377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:32 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1bbfdbe4-73a4-4aa6-b5fa-97c462c60ff9 tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (013471d2-237a-4784-96c9-6230e52fd137) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ac1ec64-2c81-4f26-83c9-2acc6eed9176', 'volume_size': 1, 'snapshot_id': 'f69475ab-d1f5-4ccc-bff0-73a3db46e391'}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:32 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1bbfdbe4-73a4-4aa6-b5fa-97c462c60ff9 tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07f91852-5544-4513-9b08-d3be25fba3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:32 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-1bbfdbe4-73a4-4aa6-b5fa-97c462c60ff9 tempest-VolumesSnapshotTestJSON-1775603194 None] Volume volume-3ac1ec64-2c81-4f26-83c9-2acc6eed9176 (3ac1ec64-2c81-4f26-83c9-2acc6eed9176): created successfully Jul 30 17:02:32 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1bbfdbe4-73a4-4aa6-b5fa-97c462c60ff9 tempest-VolumesSnapshotTestJSON-1775603194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07f91852-5544-4513-9b08-d3be25fba3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:32 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1bbfdbe4-73a4-4aa6-b5fa-97c462c60ff9 tempest-VolumesSnapshotTestJSON-1775603194 None] Flow 'volume_create_manager' (2c1a9d70-30d7-46e7-928e-07c9a2e2bb2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:02:32 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-1bbfdbe4-73a4-4aa6-b5fa-97c462c60ff9 tempest-VolumesSnapshotTestJSON-1775603194 None] Created volume successfully. Jul 30 17:02:32 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c17a1d14-1ebc-4ad6-a589-72c86ebd072a tempest-VolumesSnapshotTestJSON-1775603194 None] Acquiring lock "cinder-3ac1ec64-2c81-4f26-83c9-2acc6eed9176-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:32 devstack sudo[102377]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2a91936d-54f4-45ec-8150-99b83be2e648 tempest-VolumesGetTest-1118799669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5547110b-4be7-4c47-b568-faca8e3833d9 1073741824" returned: 0 in 0.418s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:32 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c17a1d14-1ebc-4ad6-a589-72c86ebd072a tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "cinder-3ac1ec64-2c81-4f26-83c9-2acc6eed9176-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2a91936d-54f4-45ec-8150-99b83be2e648 tempest-VolumesGetTest-1118799669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5547110b-4be7-4c47-b568-faca8e3833d9 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:32 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c17a1d14-1ebc-4ad6-a589-72c86ebd072a tempest-VolumesSnapshotTestJSON-1775603194 None] Acquiring lock "cinder-quobyte-3ac1ec64-2c81-4f26-83c9-2acc6eed9176" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:32 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c17a1d14-1ebc-4ad6-a589-72c86ebd072a tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "cinder-quobyte-3ac1ec64-2c81-4f26-83c9-2acc6eed9176" acquired by "delete_volume" :: waited 0.020s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:32 devstack sudo[102384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5547110b-4be7-4c47-b568-faca8e3833d9 Jul 30 17:02:32 devstack sudo[102384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:32 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d0b79a-3581-472c-8d66-fa62e9ff1464]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c17a1d14-1ebc-4ad6-a589-72c86ebd072a tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3ac1ec64-2c81-4f26-83c9-2acc6eed9176 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:32 devstack sudo[102386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3ac1ec64-2c81-4f26-83c9-2acc6eed9176 Jul 30 17:02:32 devstack sudo[102386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:32 devstack sudo[102384]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2a91936d-54f4-45ec-8150-99b83be2e648 tempest-VolumesGetTest-1118799669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5547110b-4be7-4c47-b568-faca8e3833d9" returned: 0 in 0.253s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:32 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-2a91936d-54f4-45ec-8150-99b83be2e648 tempest-VolumesGetTest-1118799669 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:02:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2a91936d-54f4-45ec-8150-99b83be2e648 tempest-VolumesGetTest-1118799669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-557fb00a-f96b-4718-8ef4-ee4a2234fb05 tempest-VolumeDependencyTests-893333359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.758s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:32 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-557fb00a-f96b-4718-8ef4-ee4a2234fb05 tempest-VolumeDependencyTests-893333359 None] Acquiring lock "cinder-quobyte-dbb2ae2a-a000-40bf-91e9-2ebc0705d1c4-0d55803e-4e1c-458e-aafc-3df1ad81de23" by "_create_volume_from_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:32 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2a91936d-54f4-45ec-8150-99b83be2e648 tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4630d4ce-fbb0-4fb6-a4bd-78d2bb3c7d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5547110b-4be7-4c47-b568-faca8e3833d9', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:32 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2a91936d-54f4-45ec-8150-99b83be2e648 tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef0b8980-7dac-4d21-97ad-cffc8892f277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:32 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-557fb00a-f96b-4718-8ef4-ee4a2234fb05 tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-dbb2ae2a-a000-40bf-91e9-2ebc0705d1c4-0d55803e-4e1c-458e-aafc-3df1ad81de23" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:32 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-557fb00a-f96b-4718-8ef4-ee4a2234fb05 tempest-VolumeDependencyTests-893333359 None] Creating volume 0d55803e-4e1c-458e-aafc-3df1ad81de23 from snapshot dbb2ae2a-a000-40bf-91e9-2ebc0705d1c4 {{(pid=88591) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 30 17:02:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-557fb00a-f96b-4718-8ef4-ee4a2234fb05 tempest-VolumeDependencyTests-893333359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-557fb00a-f96b-4718-8ef4-ee4a2234fb05 tempest-VolumeDependencyTests-893333359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:32 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-557fb00a-f96b-4718-8ef4-ee4a2234fb05 tempest-VolumeDependencyTests-893333359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:02:32 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-557fb00a-f96b-4718-8ef4-ee4a2234fb05 tempest-VolumeDependencyTests-893333359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:02:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-557fb00a-f96b-4718-8ef4-ee4a2234fb05 tempest-VolumeDependencyTests-893333359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:32 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-557fb00a-f96b-4718-8ef4-ee4a2234fb05 tempest-VolumeDependencyTests-893333359 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:02:32 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-557fb00a-f96b-4718-8ef4-ee4a2234fb05 tempest-VolumeDependencyTests-893333359 None] Acquiring lock "cinder-quobyte-0d55803e-4e1c-458e-aafc-3df1ad81de23" by "_copy_volume_from_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:32 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-2a91936d-54f4-45ec-8150-99b83be2e648 tempest-VolumesGetTest-1118799669 None] Volume volume-5547110b-4be7-4c47-b568-faca8e3833d9 (5547110b-4be7-4c47-b568-faca8e3833d9): created successfully Jul 30 17:02:32 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2a91936d-54f4-45ec-8150-99b83be2e648 tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef0b8980-7dac-4d21-97ad-cffc8892f277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:32 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2a91936d-54f4-45ec-8150-99b83be2e648 tempest-VolumesGetTest-1118799669 None] Flow 'volume_create_manager' (d39b67d4-a76d-4583-a031-5ff5979390e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:02:32 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-2a91936d-54f4-45ec-8150-99b83be2e648 tempest-VolumesGetTest-1118799669 None] Created volume successfully. Jul 30 17:02:32 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-557fb00a-f96b-4718-8ef4-ee4a2234fb05 tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-0d55803e-4e1c-458e-aafc-3df1ad81de23" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:32 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-557fb00a-f96b-4718-8ef4-ee4a2234fb05 tempest-VolumeDependencyTests-893333359 None] snapshot: dbb2ae2a-a000-40bf-91e9-2ebc0705d1c4, volume: 0d55803e-4e1c-458e-aafc-3df1ad81de23, {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 17:02:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-557fb00a-f96b-4718-8ef4-ee4a2234fb05 tempest-VolumeDependencyTests-893333359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-557fb00a-f96b-4718-8ef4-ee4a2234fb05 tempest-VolumeDependencyTests-893333359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:32 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-557fb00a-f96b-4718-8ef4-ee4a2234fb05 tempest-VolumeDependencyTests-893333359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:02:32 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-557fb00a-f96b-4718-8ef4-ee4a2234fb05 tempest-VolumeDependencyTests-893333359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:02:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-557fb00a-f96b-4718-8ef4-ee4a2234fb05 tempest-VolumeDependencyTests-893333359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:32 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[4420ab09-5fb4-4bab-b4ee-b3ad82b860e9]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-557fb00a-f96b-4718-8ef4-ee4a2234fb05 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d.dbb2ae2a-a000-40bf-91e9-2ebc0705d1c4 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:32 devstack sudo[102386]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c17a1d14-1ebc-4ad6-a589-72c86ebd072a tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3ac1ec64-2c81-4f26-83c9-2acc6eed9176" returned: 0 in 0.377s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c17a1d14-1ebc-4ad6-a589-72c86ebd072a tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3ac1ec64-2c81-4f26-83c9-2acc6eed9176 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:32 devstack sudo[102393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3ac1ec64-2c81-4f26-83c9-2acc6eed9176 Jul 30 17:02:32 devstack sudo[102393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:33 devstack sudo[102392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d.dbb2ae2a-a000-40bf-91e9-2ebc0705d1c4 Jul 30 17:02:33 devstack sudo[102392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:33 devstack sudo[102393]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c17a1d14-1ebc-4ad6-a589-72c86ebd072a tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3ac1ec64-2c81-4f26-83c9-2acc6eed9176" returned: 0 in 0.245s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:33 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c17a1d14-1ebc-4ad6-a589-72c86ebd072a tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "cinder-quobyte-3ac1ec64-2c81-4f26-83c9-2acc6eed9176" released by "delete_volume" :: held 0.663s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:33 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-c17a1d14-1ebc-4ad6-a589-72c86ebd072a tempest-VolumesSnapshotTestJSON-1775603194 None] Created reservations ['97e3ef99-b798-43cf-a1a8-0ab4b7baa166', 'c8fde0d2-31c1-468e-b4e7-3b9cf3b83bd0', '16727cb6-439c-4870-9b2a-1216eba6031c', 'ef5bc9c0-6647-47b0-85a3-7a8f62adc687'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:02:33 devstack sudo[102392]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-557fb00a-f96b-4718-8ef4-ee4a2234fb05 tempest-VolumeDependencyTests-893333359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d.dbb2ae2a-a000-40bf-91e9-2ebc0705d1c4" returned: 0 in 0.408s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:33 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-557fb00a-f96b-4718-8ef4-ee4a2234fb05 tempest-VolumeDependencyTests-893333359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:02:33 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4f9a97-3581-4618-8640-1fe2f8ce4a9a]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-557fb00a-f96b-4718-8ef4-ee4a2234fb05 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c17a1d14-1ebc-4ad6-a589-72c86ebd072a tempest-VolumesSnapshotTestJSON-1775603194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c17a1d14-1ebc-4ad6-a589-72c86ebd072a tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:33 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-c17a1d14-1ebc-4ad6-a589-72c86ebd072a tempest-VolumesSnapshotTestJSON-1775603194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:02:33 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-c17a1d14-1ebc-4ad6-a589-72c86ebd072a tempest-VolumesSnapshotTestJSON-1775603194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:02:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c17a1d14-1ebc-4ad6-a589-72c86ebd072a tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c17a1d14-1ebc-4ad6-a589-72c86ebd072a tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:33 devstack sudo[102402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:02:33 devstack sudo[102402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:33 devstack sudo[102401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d Jul 30 17:02:33 devstack sudo[102401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:33 devstack sudo[102402]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:33 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c89c9c24-06c1-4f87-9646-7288ad2965c2 tempest-VolumesSnapshotTestJSON-1775603194 None] Acquiring lock "cinder-f69475ab-d1f5-4ccc-bff0-73a3db46e391-delete_snapshot" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c17a1d14-1ebc-4ad6-a589-72c86ebd072a tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.298s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:33 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-c17a1d14-1ebc-4ad6-a589-72c86ebd072a tempest-VolumesSnapshotTestJSON-1775603194 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:02:33 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-c17a1d14-1ebc-4ad6-a589-72c86ebd072a tempest-VolumesSnapshotTestJSON-1775603194 None] Deleted volume successfully. Jul 30 17:02:33 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c89c9c24-06c1-4f87-9646-7288ad2965c2 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "cinder-f69475ab-d1f5-4ccc-bff0-73a3db46e391-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:33 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c89c9c24-06c1-4f87-9646-7288ad2965c2 tempest-VolumesSnapshotTestJSON-1775603194 None] Acquiring lock "cinder-quobyte-76c218fa-b01f-4165-9253-32b6c272a4f8" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:33 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c89c9c24-06c1-4f87-9646-7288ad2965c2 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "cinder-quobyte-76c218fa-b01f-4165-9253-32b6c272a4f8" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:33 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c89c9c24-06c1-4f87-9646-7288ad2965c2 tempest-VolumesSnapshotTestJSON-1775603194 None] Acquiring lock "cinder-quobyte-f69475ab-d1f5-4ccc-bff0-73a3db46e391" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:33 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c17a1d14-1ebc-4ad6-a589-72c86ebd072a tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "cinder-3ac1ec64-2c81-4f26-83c9-2acc6eed9176-delete_volume" released by "delete_volume" :: held 1.283s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:33 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c89c9c24-06c1-4f87-9646-7288ad2965c2 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "cinder-quobyte-f69475ab-d1f5-4ccc-bff0-73a3db46e391" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:33 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-c89c9c24-06c1-4f87-9646-7288ad2965c2 tempest-VolumesSnapshotTestJSON-1775603194 None] Deleting offline snapshot f69475ab-d1f5-4ccc-bff0-73a3db46e391 of volume 76c218fa-b01f-4165-9253-32b6c272a4f8 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:02:33 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-c89c9c24-06c1-4f87-9646-7288ad2965c2 tempest-VolumesSnapshotTestJSON-1775603194 None] snapshot_file for this snap is: volume-76c218fa-b01f-4165-9253-32b6c272a4f8.f69475ab-d1f5-4ccc-bff0-73a3db46e391 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:02:33 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3566dd-1d78-4874-8934-92eb6571e453]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c89c9c24-06c1-4f87-9646-7288ad2965c2 tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-76c218fa-b01f-4165-9253-32b6c272a4f8.f69475ab-d1f5-4ccc-bff0-73a3db46e391 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:33 devstack sudo[102401]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-557fb00a-f96b-4718-8ef4-ee4a2234fb05 tempest-VolumeDependencyTests-893333359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d" returned: 0 in 0.476s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:33 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-557fb00a-f96b-4718-8ef4-ee4a2234fb05 tempest-VolumeDependencyTests-893333359 None] will copy from snapshot at /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 17:02:33 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-557fb00a-f96b-4718-8ef4-ee4a2234fb05 tempest-VolumeDependencyTests-893333359 None] Creating direct copy from snapshot {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 17:02:33 devstack cinder-volume[88591]: DEBUG cinder.utils [None req-557fb00a-f96b-4718-8ef4-ee4a2234fb05 tempest-VolumeDependencyTests-893333359 None] Path /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23 not found in is_blk_device check {{(pid=88591) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 17:02:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-557fb00a-f96b-4718-8ef4-ee4a2234fb05 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:33 devstack sudo[102410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23 Jul 30 17:02:33 devstack sudo[102410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:33 devstack sudo[102409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-76c218fa-b01f-4165-9253-32b6c272a4f8.f69475ab-d1f5-4ccc-bff0-73a3db46e391 Jul 30 17:02:33 devstack sudo[102409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:34 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-a21f97a4-3607-44b2-a26c-1d0ae9978bb3 tempest-VolumesGetTest-1118799669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:02:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a21f97a4-3607-44b2-a26c-1d0ae9978bb3 tempest-VolumesGetTest-1118799669 None] Flow 'volume_create_manager' (b3f8900c-82b0-41c8-bc0f-8b6cc029cdc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:02:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a21f97a4-3607-44b2-a26c-1d0ae9978bb3 tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (556d0cb4-1a12-407c-a4b8-f81c69d64fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:34 devstack sudo[102409]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a21f97a4-3607-44b2-a26c-1d0ae9978bb3 tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (556d0cb4-1a12-407c-a4b8-f81c69d64fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:02:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1800798542',display_name='tempest-VolumesGetTest-Volume-413459206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0de6ecce-5e63-474e-b310-36cfc42a1e90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c6e94e27fa4ce98248b491a048f03e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:02:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:02:34Z,use_quota=True,user_id='58b251ff552e40e38310aedc71e0c3f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a21f97a4-3607-44b2-a26c-1d0ae9978bb3 tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (945cb501-9c17-49e1-8ada-36b15e8f8753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a21f97a4-3607-44b2-a26c-1d0ae9978bb3 tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (945cb501-9c17-49e1-8ada-36b15e8f8753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a21f97a4-3607-44b2-a26c-1d0ae9978bb3 tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b1b15fd-f320-4744-b401-66367ffb2929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a21f97a4-3607-44b2-a26c-1d0ae9978bb3 tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b1b15fd-f320-4744-b401-66367ffb2929) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0de6ecce-5e63-474e-b310-36cfc42a1e90', 'volume_name': 'volume-0de6ecce-5e63-474e-b310-36cfc42a1e90', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a21f97a4-3607-44b2-a26c-1d0ae9978bb3 tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfcc2d92-8dee-4a3b-929e-87c8f93a913f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a21f97a4-3607-44b2-a26c-1d0ae9978bb3 tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfcc2d92-8dee-4a3b-929e-87c8f93a913f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a21f97a4-3607-44b2-a26c-1d0ae9978bb3 tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37820632-93ec-47ee-a8d0-df556ee58223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:34 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-a21f97a4-3607-44b2-a26c-1d0ae9978bb3 tempest-VolumesGetTest-1118799669 None] Volume 0de6ecce-5e63-474e-b310-36cfc42a1e90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0de6ecce-5e63-474e-b310-36cfc42a1e90', 'volume_size': 1} Jul 30 17:02:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a21f97a4-3607-44b2-a26c-1d0ae9978bb3 tempest-VolumesGetTest-1118799669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c89c9c24-06c1-4f87-9646-7288ad2965c2 tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-76c218fa-b01f-4165-9253-32b6c272a4f8.f69475ab-d1f5-4ccc-bff0-73a3db46e391" returned: 0 in 0.466s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:34 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-c89c9c24-06c1-4f87-9646-7288ad2965c2 tempest-VolumesSnapshotTestJSON-1775603194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76c218fa-b01f-4165-9253-32b6c272a4f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:02:34 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97d62f4-c80a-4a04-bdc5-6b2760a08dfd]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c89c9c24-06c1-4f87-9646-7288ad2965c2 tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-76c218fa-b01f-4165-9253-32b6c272a4f8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:34 devstack sudo[102420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-76c218fa-b01f-4165-9253-32b6c272a4f8 Jul 30 17:02:34 devstack sudo[102420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:35 devstack sudo[102420]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c89c9c24-06c1-4f87-9646-7288ad2965c2 tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-76c218fa-b01f-4165-9253-32b6c272a4f8" returned: 0 in 0.777s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c89c9c24-06c1-4f87-9646-7288ad2965c2 tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-76c218fa-b01f-4165-9253-32b6c272a4f8.f69475ab-d1f5-4ccc-bff0-73a3db46e391 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:35 devstack sudo[102431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-76c218fa-b01f-4165-9253-32b6c272a4f8.f69475ab-d1f5-4ccc-bff0-73a3db46e391 Jul 30 17:02:35 devstack sudo[102431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:35 devstack sudo[102431]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c89c9c24-06c1-4f87-9646-7288ad2965c2 tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-76c218fa-b01f-4165-9253-32b6c272a4f8.f69475ab-d1f5-4ccc-bff0-73a3db46e391" returned: 0 in 0.692s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c89c9c24-06c1-4f87-9646-7288ad2965c2 tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-76c218fa-b01f-4165-9253-32b6c272a4f8.f69475ab-d1f5-4ccc-bff0-73a3db46e391 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:35 devstack sudo[102436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-76c218fa-b01f-4165-9253-32b6c272a4f8.f69475ab-d1f5-4ccc-bff0-73a3db46e391 Jul 30 17:02:35 devstack sudo[102436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:36 devstack sudo[102436]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c89c9c24-06c1-4f87-9646-7288ad2965c2 tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-76c218fa-b01f-4165-9253-32b6c272a4f8.f69475ab-d1f5-4ccc-bff0-73a3db46e391" returned: 0 in 0.499s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:36 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c89c9c24-06c1-4f87-9646-7288ad2965c2 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "cinder-quobyte-f69475ab-d1f5-4ccc-bff0-73a3db46e391" released by "_delete_snapshot" :: held 2.598s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:36 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c89c9c24-06c1-4f87-9646-7288ad2965c2 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "cinder-quobyte-76c218fa-b01f-4165-9253-32b6c272a4f8" released by "delete_snapshot" :: held 2.652s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:36 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-c89c9c24-06c1-4f87-9646-7288ad2965c2 tempest-VolumesSnapshotTestJSON-1775603194 None] Created reservations ['cf071589-90f4-4b79-a2b4-a8a5377e7b90', 'a5918348-19b3-4921-93de-55082ca1788e', '960524d3-17d9-4371-bd9a-7da7ccc5040c', '44e1735e-8714-4b36-87d4-571bb1ef49a4'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:02:36 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-c89c9c24-06c1-4f87-9646-7288ad2965c2 tempest-VolumesSnapshotTestJSON-1775603194 None] Delete snapshot completed successfully. Jul 30 17:02:36 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c89c9c24-06c1-4f87-9646-7288ad2965c2 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "cinder-f69475ab-d1f5-4ccc-bff0-73a3db46e391-delete_snapshot" released by "delete_snapshot" :: held 3.060s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:37 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-bac4a793-e52e-42da-b814-da64680dadb3 tempest-VolumesSnapshotTestJSON-1775603194 None] Acquiring lock "cinder-76c218fa-b01f-4165-9253-32b6c272a4f8-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:37 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-bac4a793-e52e-42da-b814-da64680dadb3 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "cinder-76c218fa-b01f-4165-9253-32b6c272a4f8-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:37 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-bac4a793-e52e-42da-b814-da64680dadb3 tempest-VolumesSnapshotTestJSON-1775603194 None] Acquiring lock "cinder-quobyte-76c218fa-b01f-4165-9253-32b6c272a4f8" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:37 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-bac4a793-e52e-42da-b814-da64680dadb3 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "cinder-quobyte-76c218fa-b01f-4165-9253-32b6c272a4f8" acquired by "delete_volume" :: waited 0.037s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:37 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[487eb836-246e-4286-be84-bba295cb54f9]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bac4a793-e52e-42da-b814-da64680dadb3 tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-76c218fa-b01f-4165-9253-32b6c272a4f8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:37 devstack sudo[102439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-76c218fa-b01f-4165-9253-32b6c272a4f8 Jul 30 17:02:37 devstack sudo[102439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:38 devstack sudo[102439]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bac4a793-e52e-42da-b814-da64680dadb3 tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-76c218fa-b01f-4165-9253-32b6c272a4f8" returned: 0 in 0.817s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bac4a793-e52e-42da-b814-da64680dadb3 tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-76c218fa-b01f-4165-9253-32b6c272a4f8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:38 devstack sudo[102445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-76c218fa-b01f-4165-9253-32b6c272a4f8 Jul 30 17:02:38 devstack sudo[102445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:38 devstack sudo[102410]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-557fb00a-f96b-4718-8ef4-ee4a2234fb05 tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23" returned: 0 in 4.761s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:38 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-557fb00a-f96b-4718-8ef4-ee4a2234fb05 tempest-VolumeDependencyTests-893333359 None] Image conversion details: src /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d, size 1024.00 MB, duration 4.76 sec, destination /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23 {{(pid=88591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 17:02:38 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-557fb00a-f96b-4718-8ef4-ee4a2234fb05 tempest-VolumeDependencyTests-893333359 None] Converted 1024.00 MB image at 215.02 MB/s Jul 30 17:02:38 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-557fb00a-f96b-4718-8ef4-ee4a2234fb05 tempest-VolumeDependencyTests-893333359 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23 is being set with open permissions: ugo+rw Jul 30 17:02:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-557fb00a-f96b-4718-8ef4-ee4a2234fb05 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:38 devstack sudo[102447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23 Jul 30 17:02:38 devstack sudo[102447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:38 devstack sudo[102445]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bac4a793-e52e-42da-b814-da64680dadb3 tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-76c218fa-b01f-4165-9253-32b6c272a4f8" returned: 0 in 0.364s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:38 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-bac4a793-e52e-42da-b814-da64680dadb3 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "cinder-quobyte-76c218fa-b01f-4165-9253-32b6c272a4f8" released by "delete_volume" :: held 1.305s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:38 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:SELECT=140,cinder:UPDATE=137,cinder:INSERT=57,cinder:DELETE=17 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:02:38 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-bac4a793-e52e-42da-b814-da64680dadb3 tempest-VolumesSnapshotTestJSON-1775603194 None] Created reservations ['4722f037-70e5-4f1c-a7c0-9119f199e978', '2df41433-9b61-4c84-9e91-ec1411cf514b', 'ee327169-6e2a-4c63-99ec-15450f3b18d9', 'f8155c34-c8b9-4f06-816d-99e0535f4bc8'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:02:38 devstack sudo[102447]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:38 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:UPDATE=144,cinder:INSERT=50,cinder:SELECT=127,cinder:DELETE=8 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:02:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-557fb00a-f96b-4718-8ef4-ee4a2234fb05 tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23" returned: 0 in 0.268s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:38 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-557fb00a-f96b-4718-8ef4-ee4a2234fb05 tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-0d55803e-4e1c-458e-aafc-3df1ad81de23" released by "_copy_volume_from_snapshot" :: held 6.024s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:38 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-557fb00a-f96b-4718-8ef4-ee4a2234fb05 tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-dbb2ae2a-a000-40bf-91e9-2ebc0705d1c4-0d55803e-4e1c-458e-aafc-3df1ad81de23" released by "_create_volume_from_snapshot" :: held 6.113s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-557fb00a-f96b-4718-8ef4-ee4a2234fb05 tempest-VolumeDependencyTests-893333359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.150s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-bac4a793-e52e-42da-b814-da64680dadb3 tempest-VolumesSnapshotTestJSON-1775603194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-bac4a793-e52e-42da-b814-da64680dadb3 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:38 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-bac4a793-e52e-42da-b814-da64680dadb3 tempest-VolumesSnapshotTestJSON-1775603194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:02:38 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-bac4a793-e52e-42da-b814-da64680dadb3 tempest-VolumesSnapshotTestJSON-1775603194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:02:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-bac4a793-e52e-42da-b814-da64680dadb3 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bac4a793-e52e-42da-b814-da64680dadb3 tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a21f97a4-3607-44b2-a26c-1d0ae9978bb3 tempest-VolumesGetTest-1118799669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.670s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:38 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a21f97a4-3607-44b2-a26c-1d0ae9978bb3 tempest-VolumesGetTest-1118799669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:02:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1800798542',display_name='tempest-VolumesGetTest-Volume-413459206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0de6ecce-5e63-474e-b310-36cfc42a1e90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c6e94e27fa4ce98248b491a048f03e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:02:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:02:34Z,use_quota=True,user_id='58b251ff552e40e38310aedc71e0c3f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:02:38 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-a21f97a4-3607-44b2-a26c-1d0ae9978bb3 tempest-VolumesGetTest-1118799669 None] Creating volume 0de6ecce-5e63-474e-b310-36cfc42a1e90 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:02:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a21f97a4-3607-44b2-a26c-1d0ae9978bb3 tempest-VolumesGetTest-1118799669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a21f97a4-3607-44b2-a26c-1d0ae9978bb3 tempest-VolumesGetTest-1118799669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:38 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a21f97a4-3607-44b2-a26c-1d0ae9978bb3 tempest-VolumesGetTest-1118799669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:02:38 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a21f97a4-3607-44b2-a26c-1d0ae9978bb3 tempest-VolumesGetTest-1118799669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:02:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a21f97a4-3607-44b2-a26c-1d0ae9978bb3 tempest-VolumesGetTest-1118799669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:38 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a21f97a4-3607-44b2-a26c-1d0ae9978bb3 tempest-VolumesGetTest-1118799669 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:02:38 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-a21f97a4-3607-44b2-a26c-1d0ae9978bb3 tempest-VolumesGetTest-1118799669 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:02:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a21f97a4-3607-44b2-a26c-1d0ae9978bb3 tempest-VolumesGetTest-1118799669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0de6ecce-5e63-474e-b310-36cfc42a1e90 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:38 devstack sudo[102451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:02:38 devstack sudo[102451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:38 devstack sudo[102453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0de6ecce-5e63-474e-b310-36cfc42a1e90 1073741824 Jul 30 17:02:38 devstack sudo[102453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-557fb00a-f96b-4718-8ef4-ee4a2234fb05 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f976b8eb-ad3f-424c-a4a5-5718702eacff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d55803e-4e1c-458e-aafc-3df1ad81de23', 'volume_size': 1, 'snapshot_id': 'dbb2ae2a-a000-40bf-91e9-2ebc0705d1c4'}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-557fb00a-f96b-4718-8ef4-ee4a2234fb05 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59f98102-24e8-4489-abcf-a7e0fcd56b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:39 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-557fb00a-f96b-4718-8ef4-ee4a2234fb05 tempest-VolumeDependencyTests-893333359 None] Volume volume-0d55803e-4e1c-458e-aafc-3df1ad81de23 (0d55803e-4e1c-458e-aafc-3df1ad81de23): created successfully Jul 30 17:02:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-557fb00a-f96b-4718-8ef4-ee4a2234fb05 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59f98102-24e8-4489-abcf-a7e0fcd56b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-557fb00a-f96b-4718-8ef4-ee4a2234fb05 tempest-VolumeDependencyTests-893333359 None] Flow 'volume_create_manager' (bdc6135e-aa49-46aa-a774-9b36df264eb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:02:39 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-557fb00a-f96b-4718-8ef4-ee4a2234fb05 tempest-VolumeDependencyTests-893333359 None] Created volume successfully. Jul 30 17:02:39 devstack sudo[102451]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bac4a793-e52e-42da-b814-da64680dadb3 tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.265s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:39 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-bac4a793-e52e-42da-b814-da64680dadb3 tempest-VolumesSnapshotTestJSON-1775603194 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:02:39 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-bac4a793-e52e-42da-b814-da64680dadb3 tempest-VolumesSnapshotTestJSON-1775603194 None] Deleted volume successfully. Jul 30 17:02:39 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-bac4a793-e52e-42da-b814-da64680dadb3 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "cinder-76c218fa-b01f-4165-9253-32b6c272a4f8-delete_volume" released by "delete_volume" :: held 1.908s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:39 devstack sudo[102453]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a21f97a4-3607-44b2-a26c-1d0ae9978bb3 tempest-VolumesGetTest-1118799669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0de6ecce-5e63-474e-b310-36cfc42a1e90 1073741824" returned: 0 in 0.450s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a21f97a4-3607-44b2-a26c-1d0ae9978bb3 tempest-VolumesGetTest-1118799669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0de6ecce-5e63-474e-b310-36cfc42a1e90 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:39 devstack sudo[102460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0de6ecce-5e63-474e-b310-36cfc42a1e90 Jul 30 17:02:39 devstack sudo[102460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:39 devstack sudo[102460]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a21f97a4-3607-44b2-a26c-1d0ae9978bb3 tempest-VolumesGetTest-1118799669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0de6ecce-5e63-474e-b310-36cfc42a1e90" returned: 0 in 0.261s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:39 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a21f97a4-3607-44b2-a26c-1d0ae9978bb3 tempest-VolumesGetTest-1118799669 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:02:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a21f97a4-3607-44b2-a26c-1d0ae9978bb3 tempest-VolumesGetTest-1118799669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a21f97a4-3607-44b2-a26c-1d0ae9978bb3 tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37820632-93ec-47ee-a8d0-df556ee58223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0de6ecce-5e63-474e-b310-36cfc42a1e90', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a21f97a4-3607-44b2-a26c-1d0ae9978bb3 tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5a26e8b-db5f-44cc-8d28-721d39f018ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:39 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ebe8dec0-711a-48a3-8e0e-0c9a2eaa3df2 tempest-VolumesSnapshotTestJSON-1775603194 None] Acquiring lock "cinder-ceed46bc-e34f-4b07-b786-cee0be9a0c9c-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:39 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ebe8dec0-711a-48a3-8e0e-0c9a2eaa3df2 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "cinder-ceed46bc-e34f-4b07-b786-cee0be9a0c9c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:39 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-a21f97a4-3607-44b2-a26c-1d0ae9978bb3 tempest-VolumesGetTest-1118799669 None] Volume volume-0de6ecce-5e63-474e-b310-36cfc42a1e90 (0de6ecce-5e63-474e-b310-36cfc42a1e90): created successfully Jul 30 17:02:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a21f97a4-3607-44b2-a26c-1d0ae9978bb3 tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5a26e8b-db5f-44cc-8d28-721d39f018ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a21f97a4-3607-44b2-a26c-1d0ae9978bb3 tempest-VolumesGetTest-1118799669 None] Flow 'volume_create_manager' (b3f8900c-82b0-41c8-bc0f-8b6cc029cdc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:02:39 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-a21f97a4-3607-44b2-a26c-1d0ae9978bb3 tempest-VolumesGetTest-1118799669 None] Created volume successfully. Jul 30 17:02:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d554b61b-50d9-4c19-b035-f6db5411c441 tempest-VolumeDependencyTests-893333359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d554b61b-50d9-4c19-b035-f6db5411c441 tempest-VolumeDependencyTests-893333359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:39 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ebe8dec0-711a-48a3-8e0e-0c9a2eaa3df2 tempest-VolumesSnapshotTestJSON-1775603194 None] Acquiring lock "cinder-quobyte-ceed46bc-e34f-4b07-b786-cee0be9a0c9c" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:39 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-d554b61b-50d9-4c19-b035-f6db5411c441 tempest-VolumeDependencyTests-893333359 None] Creating offline snapshot 6cdc6195-a520-47e2-a949-811f457ff219 of volume 0d55803e-4e1c-458e-aafc-3df1ad81de23 {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:02:39 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ebe8dec0-711a-48a3-8e0e-0c9a2eaa3df2 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "cinder-quobyte-ceed46bc-e34f-4b07-b786-cee0be9a0c9c" acquired by "delete_volume" :: waited 0.024s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:39 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[888a69a6-e17d-4bb4-95d2-27bc7fd75159]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d554b61b-50d9-4c19-b035-f6db5411c441 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:39 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0f54ae-8599-453c-9a7b-0da2c813adbc]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ebe8dec0-711a-48a3-8e0e-0c9a2eaa3df2 tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ceed46bc-e34f-4b07-b786-cee0be9a0c9c {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:39 devstack sudo[102463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23 Jul 30 17:02:39 devstack sudo[102463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:40 devstack sudo[102464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ceed46bc-e34f-4b07-b786-cee0be9a0c9c Jul 30 17:02:40 devstack sudo[102464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:40 devstack sudo[102463]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d554b61b-50d9-4c19-b035-f6db5411c441 tempest-VolumeDependencyTests-893333359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23" returned: 0 in 0.363s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d554b61b-50d9-4c19-b035-f6db5411c441 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23.6cdc6195-a520-47e2-a949-811f457ff219 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:40 devstack sudo[102464]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ebe8dec0-711a-48a3-8e0e-0c9a2eaa3df2 tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ceed46bc-e34f-4b07-b786-cee0be9a0c9c" returned: 0 in 0.363s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ebe8dec0-711a-48a3-8e0e-0c9a2eaa3df2 tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ceed46bc-e34f-4b07-b786-cee0be9a0c9c {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:40 devstack sudo[102473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23.6cdc6195-a520-47e2-a949-811f457ff219 1G Jul 30 17:02:40 devstack sudo[102473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:40 devstack sudo[102474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ceed46bc-e34f-4b07-b786-cee0be9a0c9c Jul 30 17:02:40 devstack sudo[102474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:40 devstack sudo[102474]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ebe8dec0-711a-48a3-8e0e-0c9a2eaa3df2 tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ceed46bc-e34f-4b07-b786-cee0be9a0c9c" returned: 0 in 0.251s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:40 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ebe8dec0-711a-48a3-8e0e-0c9a2eaa3df2 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "cinder-quobyte-ceed46bc-e34f-4b07-b786-cee0be9a0c9c" released by "delete_volume" :: held 0.679s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:40 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-ebe8dec0-711a-48a3-8e0e-0c9a2eaa3df2 tempest-VolumesSnapshotTestJSON-1775603194 None] Created reservations ['86704cf2-3850-4ec3-b7a8-bf1140d2f63f', '0c2f70d7-ba82-4f4f-acc2-0c4281c230e5', 'fd31a6f7-e7c5-407a-b771-f462ff17cd7c', '6d2eb685-f774-4172-9c06-da0b42e12871'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:02:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ebe8dec0-711a-48a3-8e0e-0c9a2eaa3df2 tempest-VolumesSnapshotTestJSON-1775603194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ebe8dec0-711a-48a3-8e0e-0c9a2eaa3df2 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:40 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ebe8dec0-711a-48a3-8e0e-0c9a2eaa3df2 tempest-VolumesSnapshotTestJSON-1775603194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:02:40 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ebe8dec0-711a-48a3-8e0e-0c9a2eaa3df2 tempest-VolumesSnapshotTestJSON-1775603194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:02:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ebe8dec0-711a-48a3-8e0e-0c9a2eaa3df2 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ebe8dec0-711a-48a3-8e0e-0c9a2eaa3df2 tempest-VolumesSnapshotTestJSON-1775603194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:40 devstack sudo[102473]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d554b61b-50d9-4c19-b035-f6db5411c441 tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23.6cdc6195-a520-47e2-a949-811f457ff219 1G" returned: 0 in 0.421s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d554b61b-50d9-4c19-b035-f6db5411c441 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d55803e-4e1c-458e-aafc-3df1ad81de23 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23.6cdc6195-a520-47e2-a949-811f457ff219 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:40 devstack sudo[102481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:02:40 devstack sudo[102481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:40 devstack sudo[102482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d55803e-4e1c-458e-aafc-3df1ad81de23 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23.6cdc6195-a520-47e2-a949-811f457ff219 Jul 30 17:02:40 devstack sudo[102482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:40 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-1188a7ce-fa71-4f4d-bef8-6c04d7359b73 tempest-VolumesGetTest-1118799669 None] Acquiring lock "cinder-0de6ecce-5e63-474e-b310-36cfc42a1e90-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:40 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-1188a7ce-fa71-4f4d-bef8-6c04d7359b73 tempest-VolumesGetTest-1118799669 None] Lock "cinder-0de6ecce-5e63-474e-b310-36cfc42a1e90-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:41 devstack sudo[102481]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ebe8dec0-711a-48a3-8e0e-0c9a2eaa3df2 tempest-VolumesSnapshotTestJSON-1775603194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.353s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:41 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-ebe8dec0-711a-48a3-8e0e-0c9a2eaa3df2 tempest-VolumesSnapshotTestJSON-1775603194 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:02:41 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-ebe8dec0-711a-48a3-8e0e-0c9a2eaa3df2 tempest-VolumesSnapshotTestJSON-1775603194 None] Deleted volume successfully. Jul 30 17:02:41 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ebe8dec0-711a-48a3-8e0e-0c9a2eaa3df2 tempest-VolumesSnapshotTestJSON-1775603194 None] Lock "cinder-ceed46bc-e34f-4b07-b786-cee0be9a0c9c-delete_volume" released by "delete_volume" :: held 1.282s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:41 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-1188a7ce-fa71-4f4d-bef8-6c04d7359b73 tempest-VolumesGetTest-1118799669 None] Acquiring lock "cinder-quobyte-0de6ecce-5e63-474e-b310-36cfc42a1e90" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:41 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-1188a7ce-fa71-4f4d-bef8-6c04d7359b73 tempest-VolumesGetTest-1118799669 None] Lock "cinder-quobyte-0de6ecce-5e63-474e-b310-36cfc42a1e90" acquired by "delete_volume" :: waited 0.017s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:41 devstack sudo[102482]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d554b61b-50d9-4c19-b035-f6db5411c441 tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d55803e-4e1c-458e-aafc-3df1ad81de23 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23.6cdc6195-a520-47e2-a949-811f457ff219" returned: 0 in 0.426s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:41 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-d554b61b-50d9-4c19-b035-f6db5411c441 tempest-VolumeDependencyTests-893333359 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23.6cdc6195-a520-47e2-a949-811f457ff219 is being set with open permissions: ugo+rw Jul 30 17:02:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d554b61b-50d9-4c19-b035-f6db5411c441 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23.6cdc6195-a520-47e2-a949-811f457ff219 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:41 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[046e4a3b-d804-41cb-a5a5-07ce76c5720b]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1188a7ce-fa71-4f4d-bef8-6c04d7359b73 tempest-VolumesGetTest-1118799669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0de6ecce-5e63-474e-b310-36cfc42a1e90 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:41 devstack sudo[102489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23.6cdc6195-a520-47e2-a949-811f457ff219 Jul 30 17:02:41 devstack sudo[102489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:41 devstack sudo[102490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0de6ecce-5e63-474e-b310-36cfc42a1e90 Jul 30 17:02:41 devstack sudo[102490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:41 devstack sudo[102489]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d554b61b-50d9-4c19-b035-f6db5411c441 tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23.6cdc6195-a520-47e2-a949-811f457ff219" returned: 0 in 0.272s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d554b61b-50d9-4c19-b035-f6db5411c441 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:41 devstack sudo[102494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23.info Jul 30 17:02:41 devstack sudo[102494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:41 devstack sudo[102490]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1188a7ce-fa71-4f4d-bef8-6c04d7359b73 tempest-VolumesGetTest-1118799669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0de6ecce-5e63-474e-b310-36cfc42a1e90" returned: 0 in 0.387s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1188a7ce-fa71-4f4d-bef8-6c04d7359b73 tempest-VolumesGetTest-1118799669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0de6ecce-5e63-474e-b310-36cfc42a1e90 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:41 devstack sudo[102499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0de6ecce-5e63-474e-b310-36cfc42a1e90 Jul 30 17:02:41 devstack sudo[102499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:41 devstack sudo[102494]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d554b61b-50d9-4c19-b035-f6db5411c441 tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23.info" returned: 0 in 0.275s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:41 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-d554b61b-50d9-4c19-b035-f6db5411c441 tempest-VolumeDependencyTests-893333359 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23.info is being set with open permissions: ugo+rw Jul 30 17:02:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d554b61b-50d9-4c19-b035-f6db5411c441 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:41 devstack sudo[102502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23.info Jul 30 17:02:41 devstack sudo[102502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:41 devstack sudo[102499]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1188a7ce-fa71-4f4d-bef8-6c04d7359b73 tempest-VolumesGetTest-1118799669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0de6ecce-5e63-474e-b310-36cfc42a1e90" returned: 0 in 0.286s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:41 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-1188a7ce-fa71-4f4d-bef8-6c04d7359b73 tempest-VolumesGetTest-1118799669 None] Lock "cinder-quobyte-0de6ecce-5e63-474e-b310-36cfc42a1e90" released by "delete_volume" :: held 0.730s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:41 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-1188a7ce-fa71-4f4d-bef8-6c04d7359b73 tempest-VolumesGetTest-1118799669 None] Created reservations ['c3cbcc70-3986-48b9-9f02-6ca6ec20b389', '276fe710-96aa-4293-a8c9-4f29b0ba8eb6', '6d8a0d49-10d8-4f95-8292-df1f4ecdb007', '7186d067-f6f0-42f3-8d7f-0220989320aa'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:02:42 devstack sudo[102502]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d554b61b-50d9-4c19-b035-f6db5411c441 tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23.info" returned: 0 in 0.323s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d554b61b-50d9-4c19-b035-f6db5411c441 tempest-VolumeDependencyTests-893333359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.203s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1188a7ce-fa71-4f4d-bef8-6c04d7359b73 tempest-VolumesGetTest-1118799669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1188a7ce-fa71-4f4d-bef8-6c04d7359b73 tempest-VolumesGetTest-1118799669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:42 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-1188a7ce-fa71-4f4d-bef8-6c04d7359b73 tempest-VolumesGetTest-1118799669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:02:42 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-1188a7ce-fa71-4f4d-bef8-6c04d7359b73 tempest-VolumesGetTest-1118799669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:02:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1188a7ce-fa71-4f4d-bef8-6c04d7359b73 tempest-VolumesGetTest-1118799669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1188a7ce-fa71-4f4d-bef8-6c04d7359b73 tempest-VolumesGetTest-1118799669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:42 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-d554b61b-50d9-4c19-b035-f6db5411c441 tempest-VolumeDependencyTests-893333359 None] Create snapshot completed successfully Jul 30 17:02:42 devstack sudo[102506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:02:42 devstack sudo[102506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:42 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-03c0b4fa-aa30-470c-a688-bbdbb4219175 tempest-VolumesGetTest-1118799669 None] Acquiring lock "cinder-5547110b-4be7-4c47-b568-faca8e3833d9-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:42 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-03c0b4fa-aa30-470c-a688-bbdbb4219175 tempest-VolumesGetTest-1118799669 None] Lock "cinder-5547110b-4be7-4c47-b568-faca8e3833d9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:42 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-03c0b4fa-aa30-470c-a688-bbdbb4219175 tempest-VolumesGetTest-1118799669 None] Acquiring lock "cinder-quobyte-5547110b-4be7-4c47-b568-faca8e3833d9" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:42 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-03c0b4fa-aa30-470c-a688-bbdbb4219175 tempest-VolumesGetTest-1118799669 None] Lock "cinder-quobyte-5547110b-4be7-4c47-b568-faca8e3833d9" acquired by "delete_volume" :: waited 0.023s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:42 devstack sudo[102506]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1188a7ce-fa71-4f4d-bef8-6c04d7359b73 tempest-VolumesGetTest-1118799669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.283s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:42 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-1188a7ce-fa71-4f4d-bef8-6c04d7359b73 tempest-VolumesGetTest-1118799669 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:02:42 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed867d2-0063-47bf-8cae-4bc3f331c7be]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-03c0b4fa-aa30-470c-a688-bbdbb4219175 tempest-VolumesGetTest-1118799669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5547110b-4be7-4c47-b568-faca8e3833d9 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:42 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-1188a7ce-fa71-4f4d-bef8-6c04d7359b73 tempest-VolumesGetTest-1118799669 None] Deleted volume successfully. Jul 30 17:02:42 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-1188a7ce-fa71-4f4d-bef8-6c04d7359b73 tempest-VolumesGetTest-1118799669 None] Lock "cinder-0de6ecce-5e63-474e-b310-36cfc42a1e90-delete_volume" released by "delete_volume" :: held 1.408s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:42 devstack sudo[102510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5547110b-4be7-4c47-b568-faca8e3833d9 Jul 30 17:02:42 devstack sudo[102510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:42 devstack sudo[102510]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-03c0b4fa-aa30-470c-a688-bbdbb4219175 tempest-VolumesGetTest-1118799669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5547110b-4be7-4c47-b568-faca8e3833d9" returned: 0 in 0.412s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-03c0b4fa-aa30-470c-a688-bbdbb4219175 tempest-VolumesGetTest-1118799669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5547110b-4be7-4c47-b568-faca8e3833d9 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:42 devstack sudo[102516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5547110b-4be7-4c47-b568-faca8e3833d9 Jul 30 17:02:42 devstack sudo[102516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:43 devstack sudo[102516]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-03c0b4fa-aa30-470c-a688-bbdbb4219175 tempest-VolumesGetTest-1118799669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5547110b-4be7-4c47-b568-faca8e3833d9" returned: 0 in 0.286s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:43 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-03c0b4fa-aa30-470c-a688-bbdbb4219175 tempest-VolumesGetTest-1118799669 None] Lock "cinder-quobyte-5547110b-4be7-4c47-b568-faca8e3833d9" released by "delete_volume" :: held 0.749s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:43 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-03c0b4fa-aa30-470c-a688-bbdbb4219175 tempest-VolumesGetTest-1118799669 None] Created reservations ['8c9e0d84-9bcd-4f26-a09b-bc30b0a5b43d', '9c311fce-7493-4689-a627-6982b5e41d4f', '406d9549-a89a-4192-8011-0a6e12506701', '273b84b7-c1b8-4945-abf6-f4aade02ee24'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:02:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-03c0b4fa-aa30-470c-a688-bbdbb4219175 tempest-VolumesGetTest-1118799669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-03c0b4fa-aa30-470c-a688-bbdbb4219175 tempest-VolumesGetTest-1118799669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:43 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-03c0b4fa-aa30-470c-a688-bbdbb4219175 tempest-VolumesGetTest-1118799669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:02:43 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-03c0b4fa-aa30-470c-a688-bbdbb4219175 tempest-VolumesGetTest-1118799669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:02:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-03c0b4fa-aa30-470c-a688-bbdbb4219175 tempest-VolumesGetTest-1118799669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-03c0b4fa-aa30-470c-a688-bbdbb4219175 tempest-VolumesGetTest-1118799669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:43 devstack sudo[102519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:02:43 devstack sudo[102519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:43 devstack sudo[102519]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-03c0b4fa-aa30-470c-a688-bbdbb4219175 tempest-VolumesGetTest-1118799669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.313s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:43 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-03c0b4fa-aa30-470c-a688-bbdbb4219175 tempest-VolumesGetTest-1118799669 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:02:43 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-03c0b4fa-aa30-470c-a688-bbdbb4219175 tempest-VolumesGetTest-1118799669 None] Deleted volume successfully. Jul 30 17:02:43 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-03c0b4fa-aa30-470c-a688-bbdbb4219175 tempest-VolumesGetTest-1118799669 None] Lock "cinder-5547110b-4be7-4c47-b568-faca8e3833d9-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:43 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a20b862-5a55-4baf-8ea0-c46f59060f41 tempest-VolumeDependencyTests-893333359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:02:43 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7a20b862-5a55-4baf-8ea0-c46f59060f41 tempest-VolumeDependencyTests-893333359 None] Flow 'volume_create_manager' (02a1bffb-b533-42a1-862d-9ceb0dbe0dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:02:43 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7a20b862-5a55-4baf-8ea0-c46f59060f41 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb64a5cb-a155-4026-bec3-b1dff47ae0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:43 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7a20b862-5a55-4baf-8ea0-c46f59060f41 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb64a5cb-a155-4026-bec3-b1dff47ae0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:02:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1261968726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baaba15a-d679-4a84-b83a-105e90f197ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1142be8cf434dc9b1a32ef12a92e88b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:02:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6cdc6195-a520-47e2-a949-811f457ff219,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:02:44Z,use_quota=True,user_id='db3e9fa2901f4abe9034e8c4a4f63fb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:43 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7a20b862-5a55-4baf-8ea0-c46f59060f41 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cf8f63a-1bfc-4d43-91bf-1c929803a59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:43 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7a20b862-5a55-4baf-8ea0-c46f59060f41 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cf8f63a-1bfc-4d43-91bf-1c929803a59a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:43 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7a20b862-5a55-4baf-8ea0-c46f59060f41 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7334fc0c-1392-44cb-aed9-12293450e720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:43 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7a20b862-5a55-4baf-8ea0-c46f59060f41 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7334fc0c-1392-44cb-aed9-12293450e720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'baaba15a-d679-4a84-b83a-105e90f197ff', 'volume_name': 'volume-baaba15a-d679-4a84-b83a-105e90f197ff', 'volume_size': 1, 'snapshot_id': '6cdc6195-a520-47e2-a949-811f457ff219'}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:43 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7a20b862-5a55-4baf-8ea0-c46f59060f41 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (861640a6-3556-4564-93b8-46b71f80d30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:43 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7a20b862-5a55-4baf-8ea0-c46f59060f41 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (861640a6-3556-4564-93b8-46b71f80d30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:43 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7a20b862-5a55-4baf-8ea0-c46f59060f41 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9ab2c64-f765-489d-9505-ea7b4df96e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:43 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-7a20b862-5a55-4baf-8ea0-c46f59060f41 tempest-VolumeDependencyTests-893333359 None] Volume baaba15a-d679-4a84-b83a-105e90f197ff: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-baaba15a-d679-4a84-b83a-105e90f197ff', 'volume_size': 1, 'snapshot_id': '6cdc6195-a520-47e2-a949-811f457ff219'} Jul 30 17:02:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7a20b862-5a55-4baf-8ea0-c46f59060f41 tempest-VolumeDependencyTests-893333359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7a20b862-5a55-4baf-8ea0-c46f59060f41 tempest-VolumeDependencyTests-893333359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:43 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7a20b862-5a55-4baf-8ea0-c46f59060f41 tempest-VolumeDependencyTests-893333359 None] Acquiring lock "cinder-quobyte-6cdc6195-a520-47e2-a949-811f457ff219-baaba15a-d679-4a84-b83a-105e90f197ff" by "_create_volume_from_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:43 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7a20b862-5a55-4baf-8ea0-c46f59060f41 tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-6cdc6195-a520-47e2-a949-811f457ff219-baaba15a-d679-4a84-b83a-105e90f197ff" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:43 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7a20b862-5a55-4baf-8ea0-c46f59060f41 tempest-VolumeDependencyTests-893333359 None] Creating volume baaba15a-d679-4a84-b83a-105e90f197ff from snapshot 6cdc6195-a520-47e2-a949-811f457ff219 {{(pid=88591) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 30 17:02:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7a20b862-5a55-4baf-8ea0-c46f59060f41 tempest-VolumeDependencyTests-893333359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7a20b862-5a55-4baf-8ea0-c46f59060f41 tempest-VolumeDependencyTests-893333359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:43 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7a20b862-5a55-4baf-8ea0-c46f59060f41 tempest-VolumeDependencyTests-893333359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:02:43 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7a20b862-5a55-4baf-8ea0-c46f59060f41 tempest-VolumeDependencyTests-893333359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:02:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7a20b862-5a55-4baf-8ea0-c46f59060f41 tempest-VolumeDependencyTests-893333359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:43 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7a20b862-5a55-4baf-8ea0-c46f59060f41 tempest-VolumeDependencyTests-893333359 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:02:43 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7a20b862-5a55-4baf-8ea0-c46f59060f41 tempest-VolumeDependencyTests-893333359 None] Acquiring lock "cinder-quobyte-baaba15a-d679-4a84-b83a-105e90f197ff" by "_copy_volume_from_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:43 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7a20b862-5a55-4baf-8ea0-c46f59060f41 tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-baaba15a-d679-4a84-b83a-105e90f197ff" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:43 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7a20b862-5a55-4baf-8ea0-c46f59060f41 tempest-VolumeDependencyTests-893333359 None] snapshot: 6cdc6195-a520-47e2-a949-811f457ff219, volume: baaba15a-d679-4a84-b83a-105e90f197ff, {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 17:02:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7a20b862-5a55-4baf-8ea0-c46f59060f41 tempest-VolumeDependencyTests-893333359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7a20b862-5a55-4baf-8ea0-c46f59060f41 tempest-VolumeDependencyTests-893333359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:43 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7a20b862-5a55-4baf-8ea0-c46f59060f41 tempest-VolumeDependencyTests-893333359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:02:43 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7a20b862-5a55-4baf-8ea0-c46f59060f41 tempest-VolumeDependencyTests-893333359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:02:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7a20b862-5a55-4baf-8ea0-c46f59060f41 tempest-VolumeDependencyTests-893333359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:43 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ad42c9-e09e-47f1-af6a-9b4ffc6a80d0]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7a20b862-5a55-4baf-8ea0-c46f59060f41 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23.6cdc6195-a520-47e2-a949-811f457ff219 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:43 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b63fd54-3b8a-43d0-8a6a-83b5fbc7190b tempest-VolumesGetTest-1118799669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:02:44 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5b63fd54-3b8a-43d0-8a6a-83b5fbc7190b tempest-VolumesGetTest-1118799669 None] Flow 'volume_create_manager' (2b6afb18-7401-4b06-a808-d1ed11ee8f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:02:44 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5b63fd54-3b8a-43d0-8a6a-83b5fbc7190b tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70d57c39-4745-45cd-a886-821afd0cab51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:44 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5b63fd54-3b8a-43d0-8a6a-83b5fbc7190b tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70d57c39-4745-45cd-a886-821afd0cab51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:02:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-934189673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9dcecfb-cb74-419b-84d8-f503e403c5ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c6e94e27fa4ce98248b491a048f03e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:02:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:02:44Z,use_quota=True,user_id='58b251ff552e40e38310aedc71e0c3f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:44 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5b63fd54-3b8a-43d0-8a6a-83b5fbc7190b tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42235a4c-bc7c-488b-a562-de69bf672a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:44 devstack sudo[102522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23.6cdc6195-a520-47e2-a949-811f457ff219 Jul 30 17:02:44 devstack sudo[102522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:44 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5b63fd54-3b8a-43d0-8a6a-83b5fbc7190b tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42235a4c-bc7c-488b-a562-de69bf672a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:44 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5b63fd54-3b8a-43d0-8a6a-83b5fbc7190b tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (641079cd-0cfc-4a7c-88aa-fae5c2ff9731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:44 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5b63fd54-3b8a-43d0-8a6a-83b5fbc7190b tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (641079cd-0cfc-4a7c-88aa-fae5c2ff9731) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9dcecfb-cb74-419b-84d8-f503e403c5ed', 'volume_name': 'volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:44 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5b63fd54-3b8a-43d0-8a6a-83b5fbc7190b tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa3f4830-434b-4ebc-9919-0e8e9cf1272d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:44 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5b63fd54-3b8a-43d0-8a6a-83b5fbc7190b tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa3f4830-434b-4ebc-9919-0e8e9cf1272d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:44 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5b63fd54-3b8a-43d0-8a6a-83b5fbc7190b tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad0b8129-21b0-4d0b-aaf1-090a7964fb8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:44 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-5b63fd54-3b8a-43d0-8a6a-83b5fbc7190b tempest-VolumesGetTest-1118799669 None] Volume c9dcecfb-cb74-419b-84d8-f503e403c5ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed', 'volume_size': 1} Jul 30 17:02:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5b63fd54-3b8a-43d0-8a6a-83b5fbc7190b tempest-VolumesGetTest-1118799669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:44 devstack sudo[102522]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7a20b862-5a55-4baf-8ea0-c46f59060f41 tempest-VolumeDependencyTests-893333359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23.6cdc6195-a520-47e2-a949-811f457ff219" returned: 0 in 0.432s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:44 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-7a20b862-5a55-4baf-8ea0-c46f59060f41 tempest-VolumeDependencyTests-893333359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d55803e-4e1c-458e-aafc-3df1ad81de23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:02:44 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff75964f-888d-4f4f-ba0e-f91bb2e44b45]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7a20b862-5a55-4baf-8ea0-c46f59060f41 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:44 devstack sudo[102527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23 Jul 30 17:02:44 devstack sudo[102527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:44 devstack sudo[102527]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7a20b862-5a55-4baf-8ea0-c46f59060f41 tempest-VolumeDependencyTests-893333359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23" returned: 0 in 0.393s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:44 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7a20b862-5a55-4baf-8ea0-c46f59060f41 tempest-VolumeDependencyTests-893333359 None] will copy from snapshot at /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23 {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 17:02:44 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7a20b862-5a55-4baf-8ea0-c46f59060f41 tempest-VolumeDependencyTests-893333359 None] Creating direct copy from snapshot {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 17:02:44 devstack cinder-volume[88591]: DEBUG cinder.utils [None req-7a20b862-5a55-4baf-8ea0-c46f59060f41 tempest-VolumeDependencyTests-893333359 None] Path /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff not found in is_blk_device check {{(pid=88591) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 17:02:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7a20b862-5a55-4baf-8ea0-c46f59060f41 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:44 devstack sudo[102532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff Jul 30 17:02:44 devstack sudo[102532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:45 devstack sudo[102532]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7a20b862-5a55-4baf-8ea0-c46f59060f41 tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff" returned: 0 in 0.509s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:45 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-7a20b862-5a55-4baf-8ea0-c46f59060f41 tempest-VolumeDependencyTests-893333359 None] Image conversion details: src /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff {{(pid=88591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 17:02:45 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-7a20b862-5a55-4baf-8ea0-c46f59060f41 tempest-VolumeDependencyTests-893333359 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 30 17:02:45 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-7a20b862-5a55-4baf-8ea0-c46f59060f41 tempest-VolumeDependencyTests-893333359 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff is being set with open permissions: ugo+rw Jul 30 17:02:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7a20b862-5a55-4baf-8ea0-c46f59060f41 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:45 devstack sudo[102539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff Jul 30 17:02:45 devstack sudo[102539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:45 devstack sudo[102539]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7a20b862-5a55-4baf-8ea0-c46f59060f41 tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff" returned: 0 in 0.258s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:45 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7a20b862-5a55-4baf-8ea0-c46f59060f41 tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-baaba15a-d679-4a84-b83a-105e90f197ff" released by "_copy_volume_from_snapshot" :: held 1.732s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:45 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7a20b862-5a55-4baf-8ea0-c46f59060f41 tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-6cdc6195-a520-47e2-a949-811f457ff219-baaba15a-d679-4a84-b83a-105e90f197ff" released by "_create_volume_from_snapshot" :: held 1.815s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7a20b862-5a55-4baf-8ea0-c46f59060f41 tempest-VolumeDependencyTests-893333359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 1.839s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5b63fd54-3b8a-43d0-8a6a-83b5fbc7190b tempest-VolumesGetTest-1118799669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.516s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:45 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-5b63fd54-3b8a-43d0-8a6a-83b5fbc7190b tempest-VolumesGetTest-1118799669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:02:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-934189673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9dcecfb-cb74-419b-84d8-f503e403c5ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c6e94e27fa4ce98248b491a048f03e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:02:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:02:44Z,use_quota=True,user_id='58b251ff552e40e38310aedc71e0c3f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:02:45 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-5b63fd54-3b8a-43d0-8a6a-83b5fbc7190b tempest-VolumesGetTest-1118799669 None] Creating volume c9dcecfb-cb74-419b-84d8-f503e403c5ed {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:02:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5b63fd54-3b8a-43d0-8a6a-83b5fbc7190b tempest-VolumesGetTest-1118799669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5b63fd54-3b8a-43d0-8a6a-83b5fbc7190b tempest-VolumesGetTest-1118799669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:45 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-5b63fd54-3b8a-43d0-8a6a-83b5fbc7190b tempest-VolumesGetTest-1118799669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:02:45 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-5b63fd54-3b8a-43d0-8a6a-83b5fbc7190b tempest-VolumesGetTest-1118799669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:02:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5b63fd54-3b8a-43d0-8a6a-83b5fbc7190b tempest-VolumesGetTest-1118799669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:45 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-5b63fd54-3b8a-43d0-8a6a-83b5fbc7190b tempest-VolumesGetTest-1118799669 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:02:45 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-5b63fd54-3b8a-43d0-8a6a-83b5fbc7190b tempest-VolumesGetTest-1118799669 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:02:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5b63fd54-3b8a-43d0-8a6a-83b5fbc7190b tempest-VolumesGetTest-1118799669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:45 devstack sudo[102542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed 1073741824 Jul 30 17:02:45 devstack sudo[102542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:45 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7a20b862-5a55-4baf-8ea0-c46f59060f41 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9ab2c64-f765-489d-9505-ea7b4df96e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-baaba15a-d679-4a84-b83a-105e90f197ff', 'volume_size': 1, 'snapshot_id': '6cdc6195-a520-47e2-a949-811f457ff219'}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:45 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7a20b862-5a55-4baf-8ea0-c46f59060f41 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f68df648-9010-43ba-b256-738c083fcb01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:45 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-7a20b862-5a55-4baf-8ea0-c46f59060f41 tempest-VolumeDependencyTests-893333359 None] Volume volume-baaba15a-d679-4a84-b83a-105e90f197ff (baaba15a-d679-4a84-b83a-105e90f197ff): created successfully Jul 30 17:02:45 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7a20b862-5a55-4baf-8ea0-c46f59060f41 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f68df648-9010-43ba-b256-738c083fcb01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:45 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7a20b862-5a55-4baf-8ea0-c46f59060f41 tempest-VolumeDependencyTests-893333359 None] Flow 'volume_create_manager' (02a1bffb-b533-42a1-862d-9ceb0dbe0dad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:02:45 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-7a20b862-5a55-4baf-8ea0-c46f59060f41 tempest-VolumeDependencyTests-893333359 None] Created volume successfully. Jul 30 17:02:46 devstack sudo[102542]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5b63fd54-3b8a-43d0-8a6a-83b5fbc7190b tempest-VolumesGetTest-1118799669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed 1073741824" returned: 0 in 0.541s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5b63fd54-3b8a-43d0-8a6a-83b5fbc7190b tempest-VolumesGetTest-1118799669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:46 devstack sudo[102548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed Jul 30 17:02:46 devstack sudo[102548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:46 devstack sudo[102548]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5b63fd54-3b8a-43d0-8a6a-83b5fbc7190b tempest-VolumesGetTest-1118799669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed" returned: 0 in 0.254s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:46 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-5b63fd54-3b8a-43d0-8a6a-83b5fbc7190b tempest-VolumesGetTest-1118799669 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:02:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5b63fd54-3b8a-43d0-8a6a-83b5fbc7190b tempest-VolumesGetTest-1118799669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:46 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5b63fd54-3b8a-43d0-8a6a-83b5fbc7190b tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad0b8129-21b0-4d0b-aaf1-090a7964fb8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:46 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5b63fd54-3b8a-43d0-8a6a-83b5fbc7190b tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db4b1f66-263d-4e47-ba8c-006c86ad6491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:46 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-5b63fd54-3b8a-43d0-8a6a-83b5fbc7190b tempest-VolumesGetTest-1118799669 None] Volume volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed (c9dcecfb-cb74-419b-84d8-f503e403c5ed): created successfully Jul 30 17:02:46 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5b63fd54-3b8a-43d0-8a6a-83b5fbc7190b tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db4b1f66-263d-4e47-ba8c-006c86ad6491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:46 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5b63fd54-3b8a-43d0-8a6a-83b5fbc7190b tempest-VolumesGetTest-1118799669 None] Flow 'volume_create_manager' (2b6afb18-7401-4b06-a808-d1ed11ee8f71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:02:46 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-5b63fd54-3b8a-43d0-8a6a-83b5fbc7190b tempest-VolumesGetTest-1118799669 None] Created volume successfully. Jul 30 17:02:47 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:02:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] Flow 'volume_create_manager' (751176c3-a017-44ed-831f-69005fa45f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:02:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (121a5eb9-ff52-4592-be55-367fb90566da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (121a5eb9-ff52-4592-be55-367fb90566da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:02:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-927564782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0934f7d3-5df7-47ba-b440-a5064b6884ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1142be8cf434dc9b1a32ef12a92e88b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:02:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=baaba15a-d679-4a84-b83a-105e90f197ff,status='creating',terminated_at=None,updated_at=2026-07-30T15:02:47Z,use_quota=True,user_id='db3e9fa2901f4abe9034e8c4a4f63fb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6388bff7-a750-4b22-a343-2b9c21c18968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6388bff7-a750-4b22-a343-2b9c21c18968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aadff28e-079a-4239-8e2e-5a4aa164551a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aadff28e-079a-4239-8e2e-5a4aa164551a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0934f7d3-5df7-47ba-b440-a5064b6884ec', 'volume_name': 'volume-0934f7d3-5df7-47ba-b440-a5064b6884ec', 'volume_size': 1, 'source_volid': 'baaba15a-d679-4a84-b83a-105e90f197ff', 'source_volstatus': 'available'}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad3deb78-0575-477a-8c2c-c00315a478b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad3deb78-0575-477a-8c2c-c00315a478b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44ea00c8-184e-451e-ae58-4d6e48bf94fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:47 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] Volume 0934f7d3-5df7-47ba-b440-a5064b6884ec: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0934f7d3-5df7-47ba-b440-a5064b6884ec', 'volume_size': 1, 'source_volid': 'baaba15a-d679-4a84-b83a-105e90f197ff', 'source_volstatus': 'available'} Jul 30 17:02:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:47 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] Cloning volume baaba15a-d679-4a84-b83a-105e90f197ff to volume 0934f7d3-5df7-47ba-b440-a5064b6884ec Jul 30 17:02:47 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] Creating offline snapshot 0544cb22-6f0a-46ef-beb9-422fa80212d4 of volume baaba15a-d679-4a84-b83a-105e90f197ff {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:02:47 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[eedae48c-f6bd-4e9b-a7ed-3220dd973cae]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:47 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d7c1f08-49ac-4f2c-b3ff-7d1c887f4cbb tempest-VolumesSnapshotListTestJSON-700740194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:02:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7d7c1f08-49ac-4f2c-b3ff-7d1c887f4cbb tempest-VolumesSnapshotListTestJSON-700740194 None] Flow 'volume_create_manager' (882bdb54-7572-4d4c-a52e-b46acc8cb213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:02:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7d7c1f08-49ac-4f2c-b3ff-7d1c887f4cbb tempest-VolumesSnapshotListTestJSON-700740194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e95f5f1b-83be-4bb3-bbe5-ac9d59b677fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7d7c1f08-49ac-4f2c-b3ff-7d1c887f4cbb tempest-VolumesSnapshotListTestJSON-700740194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e95f5f1b-83be-4bb3-bbe5-ac9d59b677fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:02:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1687159243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3160d2a-b30b-416b-a02e-429f73e00900,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f938d9400a8a4ff9984fe51d4098fc9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:02:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:02:47Z,use_quota=True,user_id='b67cde1e88164a24821d13b102f27a6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7d7c1f08-49ac-4f2c-b3ff-7d1c887f4cbb tempest-VolumesSnapshotListTestJSON-700740194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d176b21-d22d-4ed5-a750-7a550e728884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7d7c1f08-49ac-4f2c-b3ff-7d1c887f4cbb tempest-VolumesSnapshotListTestJSON-700740194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d176b21-d22d-4ed5-a750-7a550e728884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7d7c1f08-49ac-4f2c-b3ff-7d1c887f4cbb tempest-VolumesSnapshotListTestJSON-700740194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ede4bbd-ae50-4a3a-995f-47c73f96eae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7d7c1f08-49ac-4f2c-b3ff-7d1c887f4cbb tempest-VolumesSnapshotListTestJSON-700740194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ede4bbd-ae50-4a3a-995f-47c73f96eae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3160d2a-b30b-416b-a02e-429f73e00900', 'volume_name': 'volume-b3160d2a-b30b-416b-a02e-429f73e00900', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7d7c1f08-49ac-4f2c-b3ff-7d1c887f4cbb tempest-VolumesSnapshotListTestJSON-700740194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (092735da-7776-4488-9d56-a0ef685ede26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7d7c1f08-49ac-4f2c-b3ff-7d1c887f4cbb tempest-VolumesSnapshotListTestJSON-700740194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (092735da-7776-4488-9d56-a0ef685ede26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7d7c1f08-49ac-4f2c-b3ff-7d1c887f4cbb tempest-VolumesSnapshotListTestJSON-700740194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (216a75d5-ee8c-4272-9e4a-aa5de2a95dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:47 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-7d7c1f08-49ac-4f2c-b3ff-7d1c887f4cbb tempest-VolumesSnapshotListTestJSON-700740194 None] Volume b3160d2a-b30b-416b-a02e-429f73e00900: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3160d2a-b30b-416b-a02e-429f73e00900', 'volume_size': 1} Jul 30 17:02:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7d7c1f08-49ac-4f2c-b3ff-7d1c887f4cbb tempest-VolumesSnapshotListTestJSON-700740194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:47 devstack sudo[102565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff Jul 30 17:02:47 devstack sudo[102565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:47 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:02:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] Flow 'volume_create_manager' (67cc8bbc-ddaa-4b63-803c-2138d765da22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:02:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e5e90bb-f130-4d63-b58d-2a4356dc2e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e5e90bb-f130-4d63-b58d-2a4356dc2e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:02:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-759941326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=116c8fd7-7bb4-4ad6-b7ab-81d7be29b8b7,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='19c6e94e27fa4ce98248b491a048f03e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=c9dcecfb-cb74-419b-84d8-f503e403c5ed,status='creating',terminated_at=None,updated_at=2026-07-30T15:02:48Z,use_quota=True,user_id='58b251ff552e40e38310aedc71e0c3f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61e0f3a7-cf11-43b8-80e2-9889452c7bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61e0f3a7-cf11-43b8-80e2-9889452c7bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0956041c-8b35-438c-b339-d4f103075653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0956041c-8b35-438c-b339-d4f103075653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '116c8fd7-7bb4-4ad6-b7ab-81d7be29b8b7', 'volume_name': 'volume-116c8fd7-7bb4-4ad6-b7ab-81d7be29b8b7', 'volume_size': 1, 'source_volid': 'c9dcecfb-cb74-419b-84d8-f503e403c5ed', 'source_volstatus': 'available'}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ac749e1-01f0-42ee-bfce-70e47c404025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ac749e1-01f0-42ee-bfce-70e47c404025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a749b765-f748-4196-a4c6-f1014bed7b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:47 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] Volume 116c8fd7-7bb4-4ad6-b7ab-81d7be29b8b7: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-116c8fd7-7bb4-4ad6-b7ab-81d7be29b8b7', 'volume_size': 1, 'source_volid': 'c9dcecfb-cb74-419b-84d8-f503e403c5ed', 'source_volstatus': 'available'} Jul 30 17:02:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:47 devstack sudo[102565]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff" returned: 0 in 0.467s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff.0544cb22-6f0a-46ef-beb9-422fa80212d4 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:48 devstack sudo[102592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff.0544cb22-6f0a-46ef-beb9-422fa80212d4 1G Jul 30 17:02:48 devstack sudo[102592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:48 devstack sudo[102592]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff.0544cb22-6f0a-46ef-beb9-422fa80212d4 1G" returned: 0 in 0.417s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-baaba15a-d679-4a84-b83a-105e90f197ff -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff.0544cb22-6f0a-46ef-beb9-422fa80212d4 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:48 devstack sudo[102598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-baaba15a-d679-4a84-b83a-105e90f197ff -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff.0544cb22-6f0a-46ef-beb9-422fa80212d4 Jul 30 17:02:48 devstack sudo[102598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:48 devstack sudo[102598]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-baaba15a-d679-4a84-b83a-105e90f197ff -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff.0544cb22-6f0a-46ef-beb9-422fa80212d4" returned: 0 in 0.285s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:48 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff.0544cb22-6f0a-46ef-beb9-422fa80212d4 is being set with open permissions: ugo+rw Jul 30 17:02:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff.0544cb22-6f0a-46ef-beb9-422fa80212d4 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:48 devstack sudo[102603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff.0544cb22-6f0a-46ef-beb9-422fa80212d4 Jul 30 17:02:48 devstack sudo[102603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:48 devstack sudo[102603]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff.0544cb22-6f0a-46ef-beb9-422fa80212d4" returned: 0 in 0.242s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:48 devstack sudo[102606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff.info Jul 30 17:02:48 devstack sudo[102606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:49 devstack sudo[102606]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff.info" returned: 0 in 0.249s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:49 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff.info is being set with open permissions: ugo+rw Jul 30 17:02:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:49 devstack sudo[102609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff.info Jul 30 17:02:49 devstack sudo[102609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:49 devstack sudo[102609]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff.info" returned: 0 in 0.248s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:49 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] Acquiring lock "cinder-quobyte-0934f7d3-5df7-47ba-b440-a5064b6884ec" by "_copy_volume_from_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:49 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-0934f7d3-5df7-47ba-b440-a5064b6884ec" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:49 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] snapshot: 0544cb22-6f0a-46ef-beb9-422fa80212d4, volume: 0934f7d3-5df7-47ba-b440-a5064b6884ec, {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 17:02:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:49 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:02:49 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:02:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:49 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c7fa0e-0a82-447d-870b-5cd375c0f530]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff.0544cb22-6f0a-46ef-beb9-422fa80212d4 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:49 devstack sudo[102612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff.0544cb22-6f0a-46ef-beb9-422fa80212d4 Jul 30 17:02:49 devstack sudo[102612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:49 devstack sudo[102612]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff.0544cb22-6f0a-46ef-beb9-422fa80212d4" returned: 0 in 0.363s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:49 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-baaba15a-d679-4a84-b83a-105e90f197ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:02:49 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9f3be7-14f2-440d-b38c-3989ede7ed5d]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:50 devstack sudo[102618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff Jul 30 17:02:50 devstack sudo[102618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:50 devstack sudo[102618]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff" returned: 0 in 0.348s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:50 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] will copy from snapshot at /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 17:02:50 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] Creating direct copy from snapshot {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 17:02:50 devstack cinder-volume[88591]: DEBUG cinder.utils [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] Path /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0934f7d3-5df7-47ba-b440-a5064b6884ec not found in is_blk_device check {{(pid=88591) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 17:02:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0934f7d3-5df7-47ba-b440-a5064b6884ec {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:50 devstack sudo[102623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0934f7d3-5df7-47ba-b440-a5064b6884ec Jul 30 17:02:50 devstack sudo[102623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:50 devstack sudo[102623]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0934f7d3-5df7-47ba-b440-a5064b6884ec" returned: 0 in 0.447s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:50 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] Image conversion details: src /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0934f7d3-5df7-47ba-b440-a5064b6884ec {{(pid=88591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 17:02:50 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 30 17:02:50 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0934f7d3-5df7-47ba-b440-a5064b6884ec is being set with open permissions: ugo+rw Jul 30 17:02:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0934f7d3-5df7-47ba-b440-a5064b6884ec {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:50 devstack sudo[102635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0934f7d3-5df7-47ba-b440-a5064b6884ec Jul 30 17:02:50 devstack sudo[102635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:50 devstack sudo[102635]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0934f7d3-5df7-47ba-b440-a5064b6884ec" returned: 0 in 0.249s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:50 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-0934f7d3-5df7-47ba-b440-a5064b6884ec" released by "_copy_volume_from_snapshot" :: held 1.480s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:51 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] Acquiring lock "cinder-quobyte-0544cb22-6f0a-46ef-beb9-422fa80212d4" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:51 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-0544cb22-6f0a-46ef-beb9-422fa80212d4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:51 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] Deleting offline snapshot 0544cb22-6f0a-46ef-beb9-422fa80212d4 of volume baaba15a-d679-4a84-b83a-105e90f197ff {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:02:51 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] snapshot_file for this snap is: volume-baaba15a-d679-4a84-b83a-105e90f197ff.0544cb22-6f0a-46ef-beb9-422fa80212d4 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:02:51 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e4c7da-b5a9-42eb-9ef2-6858f2e7821d]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff.0544cb22-6f0a-46ef-beb9-422fa80212d4 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:51 devstack sudo[102638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff.0544cb22-6f0a-46ef-beb9-422fa80212d4 Jul 30 17:02:51 devstack sudo[102638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:51 devstack sudo[102638]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff.0544cb22-6f0a-46ef-beb9-422fa80212d4" returned: 0 in 0.354s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:51 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-baaba15a-d679-4a84-b83a-105e90f197ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:02:51 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84276b3-493a-4e1f-8b9f-6e21a048cdc0]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:51 devstack sudo[102643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff Jul 30 17:02:51 devstack sudo[102643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:51 devstack sudo[102643]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff" returned: 0 in 0.366s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff.0544cb22-6f0a-46ef-beb9-422fa80212d4 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:51 devstack sudo[102648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff.0544cb22-6f0a-46ef-beb9-422fa80212d4 Jul 30 17:02:51 devstack sudo[102648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:52 devstack sudo[102648]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff.0544cb22-6f0a-46ef-beb9-422fa80212d4" returned: 0 in 0.328s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff.0544cb22-6f0a-46ef-beb9-422fa80212d4 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:52 devstack sudo[102654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff.0544cb22-6f0a-46ef-beb9-422fa80212d4 Jul 30 17:02:52 devstack sudo[102654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:52 devstack sudo[102654]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff.0544cb22-6f0a-46ef-beb9-422fa80212d4" returned: 0 in 0.244s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:52 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-0544cb22-6f0a-46ef-beb9-422fa80212d4" released by "_delete_snapshot" :: held 1.396s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 5.039s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7d7c1f08-49ac-4f2c-b3ff-7d1c887f4cbb tempest-VolumesSnapshotListTestJSON-700740194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.811s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:52 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7d7c1f08-49ac-4f2c-b3ff-7d1c887f4cbb tempest-VolumesSnapshotListTestJSON-700740194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:02:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1687159243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3160d2a-b30b-416b-a02e-429f73e00900,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f938d9400a8a4ff9984fe51d4098fc9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:02:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:02:47Z,use_quota=True,user_id='b67cde1e88164a24821d13b102f27a6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:02:52 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-7d7c1f08-49ac-4f2c-b3ff-7d1c887f4cbb tempest-VolumesSnapshotListTestJSON-700740194 None] Creating volume b3160d2a-b30b-416b-a02e-429f73e00900 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:02:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7d7c1f08-49ac-4f2c-b3ff-7d1c887f4cbb tempest-VolumesSnapshotListTestJSON-700740194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7d7c1f08-49ac-4f2c-b3ff-7d1c887f4cbb tempest-VolumesSnapshotListTestJSON-700740194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:52 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7d7c1f08-49ac-4f2c-b3ff-7d1c887f4cbb tempest-VolumesSnapshotListTestJSON-700740194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:02:52 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7d7c1f08-49ac-4f2c-b3ff-7d1c887f4cbb tempest-VolumesSnapshotListTestJSON-700740194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:02:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7d7c1f08-49ac-4f2c-b3ff-7d1c887f4cbb tempest-VolumesSnapshotListTestJSON-700740194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:52 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7d7c1f08-49ac-4f2c-b3ff-7d1c887f4cbb tempest-VolumesSnapshotListTestJSON-700740194 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:02:52 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-7d7c1f08-49ac-4f2c-b3ff-7d1c887f4cbb tempest-VolumesSnapshotListTestJSON-700740194 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:02:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7d7c1f08-49ac-4f2c-b3ff-7d1c887f4cbb tempest-VolumesSnapshotListTestJSON-700740194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44ea00c8-184e-451e-ae58-4d6e48bf94fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0934f7d3-5df7-47ba-b440-a5064b6884ec', 'volume_size': 1, 'source_volid': 'baaba15a-d679-4a84-b83a-105e90f197ff', 'source_volstatus': 'available'}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:52 devstack sudo[102657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900 1073741824 Jul 30 17:02:52 devstack sudo[102657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93674687-7734-4a87-8155-e940828b5d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:52 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] Volume volume-0934f7d3-5df7-47ba-b440-a5064b6884ec (0934f7d3-5df7-47ba-b440-a5064b6884ec): created successfully Jul 30 17:02:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93674687-7734-4a87-8155-e940828b5d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] Flow 'volume_create_manager' (751176c3-a017-44ed-831f-69005fa45f07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:02:52 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-b277c579-7560-4574-9d16-9639689497df tempest-VolumeDependencyTests-893333359 None] Created volume successfully. Jul 30 17:02:52 devstack sudo[102657]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7d7c1f08-49ac-4f2c-b3ff-7d1c887f4cbb tempest-VolumesSnapshotListTestJSON-700740194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900 1073741824" returned: 0 in 0.429s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7d7c1f08-49ac-4f2c-b3ff-7d1c887f4cbb tempest-VolumesSnapshotListTestJSON-700740194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:53 devstack sudo[102663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900 Jul 30 17:02:53 devstack sudo[102663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:53 devstack sudo[102663]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7d7c1f08-49ac-4f2c-b3ff-7d1c887f4cbb tempest-VolumesSnapshotListTestJSON-700740194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900" returned: 0 in 0.252s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:53 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7d7c1f08-49ac-4f2c-b3ff-7d1c887f4cbb tempest-VolumesSnapshotListTestJSON-700740194 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:02:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7d7c1f08-49ac-4f2c-b3ff-7d1c887f4cbb tempest-VolumesSnapshotListTestJSON-700740194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 5.253s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:53 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] Cloning volume c9dcecfb-cb74-419b-84d8-f503e403c5ed to volume 116c8fd7-7bb4-4ad6-b7ab-81d7be29b8b7 Jul 30 17:02:53 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7d7c1f08-49ac-4f2c-b3ff-7d1c887f4cbb tempest-VolumesSnapshotListTestJSON-700740194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (216a75d5-ee8c-4272-9e4a-aa5de2a95dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3160d2a-b30b-416b-a02e-429f73e00900', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:53 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7d7c1f08-49ac-4f2c-b3ff-7d1c887f4cbb tempest-VolumesSnapshotListTestJSON-700740194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a924b363-a38e-416e-81b4-f3d6f43f6a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:02:53 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-7d7c1f08-49ac-4f2c-b3ff-7d1c887f4cbb tempest-VolumesSnapshotListTestJSON-700740194 None] Volume volume-b3160d2a-b30b-416b-a02e-429f73e00900 (b3160d2a-b30b-416b-a02e-429f73e00900): created successfully Jul 30 17:02:53 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7d7c1f08-49ac-4f2c-b3ff-7d1c887f4cbb tempest-VolumesSnapshotListTestJSON-700740194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a924b363-a38e-416e-81b4-f3d6f43f6a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:02:53 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7d7c1f08-49ac-4f2c-b3ff-7d1c887f4cbb tempest-VolumesSnapshotListTestJSON-700740194 None] Flow 'volume_create_manager' (882bdb54-7572-4d4c-a52e-b46acc8cb213) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:02:53 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] Creating offline snapshot 0dbb0147-8497-4db6-9674-b8b0b47f312b of volume c9dcecfb-cb74-419b-84d8-f503e403c5ed {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:02:53 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-7d7c1f08-49ac-4f2c-b3ff-7d1c887f4cbb tempest-VolumesSnapshotListTestJSON-700740194 None] Created volume successfully. Jul 30 17:02:53 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca4b78f-4afc-44f5-82e5-398477f6ca59]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:53 devstack sudo[102666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed Jul 30 17:02:53 devstack sudo[102666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:53 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-427eeef4-68e9-4eac-a76b-f9a9285a1bc0 tempest-VolumeDependencyTests-893333359 None] Acquiring lock "cinder-dbb2ae2a-a000-40bf-91e9-2ebc0705d1c4-delete_snapshot" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:53 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-427eeef4-68e9-4eac-a76b-f9a9285a1bc0 tempest-VolumeDependencyTests-893333359 None] Lock "cinder-dbb2ae2a-a000-40bf-91e9-2ebc0705d1c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:53 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-427eeef4-68e9-4eac-a76b-f9a9285a1bc0 tempest-VolumeDependencyTests-893333359 None] Acquiring lock "cinder-quobyte-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:53 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-427eeef4-68e9-4eac-a76b-f9a9285a1bc0 tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:53 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-427eeef4-68e9-4eac-a76b-f9a9285a1bc0 tempest-VolumeDependencyTests-893333359 None] Acquiring lock "cinder-quobyte-dbb2ae2a-a000-40bf-91e9-2ebc0705d1c4" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:53 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-427eeef4-68e9-4eac-a76b-f9a9285a1bc0 tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-dbb2ae2a-a000-40bf-91e9-2ebc0705d1c4" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:53 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-427eeef4-68e9-4eac-a76b-f9a9285a1bc0 tempest-VolumeDependencyTests-893333359 None] Deleting offline snapshot dbb2ae2a-a000-40bf-91e9-2ebc0705d1c4 of volume fac817aa-2523-4c4c-a5bd-0078fb2f0e4d {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:02:53 devstack sudo[102666]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:53 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-427eeef4-68e9-4eac-a76b-f9a9285a1bc0 tempest-VolumeDependencyTests-893333359 None] snapshot_file for this snap is: volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d.dbb2ae2a-a000-40bf-91e9-2ebc0705d1c4 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:02:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed" returned: 0 in 0.398s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed.0dbb0147-8497-4db6-9674-b8b0b47f312b 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:53 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1223500d-bbd8-44ed-8fd5-8f12cabbc500]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-427eeef4-68e9-4eac-a76b-f9a9285a1bc0 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d.dbb2ae2a-a000-40bf-91e9-2ebc0705d1c4 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:53 devstack sudo[102673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed.0dbb0147-8497-4db6-9674-b8b0b47f312b 1G Jul 30 17:02:53 devstack sudo[102673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:53 devstack sudo[102674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d.dbb2ae2a-a000-40bf-91e9-2ebc0705d1c4 Jul 30 17:02:53 devstack sudo[102674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2bb036d4-3619-424d-94b2-6e0c63c64a85 tempest-VolumesSnapshotListTestJSON-700740194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:54 devstack sudo[102674]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-427eeef4-68e9-4eac-a76b-f9a9285a1bc0 tempest-VolumeDependencyTests-893333359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d.dbb2ae2a-a000-40bf-91e9-2ebc0705d1c4" returned: 0 in 0.488s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:54 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-427eeef4-68e9-4eac-a76b-f9a9285a1bc0 tempest-VolumeDependencyTests-893333359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:02:54 devstack sudo[102673]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed.0dbb0147-8497-4db6-9674-b8b0b47f312b 1G" returned: 0 in 0.528s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed.0dbb0147-8497-4db6-9674-b8b0b47f312b {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:54 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[35939931-cf4f-43d0-830f-3f7e6a61e4cd]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-427eeef4-68e9-4eac-a76b-f9a9285a1bc0 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:54 devstack sudo[102684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed.0dbb0147-8497-4db6-9674-b8b0b47f312b Jul 30 17:02:54 devstack sudo[102684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:54 devstack sudo[102685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d Jul 30 17:02:54 devstack sudo[102685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:54 devstack sudo[102684]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed.0dbb0147-8497-4db6-9674-b8b0b47f312b" returned: 0 in 0.322s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:54 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed.0dbb0147-8497-4db6-9674-b8b0b47f312b is being set with open permissions: ugo+rw Jul 30 17:02:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed.0dbb0147-8497-4db6-9674-b8b0b47f312b {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:54 devstack sudo[102691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed.0dbb0147-8497-4db6-9674-b8b0b47f312b Jul 30 17:02:54 devstack sudo[102691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:54 devstack sudo[102691]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed.0dbb0147-8497-4db6-9674-b8b0b47f312b" returned: 0 in 0.261s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:54 devstack sudo[102685]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-427eeef4-68e9-4eac-a76b-f9a9285a1bc0 tempest-VolumeDependencyTests-893333359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d" returned: 0 in 0.621s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-427eeef4-68e9-4eac-a76b-f9a9285a1bc0 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d.dbb2ae2a-a000-40bf-91e9-2ebc0705d1c4 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:54 devstack sudo[102697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed.info Jul 30 17:02:54 devstack sudo[102697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:54 devstack sudo[102699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d.dbb2ae2a-a000-40bf-91e9-2ebc0705d1c4 Jul 30 17:02:54 devstack sudo[102699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:55 devstack sudo[102697]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed.info" returned: 0 in 0.268s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:55 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed.info is being set with open permissions: ugo+rw Jul 30 17:02:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:55 devstack sudo[102704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed.info Jul 30 17:02:55 devstack sudo[102704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:55 devstack sudo[102699]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-427eeef4-68e9-4eac-a76b-f9a9285a1bc0 tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d.dbb2ae2a-a000-40bf-91e9-2ebc0705d1c4" returned: 0 in 0.383s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-427eeef4-68e9-4eac-a76b-f9a9285a1bc0 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d.dbb2ae2a-a000-40bf-91e9-2ebc0705d1c4 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:55 devstack sudo[102707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d.dbb2ae2a-a000-40bf-91e9-2ebc0705d1c4 Jul 30 17:02:55 devstack sudo[102707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:55 devstack sudo[102704]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed.info" returned: 0 in 0.258s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:55 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] Acquiring lock "cinder-quobyte-116c8fd7-7bb4-4ad6-b7ab-81d7be29b8b7" by "_copy_volume_from_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:55 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] Lock "cinder-quobyte-116c8fd7-7bb4-4ad6-b7ab-81d7be29b8b7" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:55 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] snapshot: 0dbb0147-8497-4db6-9674-b8b0b47f312b, volume: 116c8fd7-7bb4-4ad6-b7ab-81d7be29b8b7, {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 17:02:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:02:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:02:55 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:02:55 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:02:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:02:55 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[d973e373-7051-41f1-bbb6-cf933ec1eac2]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed.0dbb0147-8497-4db6-9674-b8b0b47f312b {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:55 devstack sudo[102707]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-427eeef4-68e9-4eac-a76b-f9a9285a1bc0 tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d.dbb2ae2a-a000-40bf-91e9-2ebc0705d1c4" returned: 0 in 0.251s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:55 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-427eeef4-68e9-4eac-a76b-f9a9285a1bc0 tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-dbb2ae2a-a000-40bf-91e9-2ebc0705d1c4" released by "_delete_snapshot" :: held 1.868s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:55 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-427eeef4-68e9-4eac-a76b-f9a9285a1bc0 tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d" released by "delete_snapshot" :: held 1.892s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:55 devstack sudo[102711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed.0dbb0147-8497-4db6-9674-b8b0b47f312b Jul 30 17:02:55 devstack sudo[102711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:55 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-427eeef4-68e9-4eac-a76b-f9a9285a1bc0 tempest-VolumeDependencyTests-893333359 None] Created reservations ['39803710-91d1-4b4a-9956-cb926585456a', '44d40d41-06fa-4010-9504-9e4dc4831fe2', '862387e4-40b1-40ed-b548-12aa0fe20cec', '69e5dba8-46d6-475a-b094-78e58ad25169'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:02:55 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-427eeef4-68e9-4eac-a76b-f9a9285a1bc0 tempest-VolumeDependencyTests-893333359 None] Delete snapshot completed successfully. Jul 30 17:02:55 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-427eeef4-68e9-4eac-a76b-f9a9285a1bc0 tempest-VolumeDependencyTests-893333359 None] Lock "cinder-dbb2ae2a-a000-40bf-91e9-2ebc0705d1c4-delete_snapshot" released by "delete_snapshot" :: held 2.037s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:55 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c5eaaf8a-c934-4c89-b435-d15cbeaed6c3 tempest-VolumeDependencyTests-893333359 None] Acquiring lock "cinder-6cdc6195-a520-47e2-a949-811f457ff219-delete_snapshot" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:55 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c5eaaf8a-c934-4c89-b435-d15cbeaed6c3 tempest-VolumeDependencyTests-893333359 None] Lock "cinder-6cdc6195-a520-47e2-a949-811f457ff219-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:55 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c5eaaf8a-c934-4c89-b435-d15cbeaed6c3 tempest-VolumeDependencyTests-893333359 None] Acquiring lock "cinder-quobyte-0d55803e-4e1c-458e-aafc-3df1ad81de23" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:55 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c5eaaf8a-c934-4c89-b435-d15cbeaed6c3 tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-0d55803e-4e1c-458e-aafc-3df1ad81de23" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:55 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c5eaaf8a-c934-4c89-b435-d15cbeaed6c3 tempest-VolumeDependencyTests-893333359 None] Acquiring lock "cinder-quobyte-6cdc6195-a520-47e2-a949-811f457ff219" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:55 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c5eaaf8a-c934-4c89-b435-d15cbeaed6c3 tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-6cdc6195-a520-47e2-a949-811f457ff219" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:55 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-c5eaaf8a-c934-4c89-b435-d15cbeaed6c3 tempest-VolumeDependencyTests-893333359 None] Deleting offline snapshot 6cdc6195-a520-47e2-a949-811f457ff219 of volume 0d55803e-4e1c-458e-aafc-3df1ad81de23 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:02:55 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-c5eaaf8a-c934-4c89-b435-d15cbeaed6c3 tempest-VolumeDependencyTests-893333359 None] snapshot_file for this snap is: volume-0d55803e-4e1c-458e-aafc-3df1ad81de23.6cdc6195-a520-47e2-a949-811f457ff219 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:02:55 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95ca48a-6755-4370-9298-bd25934af5b3]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c5eaaf8a-c934-4c89-b435-d15cbeaed6c3 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23.6cdc6195-a520-47e2-a949-811f457ff219 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:55 devstack sudo[102711]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed.0dbb0147-8497-4db6-9674-b8b0b47f312b" returned: 0 in 0.426s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:55 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:02:55 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdf2fa9-41b6-4605-a7c7-9e7c3bb976f1]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:55 devstack sudo[102716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23.6cdc6195-a520-47e2-a949-811f457ff219 Jul 30 17:02:55 devstack sudo[102716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:56 devstack sudo[102717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed Jul 30 17:02:56 devstack sudo[102717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:56 devstack sudo[102716]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c5eaaf8a-c934-4c89-b435-d15cbeaed6c3 tempest-VolumeDependencyTests-893333359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23.6cdc6195-a520-47e2-a949-811f457ff219" returned: 0 in 0.418s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:56 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-c5eaaf8a-c934-4c89-b435-d15cbeaed6c3 tempest-VolumeDependencyTests-893333359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d55803e-4e1c-458e-aafc-3df1ad81de23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:02:56 devstack sudo[102717]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed" returned: 0 in 0.404s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:56 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] will copy from snapshot at /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 17:02:56 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] Creating direct copy from snapshot {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 17:02:56 devstack cinder-volume[88591]: DEBUG cinder.utils [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] Path /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-116c8fd7-7bb4-4ad6-b7ab-81d7be29b8b7 not found in is_blk_device check {{(pid=88591) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 17:02:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-116c8fd7-7bb4-4ad6-b7ab-81d7be29b8b7 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:56 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68dfe2b-8671-4882-9b29-5c5a3c8edef3]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c5eaaf8a-c934-4c89-b435-d15cbeaed6c3 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:56 devstack sudo[102727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-116c8fd7-7bb4-4ad6-b7ab-81d7be29b8b7 Jul 30 17:02:56 devstack sudo[102727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:56 devstack sudo[102728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23 Jul 30 17:02:56 devstack sudo[102728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:56 devstack sudo[102728]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c5eaaf8a-c934-4c89-b435-d15cbeaed6c3 tempest-VolumeDependencyTests-893333359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23" returned: 0 in 0.384s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c5eaaf8a-c934-4c89-b435-d15cbeaed6c3 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23.6cdc6195-a520-47e2-a949-811f457ff219 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:56 devstack sudo[102738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23.6cdc6195-a520-47e2-a949-811f457ff219 Jul 30 17:02:56 devstack sudo[102738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:57 devstack sudo[102738]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c5eaaf8a-c934-4c89-b435-d15cbeaed6c3 tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23.6cdc6195-a520-47e2-a949-811f457ff219" returned: 0 in 0.785s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c5eaaf8a-c934-4c89-b435-d15cbeaed6c3 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23.6cdc6195-a520-47e2-a949-811f457ff219 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:57 devstack sudo[102749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23.6cdc6195-a520-47e2-a949-811f457ff219 Jul 30 17:02:57 devstack sudo[102749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:02:58 devstack sudo[102749]: pam_unix(sudo:session): session closed for user root Jul 30 17:02:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c5eaaf8a-c934-4c89-b435-d15cbeaed6c3 tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23.6cdc6195-a520-47e2-a949-811f457ff219" returned: 0 in 0.641s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:02:58 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c5eaaf8a-c934-4c89-b435-d15cbeaed6c3 tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-6cdc6195-a520-47e2-a949-811f457ff219" released by "_delete_snapshot" :: held 2.430s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:58 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c5eaaf8a-c934-4c89-b435-d15cbeaed6c3 tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-0d55803e-4e1c-458e-aafc-3df1ad81de23" released by "delete_snapshot" :: held 2.469s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:58 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-c5eaaf8a-c934-4c89-b435-d15cbeaed6c3 tempest-VolumeDependencyTests-893333359 None] Created reservations ['bffe8ae7-a6f8-49ed-9408-3f3c8ee9189e', 'ec2602e3-202a-4427-ad86-df67896e5271', '3d0651bc-9834-41d9-bbfd-01859faa8831', 'd25f456b-bd35-4325-91e4-92e3551ad023'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:02:58 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-c5eaaf8a-c934-4c89-b435-d15cbeaed6c3 tempest-VolumeDependencyTests-893333359 None] Delete snapshot completed successfully. Jul 30 17:02:58 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c5eaaf8a-c934-4c89-b435-d15cbeaed6c3 tempest-VolumeDependencyTests-893333359 None] Lock "cinder-6cdc6195-a520-47e2-a949-811f457ff219-delete_snapshot" released by "delete_snapshot" :: held 2.776s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:02:59 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7835c4be-c8fe-422c-bc40-cd8443018893 tempest-VolumeDependencyTests-893333359 None] Acquiring lock "cinder-baaba15a-d679-4a84-b83a-105e90f197ff-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:59 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7835c4be-c8fe-422c-bc40-cd8443018893 tempest-VolumeDependencyTests-893333359 None] Lock "cinder-baaba15a-d679-4a84-b83a-105e90f197ff-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:59 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7835c4be-c8fe-422c-bc40-cd8443018893 tempest-VolumeDependencyTests-893333359 None] Acquiring lock "cinder-quobyte-baaba15a-d679-4a84-b83a-105e90f197ff" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:02:59 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7835c4be-c8fe-422c-bc40-cd8443018893 tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-baaba15a-d679-4a84-b83a-105e90f197ff" acquired by "delete_volume" :: waited 0.027s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:02:59 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9dc7221-a559-4b24-a87e-d0afb70a6b3a]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:02:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7835c4be-c8fe-422c-bc40-cd8443018893 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:02:59 devstack sudo[102753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff Jul 30 17:02:59 devstack sudo[102753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:00 devstack sudo[102753]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7835c4be-c8fe-422c-bc40-cd8443018893 tempest-VolumeDependencyTests-893333359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff" returned: 0 in 0.764s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7835c4be-c8fe-422c-bc40-cd8443018893 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:00 devstack sudo[102758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff Jul 30 17:03:00 devstack sudo[102758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:00 devstack sudo[102758]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7835c4be-c8fe-422c-bc40-cd8443018893 tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-baaba15a-d679-4a84-b83a-105e90f197ff" returned: 0 in 0.526s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:00 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7835c4be-c8fe-422c-bc40-cd8443018893 tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-baaba15a-d679-4a84-b83a-105e90f197ff" released by "delete_volume" :: held 1.443s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:00 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-7835c4be-c8fe-422c-bc40-cd8443018893 tempest-VolumeDependencyTests-893333359 None] Created reservations ['d8f9781c-fd8e-41e1-b913-40035c31050d', '9fc2af8d-b3d8-4b43-aa0f-a63d3ec31fdd', '881f6b92-822f-446e-a47c-da39a19a1b7a', '5ecc1d62-99d6-4553-9636-11ca754ac6b3'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:03:00 devstack sudo[102727]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-116c8fd7-7bb4-4ad6-b7ab-81d7be29b8b7" returned: 0 in 4.666s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:00 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] Image conversion details: src /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed, size 1024.00 MB, duration 4.67 sec, destination /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-116c8fd7-7bb4-4ad6-b7ab-81d7be29b8b7 {{(pid=88591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 17:03:00 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] Converted 1024.00 MB image at 219.39 MB/s Jul 30 17:03:00 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-116c8fd7-7bb4-4ad6-b7ab-81d7be29b8b7 is being set with open permissions: ugo+rw Jul 30 17:03:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-116c8fd7-7bb4-4ad6-b7ab-81d7be29b8b7 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7835c4be-c8fe-422c-bc40-cd8443018893 tempest-VolumeDependencyTests-893333359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7835c4be-c8fe-422c-bc40-cd8443018893 tempest-VolumeDependencyTests-893333359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:01 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7835c4be-c8fe-422c-bc40-cd8443018893 tempest-VolumeDependencyTests-893333359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:03:01 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7835c4be-c8fe-422c-bc40-cd8443018893 tempest-VolumeDependencyTests-893333359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:03:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7835c4be-c8fe-422c-bc40-cd8443018893 tempest-VolumeDependencyTests-893333359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7835c4be-c8fe-422c-bc40-cd8443018893 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:01 devstack sudo[102761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-116c8fd7-7bb4-4ad6-b7ab-81d7be29b8b7 Jul 30 17:03:01 devstack sudo[102761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:01 devstack sudo[102763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:03:01 devstack sudo[102763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:01 devstack sudo[102761]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-116c8fd7-7bb4-4ad6-b7ab-81d7be29b8b7" returned: 0 in 0.243s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:01 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] Lock "cinder-quobyte-116c8fd7-7bb4-4ad6-b7ab-81d7be29b8b7" released by "_copy_volume_from_snapshot" :: held 5.819s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:01 devstack sudo[102763]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7835c4be-c8fe-422c-bc40-cd8443018893 tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.242s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:01 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-7835c4be-c8fe-422c-bc40-cd8443018893 tempest-VolumeDependencyTests-893333359 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:03:01 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-7835c4be-c8fe-422c-bc40-cd8443018893 tempest-VolumeDependencyTests-893333359 None] Deleted volume successfully. Jul 30 17:03:01 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] Acquiring lock "cinder-quobyte-0dbb0147-8497-4db6-9674-b8b0b47f312b" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:01 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7835c4be-c8fe-422c-bc40-cd8443018893 tempest-VolumeDependencyTests-893333359 None] Lock "cinder-baaba15a-d679-4a84-b83a-105e90f197ff-delete_volume" released by "delete_volume" :: held 1.991s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:01 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] Lock "cinder-quobyte-0dbb0147-8497-4db6-9674-b8b0b47f312b" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:01 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] Deleting offline snapshot 0dbb0147-8497-4db6-9674-b8b0b47f312b of volume c9dcecfb-cb74-419b-84d8-f503e403c5ed {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:03:01 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] snapshot_file for this snap is: volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed.0dbb0147-8497-4db6-9674-b8b0b47f312b {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:03:01 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[139f1cb8-fe67-43ad-bc3e-552fe1088869]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:03:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed.0dbb0147-8497-4db6-9674-b8b0b47f312b {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:01 devstack sudo[102767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed.0dbb0147-8497-4db6-9674-b8b0b47f312b Jul 30 17:03:01 devstack sudo[102767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:01 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-4d3dc84e-2686-4a96-b4db-82c88772fe58 tempest-VolumeDependencyTests-893333359 None] Acquiring lock "cinder-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:01 devstack sudo[102767]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:01 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-4d3dc84e-2686-4a96-b4db-82c88772fe58 tempest-VolumeDependencyTests-893333359 None] Lock "cinder-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed.0dbb0147-8497-4db6-9674-b8b0b47f312b" returned: 0 in 0.370s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:01 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:03:01 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[20633d60-f6e5-4d1f-b0ee-1f400814412c]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:03:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:01 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-4d3dc84e-2686-4a96-b4db-82c88772fe58 tempest-VolumeDependencyTests-893333359 None] Acquiring lock "cinder-quobyte-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:01 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-4d3dc84e-2686-4a96-b4db-82c88772fe58 tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d" acquired by "delete_volume" :: waited 0.015s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:01 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c40ace-e637-44f1-af39-3dc31fdf8a4f]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:03:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4d3dc84e-2686-4a96-b4db-82c88772fe58 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:01 devstack sudo[102772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed Jul 30 17:03:01 devstack sudo[102772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:01 devstack sudo[102773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d Jul 30 17:03:01 devstack sudo[102773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:02 devstack sudo[102773]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4d3dc84e-2686-4a96-b4db-82c88772fe58 tempest-VolumeDependencyTests-893333359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d" returned: 0 in 0.389s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4d3dc84e-2686-4a96-b4db-82c88772fe58 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:02 devstack sudo[102782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d Jul 30 17:03:02 devstack sudo[102782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:02 devstack sudo[102772]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed" returned: 0 in 0.608s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed.0dbb0147-8497-4db6-9674-b8b0b47f312b {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:02 devstack sudo[102785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed.0dbb0147-8497-4db6-9674-b8b0b47f312b Jul 30 17:03:02 devstack sudo[102785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:02 devstack sudo[102782]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4d3dc84e-2686-4a96-b4db-82c88772fe58 tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d" returned: 0 in 0.258s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:02 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-4d3dc84e-2686-4a96-b4db-82c88772fe58 tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d" released by "delete_volume" :: held 0.713s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:02 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-4d3dc84e-2686-4a96-b4db-82c88772fe58 tempest-VolumeDependencyTests-893333359 None] Created reservations ['121dfe75-e7a3-41fb-86d5-38988b55a2ee', '89e533b3-e859-431d-b2b9-bac12d15f03c', '63ece47f-a8b4-4367-b164-1ee8ae73a387', '130a241e-c325-457f-b330-2043d3565fa4'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:03:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-4d3dc84e-2686-4a96-b4db-82c88772fe58 tempest-VolumeDependencyTests-893333359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-4d3dc84e-2686-4a96-b4db-82c88772fe58 tempest-VolumeDependencyTests-893333359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:02 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-4d3dc84e-2686-4a96-b4db-82c88772fe58 tempest-VolumeDependencyTests-893333359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:03:02 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-4d3dc84e-2686-4a96-b4db-82c88772fe58 tempest-VolumeDependencyTests-893333359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:03:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-4d3dc84e-2686-4a96-b4db-82c88772fe58 tempest-VolumeDependencyTests-893333359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4d3dc84e-2686-4a96-b4db-82c88772fe58 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:02 devstack sudo[102792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:03:02 devstack sudo[102792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:02 devstack sudo[102785]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed.0dbb0147-8497-4db6-9674-b8b0b47f312b" returned: 0 in 0.351s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed.0dbb0147-8497-4db6-9674-b8b0b47f312b {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:02 devstack sudo[102794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed.0dbb0147-8497-4db6-9674-b8b0b47f312b Jul 30 17:03:02 devstack sudo[102794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:02 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b018cdd3-4de9-4659-92fa-109b49238d33 tempest-VolumeDependencyTests-893333359 None] Acquiring lock "cinder-0d55803e-4e1c-458e-aafc-3df1ad81de23-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:02 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b018cdd3-4de9-4659-92fa-109b49238d33 tempest-VolumeDependencyTests-893333359 None] Lock "cinder-0d55803e-4e1c-458e-aafc-3df1ad81de23-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:02 devstack sudo[102792]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4d3dc84e-2686-4a96-b4db-82c88772fe58 tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.265s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:02 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-4d3dc84e-2686-4a96-b4db-82c88772fe58 tempest-VolumeDependencyTests-893333359 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:03:02 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-4d3dc84e-2686-4a96-b4db-82c88772fe58 tempest-VolumeDependencyTests-893333359 None] Deleted volume successfully. Jul 30 17:03:02 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-4d3dc84e-2686-4a96-b4db-82c88772fe58 tempest-VolumeDependencyTests-893333359 None] Lock "cinder-fac817aa-2523-4c4c-a5bd-0078fb2f0e4d-delete_volume" released by "delete_volume" :: held 1.237s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:02 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b018cdd3-4de9-4659-92fa-109b49238d33 tempest-VolumeDependencyTests-893333359 None] Acquiring lock "cinder-quobyte-0d55803e-4e1c-458e-aafc-3df1ad81de23" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:02 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b018cdd3-4de9-4659-92fa-109b49238d33 tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-0d55803e-4e1c-458e-aafc-3df1ad81de23" acquired by "delete_volume" :: waited 0.020s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:02 devstack sudo[102794]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed.0dbb0147-8497-4db6-9674-b8b0b47f312b" returned: 0 in 0.307s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:03 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2f4550-2190-4c92-9355-209565de88b6]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:03:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b018cdd3-4de9-4659-92fa-109b49238d33 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:03 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] Lock "cinder-quobyte-0dbb0147-8497-4db6-9674-b8b0b47f312b" released by "_delete_snapshot" :: held 1.749s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.834s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2bb036d4-3619-424d-94b2-6e0c63c64a85 tempest-VolumesSnapshotListTestJSON-700740194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.970s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:03 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-2bb036d4-3619-424d-94b2-6e0c63c64a85 tempest-VolumesSnapshotListTestJSON-700740194 None] Creating offline snapshot 2a6443c7-d667-40e4-acfa-e7a96b33f01e of volume b3160d2a-b30b-416b-a02e-429f73e00900 {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:03:03 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a749b765-f748-4196-a4c6-f1014bed7b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-116c8fd7-7bb4-4ad6-b7ab-81d7be29b8b7', 'volume_size': 1, 'source_volid': 'c9dcecfb-cb74-419b-84d8-f503e403c5ed', 'source_volstatus': 'available'}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:03 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18da88aa-0fbb-4eb6-b01b-b6b90ea3de0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:03 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[442d3f26-d2f4-4b72-aef5-91a826ae4c84]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:03:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2bb036d4-3619-424d-94b2-6e0c63c64a85 tempest-VolumesSnapshotListTestJSON-700740194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:03 devstack sudo[102798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23 Jul 30 17:03:03 devstack sudo[102798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:03 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] Volume volume-116c8fd7-7bb4-4ad6-b7ab-81d7be29b8b7 (116c8fd7-7bb4-4ad6-b7ab-81d7be29b8b7): created successfully Jul 30 17:03:03 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18da88aa-0fbb-4eb6-b01b-b6b90ea3de0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:03 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] Flow 'volume_create_manager' (67cc8bbc-ddaa-4b63-803c-2138d765da22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:03:03 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-95613b0b-1577-47f9-902b-e4ccacb7c9bf tempest-VolumesGetTest-1118799669 None] Created volume successfully. Jul 30 17:03:03 devstack sudo[102799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900 Jul 30 17:03:03 devstack sudo[102799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:03 devstack sudo[102798]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b018cdd3-4de9-4659-92fa-109b49238d33 tempest-VolumeDependencyTests-893333359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23" returned: 0 in 0.383s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b018cdd3-4de9-4659-92fa-109b49238d33 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:03 devstack sudo[102805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23 Jul 30 17:03:03 devstack sudo[102805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:03 devstack sudo[102799]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2bb036d4-3619-424d-94b2-6e0c63c64a85 tempest-VolumesSnapshotListTestJSON-700740194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900" returned: 0 in 0.383s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2bb036d4-3619-424d-94b2-6e0c63c64a85 tempest-VolumesSnapshotListTestJSON-700740194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.2a6443c7-d667-40e4-acfa-e7a96b33f01e 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:03 devstack sudo[102810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.2a6443c7-d667-40e4-acfa-e7a96b33f01e 1G Jul 30 17:03:03 devstack sudo[102810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:03 devstack sudo[102805]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b018cdd3-4de9-4659-92fa-109b49238d33 tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d55803e-4e1c-458e-aafc-3df1ad81de23" returned: 0 in 0.260s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:03 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b018cdd3-4de9-4659-92fa-109b49238d33 tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-0d55803e-4e1c-458e-aafc-3df1ad81de23" released by "delete_volume" :: held 0.745s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:03 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-b018cdd3-4de9-4659-92fa-109b49238d33 tempest-VolumeDependencyTests-893333359 None] Created reservations ['bad8209f-5e0c-42b4-915f-cd51593be6be', '80cc0753-4831-40d0-8cb9-452c467ddc0e', 'b4d71ef9-2d1b-4f11-9b3c-f1a22b39e776', '8b877ad1-ce0b-4936-9206-6f6f7b8bbde2'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:03:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b018cdd3-4de9-4659-92fa-109b49238d33 tempest-VolumeDependencyTests-893333359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b018cdd3-4de9-4659-92fa-109b49238d33 tempest-VolumeDependencyTests-893333359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:03 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b018cdd3-4de9-4659-92fa-109b49238d33 tempest-VolumeDependencyTests-893333359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:03:03 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b018cdd3-4de9-4659-92fa-109b49238d33 tempest-VolumeDependencyTests-893333359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:03:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b018cdd3-4de9-4659-92fa-109b49238d33 tempest-VolumeDependencyTests-893333359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b018cdd3-4de9-4659-92fa-109b49238d33 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:03 devstack sudo[102816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:03:03 devstack sudo[102816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:03 devstack sudo[102810]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2bb036d4-3619-424d-94b2-6e0c63c64a85 tempest-VolumesSnapshotListTestJSON-700740194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.2a6443c7-d667-40e4-acfa-e7a96b33f01e 1G" returned: 0 in 0.435s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2bb036d4-3619-424d-94b2-6e0c63c64a85 tempest-VolumesSnapshotListTestJSON-700740194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3160d2a-b30b-416b-a02e-429f73e00900 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.2a6443c7-d667-40e4-acfa-e7a96b33f01e {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:03 devstack sudo[102819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3160d2a-b30b-416b-a02e-429f73e00900 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.2a6443c7-d667-40e4-acfa-e7a96b33f01e Jul 30 17:03:03 devstack sudo[102819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:04 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-4cbda5c0-3ed2-4922-9571-f1594de796cb tempest-VolumeDependencyTests-893333359 None] Acquiring lock "cinder-0934f7d3-5df7-47ba-b440-a5064b6884ec-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:04 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-4cbda5c0-3ed2-4922-9571-f1594de796cb tempest-VolumeDependencyTests-893333359 None] Lock "cinder-0934f7d3-5df7-47ba-b440-a5064b6884ec-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:04 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-4cbda5c0-3ed2-4922-9571-f1594de796cb tempest-VolumeDependencyTests-893333359 None] Acquiring lock "cinder-quobyte-0934f7d3-5df7-47ba-b440-a5064b6884ec" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:04 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-4cbda5c0-3ed2-4922-9571-f1594de796cb tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-0934f7d3-5df7-47ba-b440-a5064b6884ec" acquired by "delete_volume" :: waited 0.025s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:04 devstack sudo[102816]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b018cdd3-4de9-4659-92fa-109b49238d33 tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.374s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:04 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-b018cdd3-4de9-4659-92fa-109b49238d33 tempest-VolumeDependencyTests-893333359 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:03:04 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-b018cdd3-4de9-4659-92fa-109b49238d33 tempest-VolumeDependencyTests-893333359 None] Deleted volume successfully. Jul 30 17:03:04 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e19a6b7-d531-4aba-ac36-e81c78f0b29d]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:03:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4cbda5c0-3ed2-4922-9571-f1594de796cb tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0934f7d3-5df7-47ba-b440-a5064b6884ec {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:04 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b018cdd3-4de9-4659-92fa-109b49238d33 tempest-VolumeDependencyTests-893333359 None] Lock "cinder-0d55803e-4e1c-458e-aafc-3df1ad81de23-delete_volume" released by "delete_volume" :: held 1.376s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:04 devstack sudo[102819]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2bb036d4-3619-424d-94b2-6e0c63c64a85 tempest-VolumesSnapshotListTestJSON-700740194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3160d2a-b30b-416b-a02e-429f73e00900 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.2a6443c7-d667-40e4-acfa-e7a96b33f01e" returned: 0 in 0.373s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:04 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-2bb036d4-3619-424d-94b2-6e0c63c64a85 tempest-VolumesSnapshotListTestJSON-700740194 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.2a6443c7-d667-40e4-acfa-e7a96b33f01e is being set with open permissions: ugo+rw Jul 30 17:03:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2bb036d4-3619-424d-94b2-6e0c63c64a85 tempest-VolumesSnapshotListTestJSON-700740194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.2a6443c7-d667-40e4-acfa-e7a96b33f01e {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:04 devstack sudo[102822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0934f7d3-5df7-47ba-b440-a5064b6884ec Jul 30 17:03:04 devstack sudo[102822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:04 devstack sudo[102826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.2a6443c7-d667-40e4-acfa-e7a96b33f01e Jul 30 17:03:04 devstack sudo[102826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:04 devstack sudo[102826]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2bb036d4-3619-424d-94b2-6e0c63c64a85 tempest-VolumesSnapshotListTestJSON-700740194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.2a6443c7-d667-40e4-acfa-e7a96b33f01e" returned: 0 in 0.273s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2bb036d4-3619-424d-94b2-6e0c63c64a85 tempest-VolumesSnapshotListTestJSON-700740194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:04 devstack sudo[102822]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4cbda5c0-3ed2-4922-9571-f1594de796cb tempest-VolumeDependencyTests-893333359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0934f7d3-5df7-47ba-b440-a5064b6884ec" returned: 0 in 0.450s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4cbda5c0-3ed2-4922-9571-f1594de796cb tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0934f7d3-5df7-47ba-b440-a5064b6884ec {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:04 devstack sudo[102833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.info Jul 30 17:03:04 devstack sudo[102833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:04 devstack sudo[102834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0934f7d3-5df7-47ba-b440-a5064b6884ec Jul 30 17:03:04 devstack sudo[102834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:04 devstack sudo[102834]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4cbda5c0-3ed2-4922-9571-f1594de796cb tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0934f7d3-5df7-47ba-b440-a5064b6884ec" returned: 0 in 0.295s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:04 devstack sudo[102833]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2bb036d4-3619-424d-94b2-6e0c63c64a85 tempest-VolumesSnapshotListTestJSON-700740194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.info" returned: 0 in 0.324s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:04 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-2bb036d4-3619-424d-94b2-6e0c63c64a85 tempest-VolumesSnapshotListTestJSON-700740194 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.info is being set with open permissions: ugo+rw Jul 30 17:03:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2bb036d4-3619-424d-94b2-6e0c63c64a85 tempest-VolumesSnapshotListTestJSON-700740194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:04 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-4cbda5c0-3ed2-4922-9571-f1594de796cb tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-0934f7d3-5df7-47ba-b440-a5064b6884ec" released by "delete_volume" :: held 0.823s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:04 devstack sudo[102839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.info Jul 30 17:03:04 devstack sudo[102839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:04 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-a74e7160-3bad-4a8f-8d8e-ff7340b5c191 tempest-VolumesGetTest-1118799669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:03:05 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a74e7160-3bad-4a8f-8d8e-ff7340b5c191 tempest-VolumesGetTest-1118799669 None] Flow 'volume_create_manager' (9010e593-0a82-4dd2-aeeb-1f551691446c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:03:05 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a74e7160-3bad-4a8f-8d8e-ff7340b5c191 tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (672ea642-48bd-4854-aff0-5fa15ebe264f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:05 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a74e7160-3bad-4a8f-8d8e-ff7340b5c191 tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (672ea642-48bd-4854-aff0-5fa15ebe264f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:03:05Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-68532363',display_name='tempest-VolumesGetTest-Volume-1856489520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8865063-5a24-42ff-bca8-8973ce01e44c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c6e94e27fa4ce98248b491a048f03e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:03:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:03:05Z,use_quota=True,user_id='58b251ff552e40e38310aedc71e0c3f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:05 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a74e7160-3bad-4a8f-8d8e-ff7340b5c191 tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7422eda5-990c-465e-8c62-dda5fa7b5217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:05 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a74e7160-3bad-4a8f-8d8e-ff7340b5c191 tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7422eda5-990c-465e-8c62-dda5fa7b5217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:05 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a74e7160-3bad-4a8f-8d8e-ff7340b5c191 tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdbbf847-6687-4caf-a4ae-60dcf8053ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:05 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a74e7160-3bad-4a8f-8d8e-ff7340b5c191 tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdbbf847-6687-4caf-a4ae-60dcf8053ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8865063-5a24-42ff-bca8-8973ce01e44c', 'volume_name': 'volume-e8865063-5a24-42ff-bca8-8973ce01e44c', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:05 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a74e7160-3bad-4a8f-8d8e-ff7340b5c191 tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9215ca9-03d7-49f6-98b1-e5e9139cdca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:05 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a74e7160-3bad-4a8f-8d8e-ff7340b5c191 tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9215ca9-03d7-49f6-98b1-e5e9139cdca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:05 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a74e7160-3bad-4a8f-8d8e-ff7340b5c191 tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f201929b-fa67-4537-9b20-4508d1941ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:05 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-a74e7160-3bad-4a8f-8d8e-ff7340b5c191 tempest-VolumesGetTest-1118799669 None] Volume e8865063-5a24-42ff-bca8-8973ce01e44c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8865063-5a24-42ff-bca8-8973ce01e44c', 'volume_size': 1} Jul 30 17:03:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a74e7160-3bad-4a8f-8d8e-ff7340b5c191 tempest-VolumesGetTest-1118799669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:05 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-4cbda5c0-3ed2-4922-9571-f1594de796cb tempest-VolumeDependencyTests-893333359 None] Created reservations ['07c14486-4053-406a-a8f6-d8aecfef99dc', '94ddae01-c54a-4234-85b7-1789f112d178', '8d21b28a-3770-4518-8051-8e7c0e1539c5', 'ca4688c4-683b-4377-964e-014d3b74f76b'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:03:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-4cbda5c0-3ed2-4922-9571-f1594de796cb tempest-VolumeDependencyTests-893333359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-4cbda5c0-3ed2-4922-9571-f1594de796cb tempest-VolumeDependencyTests-893333359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:05 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-4cbda5c0-3ed2-4922-9571-f1594de796cb tempest-VolumeDependencyTests-893333359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:03:05 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-4cbda5c0-3ed2-4922-9571-f1594de796cb tempest-VolumeDependencyTests-893333359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:03:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-4cbda5c0-3ed2-4922-9571-f1594de796cb tempest-VolumeDependencyTests-893333359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4cbda5c0-3ed2-4922-9571-f1594de796cb tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:05 devstack sudo[102842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:03:05 devstack sudo[102842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:05 devstack sudo[102839]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2bb036d4-3619-424d-94b2-6e0c63c64a85 tempest-VolumesSnapshotListTestJSON-700740194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.info" returned: 0 in 0.283s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2bb036d4-3619-424d-94b2-6e0c63c64a85 tempest-VolumesSnapshotListTestJSON-700740194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.181s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a74e7160-3bad-4a8f-8d8e-ff7340b5c191 tempest-VolumesGetTest-1118799669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.181s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:05 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a74e7160-3bad-4a8f-8d8e-ff7340b5c191 tempest-VolumesGetTest-1118799669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:03:05Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-68532363',display_name='tempest-VolumesGetTest-Volume-1856489520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8865063-5a24-42ff-bca8-8973ce01e44c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c6e94e27fa4ce98248b491a048f03e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:03:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:03:05Z,use_quota=True,user_id='58b251ff552e40e38310aedc71e0c3f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:03:05 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-a74e7160-3bad-4a8f-8d8e-ff7340b5c191 tempest-VolumesGetTest-1118799669 None] Creating volume e8865063-5a24-42ff-bca8-8973ce01e44c {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:03:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a74e7160-3bad-4a8f-8d8e-ff7340b5c191 tempest-VolumesGetTest-1118799669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a74e7160-3bad-4a8f-8d8e-ff7340b5c191 tempest-VolumesGetTest-1118799669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:05 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a74e7160-3bad-4a8f-8d8e-ff7340b5c191 tempest-VolumesGetTest-1118799669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:03:05 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a74e7160-3bad-4a8f-8d8e-ff7340b5c191 tempest-VolumesGetTest-1118799669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:03:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a74e7160-3bad-4a8f-8d8e-ff7340b5c191 tempest-VolumesGetTest-1118799669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:05 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a74e7160-3bad-4a8f-8d8e-ff7340b5c191 tempest-VolumesGetTest-1118799669 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:03:05 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-a74e7160-3bad-4a8f-8d8e-ff7340b5c191 tempest-VolumesGetTest-1118799669 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:03:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a74e7160-3bad-4a8f-8d8e-ff7340b5c191 tempest-VolumesGetTest-1118799669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e8865063-5a24-42ff-bca8-8973ce01e44c 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:05 devstack sudo[102844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e8865063-5a24-42ff-bca8-8973ce01e44c 1073741824 Jul 30 17:03:05 devstack sudo[102844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:05 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-2bb036d4-3619-424d-94b2-6e0c63c64a85 tempest-VolumesSnapshotListTestJSON-700740194 None] Create snapshot completed successfully Jul 30 17:03:05 devstack sudo[102842]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4cbda5c0-3ed2-4922-9571-f1594de796cb tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.286s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:05 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-4cbda5c0-3ed2-4922-9571-f1594de796cb tempest-VolumeDependencyTests-893333359 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:03:05 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-4cbda5c0-3ed2-4922-9571-f1594de796cb tempest-VolumeDependencyTests-893333359 None] Deleted volume successfully. Jul 30 17:03:05 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-4cbda5c0-3ed2-4922-9571-f1594de796cb tempest-VolumeDependencyTests-893333359 None] Lock "cinder-0934f7d3-5df7-47ba-b440-a5064b6884ec-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:05 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-6742740b-eeea-4eae-b59c-a61b57f966c1 tempest-VolumeDependencyTests-893333359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:03:05 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6742740b-eeea-4eae-b59c-a61b57f966c1 tempest-VolumeDependencyTests-893333359 None] Flow 'volume_create_manager' (d25b1908-792e-44c1-a2b8-e527030b1436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:03:05 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6742740b-eeea-4eae-b59c-a61b57f966c1 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e314098-63b7-4431-89c0-afc9fdc31b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:05 devstack sudo[102844]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:05 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6742740b-eeea-4eae-b59c-a61b57f966c1 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e314098-63b7-4431-89c0-afc9fdc31b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:03:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1766191051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b4df5f2-73ba-4d23-b402-6251d845636c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1142be8cf434dc9b1a32ef12a92e88b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:03:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:03:06Z,use_quota=True,user_id='db3e9fa2901f4abe9034e8c4a4f63fb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:05 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6742740b-eeea-4eae-b59c-a61b57f966c1 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edad35f1-2d58-441c-bc51-2a181b24ba4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:05 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6742740b-eeea-4eae-b59c-a61b57f966c1 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edad35f1-2d58-441c-bc51-2a181b24ba4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:05 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6742740b-eeea-4eae-b59c-a61b57f966c1 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9892e6c5-2e49-4fe5-a9d3-3bb3f72a81bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:05 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6742740b-eeea-4eae-b59c-a61b57f966c1 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9892e6c5-2e49-4fe5-a9d3-3bb3f72a81bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b4df5f2-73ba-4d23-b402-6251d845636c', 'volume_name': 'volume-8b4df5f2-73ba-4d23-b402-6251d845636c', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:05 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6742740b-eeea-4eae-b59c-a61b57f966c1 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fa3420a-a4f1-42d9-8c36-c6cd404c4177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:05 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6742740b-eeea-4eae-b59c-a61b57f966c1 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fa3420a-a4f1-42d9-8c36-c6cd404c4177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:05 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6742740b-eeea-4eae-b59c-a61b57f966c1 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7812a86c-85ff-4b79-9b0b-de400b12462c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:05 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-6742740b-eeea-4eae-b59c-a61b57f966c1 tempest-VolumeDependencyTests-893333359 None] Volume 8b4df5f2-73ba-4d23-b402-6251d845636c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b4df5f2-73ba-4d23-b402-6251d845636c', 'volume_size': 1} Jul 30 17:03:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-6742740b-eeea-4eae-b59c-a61b57f966c1 tempest-VolumeDependencyTests-893333359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a74e7160-3bad-4a8f-8d8e-ff7340b5c191 tempest-VolumesGetTest-1118799669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e8865063-5a24-42ff-bca8-8973ce01e44c 1073741824" returned: 0 in 0.632s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ea47f1ae-7a67-484c-a754-fa1c3d51b291 tempest-VolumesSnapshotListTestJSON-700740194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a74e7160-3bad-4a8f-8d8e-ff7340b5c191 tempest-VolumesGetTest-1118799669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e8865063-5a24-42ff-bca8-8973ce01e44c {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:05 devstack sudo[102851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e8865063-5a24-42ff-bca8-8973ce01e44c Jul 30 17:03:05 devstack sudo[102851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:06 devstack sudo[102851]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a74e7160-3bad-4a8f-8d8e-ff7340b5c191 tempest-VolumesGetTest-1118799669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e8865063-5a24-42ff-bca8-8973ce01e44c" returned: 0 in 0.241s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:06 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a74e7160-3bad-4a8f-8d8e-ff7340b5c191 tempest-VolumesGetTest-1118799669 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:03:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a74e7160-3bad-4a8f-8d8e-ff7340b5c191 tempest-VolumesGetTest-1118799669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-6742740b-eeea-4eae-b59c-a61b57f966c1 tempest-VolumeDependencyTests-893333359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.285s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:06 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-6742740b-eeea-4eae-b59c-a61b57f966c1 tempest-VolumeDependencyTests-893333359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:03:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1766191051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b4df5f2-73ba-4d23-b402-6251d845636c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1142be8cf434dc9b1a32ef12a92e88b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:03:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:03:06Z,use_quota=True,user_id='db3e9fa2901f4abe9034e8c4a4f63fb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:03:06 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-6742740b-eeea-4eae-b59c-a61b57f966c1 tempest-VolumeDependencyTests-893333359 None] Creating volume 8b4df5f2-73ba-4d23-b402-6251d845636c {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:03:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-6742740b-eeea-4eae-b59c-a61b57f966c1 tempest-VolumeDependencyTests-893333359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-6742740b-eeea-4eae-b59c-a61b57f966c1 tempest-VolumeDependencyTests-893333359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:06 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-6742740b-eeea-4eae-b59c-a61b57f966c1 tempest-VolumeDependencyTests-893333359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:03:06 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-6742740b-eeea-4eae-b59c-a61b57f966c1 tempest-VolumeDependencyTests-893333359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:03:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-6742740b-eeea-4eae-b59c-a61b57f966c1 tempest-VolumeDependencyTests-893333359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:06 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-6742740b-eeea-4eae-b59c-a61b57f966c1 tempest-VolumeDependencyTests-893333359 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:03:06 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-6742740b-eeea-4eae-b59c-a61b57f966c1 tempest-VolumeDependencyTests-893333359 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:03:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6742740b-eeea-4eae-b59c-a61b57f966c1 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b4df5f2-73ba-4d23-b402-6251d845636c 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:06 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a74e7160-3bad-4a8f-8d8e-ff7340b5c191 tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f201929b-fa67-4537-9b20-4508d1941ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8865063-5a24-42ff-bca8-8973ce01e44c', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:06 devstack sudo[102854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b4df5f2-73ba-4d23-b402-6251d845636c 1073741824 Jul 30 17:03:06 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a74e7160-3bad-4a8f-8d8e-ff7340b5c191 tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a076d58-41f6-4761-8434-20ce484b5078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:06 devstack sudo[102854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:06 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-a74e7160-3bad-4a8f-8d8e-ff7340b5c191 tempest-VolumesGetTest-1118799669 None] Volume volume-e8865063-5a24-42ff-bca8-8973ce01e44c (e8865063-5a24-42ff-bca8-8973ce01e44c): created successfully Jul 30 17:03:06 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a74e7160-3bad-4a8f-8d8e-ff7340b5c191 tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a076d58-41f6-4761-8434-20ce484b5078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:06 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a74e7160-3bad-4a8f-8d8e-ff7340b5c191 tempest-VolumesGetTest-1118799669 None] Flow 'volume_create_manager' (9010e593-0a82-4dd2-aeeb-1f551691446c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:03:06 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-a74e7160-3bad-4a8f-8d8e-ff7340b5c191 tempest-VolumesGetTest-1118799669 None] Created volume successfully. Jul 30 17:03:06 devstack sudo[102854]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6742740b-eeea-4eae-b59c-a61b57f966c1 tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b4df5f2-73ba-4d23-b402-6251d845636c 1073741824" returned: 0 in 0.417s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6742740b-eeea-4eae-b59c-a61b57f966c1 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b4df5f2-73ba-4d23-b402-6251d845636c {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:06 devstack sudo[102860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b4df5f2-73ba-4d23-b402-6251d845636c Jul 30 17:03:06 devstack sudo[102860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:06 devstack sudo[102860]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6742740b-eeea-4eae-b59c-a61b57f966c1 tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b4df5f2-73ba-4d23-b402-6251d845636c" returned: 0 in 0.255s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:06 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-6742740b-eeea-4eae-b59c-a61b57f966c1 tempest-VolumeDependencyTests-893333359 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:03:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-6742740b-eeea-4eae-b59c-a61b57f966c1 tempest-VolumeDependencyTests-893333359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ea47f1ae-7a67-484c-a754-fa1c3d51b291 tempest-VolumesSnapshotListTestJSON-700740194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.974s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:06 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6742740b-eeea-4eae-b59c-a61b57f966c1 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7812a86c-85ff-4b79-9b0b-de400b12462c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b4df5f2-73ba-4d23-b402-6251d845636c', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:06 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6742740b-eeea-4eae-b59c-a61b57f966c1 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (171f4171-33f3-43d9-bdf3-8d34589cfbaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:06 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-ea47f1ae-7a67-484c-a754-fa1c3d51b291 tempest-VolumesSnapshotListTestJSON-700740194 None] Creating offline snapshot 60af7609-c76e-4d04-8313-95e1ecf3dcd1 of volume b3160d2a-b30b-416b-a02e-429f73e00900 {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:03:06 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-6742740b-eeea-4eae-b59c-a61b57f966c1 tempest-VolumeDependencyTests-893333359 None] Volume volume-8b4df5f2-73ba-4d23-b402-6251d845636c (8b4df5f2-73ba-4d23-b402-6251d845636c): created successfully Jul 30 17:03:06 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6742740b-eeea-4eae-b59c-a61b57f966c1 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (171f4171-33f3-43d9-bdf3-8d34589cfbaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:07 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-6742740b-eeea-4eae-b59c-a61b57f966c1 tempest-VolumeDependencyTests-893333359 None] Flow 'volume_create_manager' (d25b1908-792e-44c1-a2b8-e527030b1436) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:03:07 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1c2a85-778e-40f3-8b07-9b1e285afc29]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:03:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ea47f1ae-7a67-484c-a754-fa1c3d51b291 tempest-VolumesSnapshotListTestJSON-700740194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.2a6443c7-d667-40e4-acfa-e7a96b33f01e {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:07 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-6742740b-eeea-4eae-b59c-a61b57f966c1 tempest-VolumeDependencyTests-893333359 None] Created volume successfully. Jul 30 17:03:07 devstack sudo[102863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.2a6443c7-d667-40e4-acfa-e7a96b33f01e Jul 30 17:03:07 devstack sudo[102863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:07 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d9477923-1e82-4f32-bda8-5518430dca6b tempest-VolumesGetTest-1118799669 None] Acquiring lock "cinder-e8865063-5a24-42ff-bca8-8973ce01e44c-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:07 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d9477923-1e82-4f32-bda8-5518430dca6b tempest-VolumesGetTest-1118799669 None] Lock "cinder-e8865063-5a24-42ff-bca8-8973ce01e44c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:07 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d9477923-1e82-4f32-bda8-5518430dca6b tempest-VolumesGetTest-1118799669 None] Acquiring lock "cinder-quobyte-e8865063-5a24-42ff-bca8-8973ce01e44c" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:07 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d9477923-1e82-4f32-bda8-5518430dca6b tempest-VolumesGetTest-1118799669 None] Lock "cinder-quobyte-e8865063-5a24-42ff-bca8-8973ce01e44c" acquired by "delete_volume" :: waited 0.019s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:07 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8dacd6-bcb7-4cce-97f9-c91c369bdf29]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:03:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d9477923-1e82-4f32-bda8-5518430dca6b tempest-VolumesGetTest-1118799669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e8865063-5a24-42ff-bca8-8973ce01e44c {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:07 devstack sudo[102865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e8865063-5a24-42ff-bca8-8973ce01e44c Jul 30 17:03:07 devstack sudo[102865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:07 devstack sudo[102863]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ea47f1ae-7a67-484c-a754-fa1c3d51b291 tempest-VolumesSnapshotListTestJSON-700740194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.2a6443c7-d667-40e4-acfa-e7a96b33f01e" returned: 0 in 0.392s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:07 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-ea47f1ae-7a67-484c-a754-fa1c3d51b291 tempest-VolumesSnapshotListTestJSON-700740194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3160d2a-b30b-416b-a02e-429f73e00900(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:03:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ea47f1ae-7a67-484c-a754-fa1c3d51b291 tempest-VolumesSnapshotListTestJSON-700740194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.2a6443c7-d667-40e4-acfa-e7a96b33f01e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.60af7609-c76e-4d04-8313-95e1ecf3dcd1 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:07 devstack sudo[102870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.2a6443c7-d667-40e4-acfa-e7a96b33f01e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.60af7609-c76e-4d04-8313-95e1ecf3dcd1 1G Jul 30 17:03:07 devstack sudo[102870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:07 devstack sudo[102865]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d9477923-1e82-4f32-bda8-5518430dca6b tempest-VolumesGetTest-1118799669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e8865063-5a24-42ff-bca8-8973ce01e44c" returned: 0 in 0.363s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d9477923-1e82-4f32-bda8-5518430dca6b tempest-VolumesGetTest-1118799669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e8865063-5a24-42ff-bca8-8973ce01e44c {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:07 devstack sudo[102875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e8865063-5a24-42ff-bca8-8973ce01e44c Jul 30 17:03:07 devstack sudo[102875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:07 devstack sudo[102875]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d9477923-1e82-4f32-bda8-5518430dca6b tempest-VolumesGetTest-1118799669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e8865063-5a24-42ff-bca8-8973ce01e44c" returned: 0 in 0.291s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:07 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d9477923-1e82-4f32-bda8-5518430dca6b tempest-VolumesGetTest-1118799669 None] Lock "cinder-quobyte-e8865063-5a24-42ff-bca8-8973ce01e44c" released by "delete_volume" :: held 0.696s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:07 devstack sudo[102870]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ea47f1ae-7a67-484c-a754-fa1c3d51b291 tempest-VolumesSnapshotListTestJSON-700740194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.2a6443c7-d667-40e4-acfa-e7a96b33f01e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.60af7609-c76e-4d04-8313-95e1ecf3dcd1 1G" returned: 0 in 0.525s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ea47f1ae-7a67-484c-a754-fa1c3d51b291 tempest-VolumesSnapshotListTestJSON-700740194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3160d2a-b30b-416b-a02e-429f73e00900.2a6443c7-d667-40e4-acfa-e7a96b33f01e -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.60af7609-c76e-4d04-8313-95e1ecf3dcd1 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:07 devstack sudo[102882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3160d2a-b30b-416b-a02e-429f73e00900.2a6443c7-d667-40e4-acfa-e7a96b33f01e -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.60af7609-c76e-4d04-8313-95e1ecf3dcd1 Jul 30 17:03:07 devstack sudo[102882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:07 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-d9477923-1e82-4f32-bda8-5518430dca6b tempest-VolumesGetTest-1118799669 None] Created reservations ['a50e559b-204c-4fdd-ab65-9beeefc45601', '53a18005-916e-4272-9bdf-2368db98a45d', 'e967b694-bedc-41cf-a2f5-1dc346b3abf9', '42ad2b76-636f-4c44-9fdd-74b346e473d1'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:03:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-36d9760a-0ecc-4f99-8601-8ec1f2802c48 tempest-VolumeDependencyTests-893333359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d9477923-1e82-4f32-bda8-5518430dca6b tempest-VolumesGetTest-1118799669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d9477923-1e82-4f32-bda8-5518430dca6b tempest-VolumesGetTest-1118799669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:08 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d9477923-1e82-4f32-bda8-5518430dca6b tempest-VolumesGetTest-1118799669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:03:08 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d9477923-1e82-4f32-bda8-5518430dca6b tempest-VolumesGetTest-1118799669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:03:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d9477923-1e82-4f32-bda8-5518430dca6b tempest-VolumesGetTest-1118799669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d9477923-1e82-4f32-bda8-5518430dca6b tempest-VolumesGetTest-1118799669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:08 devstack sudo[102884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:03:08 devstack sudo[102884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:08 devstack sudo[102882]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ea47f1ae-7a67-484c-a754-fa1c3d51b291 tempest-VolumesSnapshotListTestJSON-700740194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3160d2a-b30b-416b-a02e-429f73e00900.2a6443c7-d667-40e4-acfa-e7a96b33f01e -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.60af7609-c76e-4d04-8313-95e1ecf3dcd1" returned: 0 in 0.346s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:08 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-ea47f1ae-7a67-484c-a754-fa1c3d51b291 tempest-VolumesSnapshotListTestJSON-700740194 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.60af7609-c76e-4d04-8313-95e1ecf3dcd1 is being set with open permissions: ugo+rw Jul 30 17:03:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ea47f1ae-7a67-484c-a754-fa1c3d51b291 tempest-VolumesSnapshotListTestJSON-700740194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.60af7609-c76e-4d04-8313-95e1ecf3dcd1 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:08 devstack sudo[102889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.60af7609-c76e-4d04-8313-95e1ecf3dcd1 Jul 30 17:03:08 devstack sudo[102889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:08 devstack sudo[102884]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d9477923-1e82-4f32-bda8-5518430dca6b tempest-VolumesGetTest-1118799669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.257s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:08 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-d9477923-1e82-4f32-bda8-5518430dca6b tempest-VolumesGetTest-1118799669 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:03:08 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-d9477923-1e82-4f32-bda8-5518430dca6b tempest-VolumesGetTest-1118799669 None] Deleted volume successfully. Jul 30 17:03:08 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d9477923-1e82-4f32-bda8-5518430dca6b tempest-VolumesGetTest-1118799669 None] Lock "cinder-e8865063-5a24-42ff-bca8-8973ce01e44c-delete_volume" released by "delete_volume" :: held 1.208s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:08 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-64d6eb17-3608-4cf3-b7d4-866c43989ba9 tempest-VolumesGetTest-1118799669 None] Acquiring lock "cinder-116c8fd7-7bb4-4ad6-b7ab-81d7be29b8b7-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:08 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-64d6eb17-3608-4cf3-b7d4-866c43989ba9 tempest-VolumesGetTest-1118799669 None] Lock "cinder-116c8fd7-7bb4-4ad6-b7ab-81d7be29b8b7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:08 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-64d6eb17-3608-4cf3-b7d4-866c43989ba9 tempest-VolumesGetTest-1118799669 None] Acquiring lock "cinder-quobyte-116c8fd7-7bb4-4ad6-b7ab-81d7be29b8b7" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:08 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-64d6eb17-3608-4cf3-b7d4-866c43989ba9 tempest-VolumesGetTest-1118799669 None] Lock "cinder-quobyte-116c8fd7-7bb4-4ad6-b7ab-81d7be29b8b7" acquired by "delete_volume" :: waited 0.015s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:08 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f5d302-a26e-4fae-91f0-96fd21c36d76]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:03:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-64d6eb17-3608-4cf3-b7d4-866c43989ba9 tempest-VolumesGetTest-1118799669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-116c8fd7-7bb4-4ad6-b7ab-81d7be29b8b7 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:08 devstack sudo[102889]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ea47f1ae-7a67-484c-a754-fa1c3d51b291 tempest-VolumesSnapshotListTestJSON-700740194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.60af7609-c76e-4d04-8313-95e1ecf3dcd1" returned: 0 in 0.271s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ea47f1ae-7a67-484c-a754-fa1c3d51b291 tempest-VolumesSnapshotListTestJSON-700740194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.672s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-36d9760a-0ecc-4f99-8601-8ec1f2802c48 tempest-VolumeDependencyTests-893333359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.549s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:08 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-36d9760a-0ecc-4f99-8601-8ec1f2802c48 tempest-VolumeDependencyTests-893333359 None] Creating offline snapshot 91212cfe-db13-400b-928e-99f16d395af8 of volume 8b4df5f2-73ba-4d23-b402-6251d845636c {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:03:08 devstack sudo[102893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-116c8fd7-7bb4-4ad6-b7ab-81d7be29b8b7 Jul 30 17:03:08 devstack sudo[102893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:08 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-ea47f1ae-7a67-484c-a754-fa1c3d51b291 tempest-VolumesSnapshotListTestJSON-700740194 None] Create snapshot completed successfully Jul 30 17:03:08 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[056dec6e-f234-4924-986d-c8558230c723]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:03:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-36d9760a-0ecc-4f99-8601-8ec1f2802c48 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b4df5f2-73ba-4d23-b402-6251d845636c {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:08 devstack sudo[102895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b4df5f2-73ba-4d23-b402-6251d845636c Jul 30 17:03:08 devstack sudo[102895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:08 devstack sudo[102893]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-64d6eb17-3608-4cf3-b7d4-866c43989ba9 tempest-VolumesGetTest-1118799669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-116c8fd7-7bb4-4ad6-b7ab-81d7be29b8b7" returned: 0 in 0.363s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-64d6eb17-3608-4cf3-b7d4-866c43989ba9 tempest-VolumesGetTest-1118799669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-116c8fd7-7bb4-4ad6-b7ab-81d7be29b8b7 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:08 devstack sudo[102900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-116c8fd7-7bb4-4ad6-b7ab-81d7be29b8b7 Jul 30 17:03:08 devstack sudo[102900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:09 devstack sudo[102895]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-36d9760a-0ecc-4f99-8601-8ec1f2802c48 tempest-VolumeDependencyTests-893333359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b4df5f2-73ba-4d23-b402-6251d845636c" returned: 0 in 0.408s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-36d9760a-0ecc-4f99-8601-8ec1f2802c48 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b4df5f2-73ba-4d23-b402-6251d845636c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b4df5f2-73ba-4d23-b402-6251d845636c.91212cfe-db13-400b-928e-99f16d395af8 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:09 devstack sudo[102905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b4df5f2-73ba-4d23-b402-6251d845636c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b4df5f2-73ba-4d23-b402-6251d845636c.91212cfe-db13-400b-928e-99f16d395af8 1G Jul 30 17:03:09 devstack sudo[102905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:09 devstack sudo[102900]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-64d6eb17-3608-4cf3-b7d4-866c43989ba9 tempest-VolumesGetTest-1118799669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-116c8fd7-7bb4-4ad6-b7ab-81d7be29b8b7" returned: 0 in 0.355s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:09 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-64d6eb17-3608-4cf3-b7d4-866c43989ba9 tempest-VolumesGetTest-1118799669 None] Lock "cinder-quobyte-116c8fd7-7bb4-4ad6-b7ab-81d7be29b8b7" released by "delete_volume" :: held 0.774s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b6e8692d-c250-4f20-9933-ff8f620d7109 tempest-VolumesSnapshotListTestJSON-700740194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:09 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-64d6eb17-3608-4cf3-b7d4-866c43989ba9 tempest-VolumesGetTest-1118799669 None] Created reservations ['24d71ce1-1343-4fb1-a89f-187124a44735', 'a8a6b1b2-306f-4203-833e-5dc14ef04e6d', 'e6ea68c4-fc9d-49e5-bdb1-f0eb64f72b72', '16d1b402-93ee-40c3-87c7-35fc3183d883'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:03:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-64d6eb17-3608-4cf3-b7d4-866c43989ba9 tempest-VolumesGetTest-1118799669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-64d6eb17-3608-4cf3-b7d4-866c43989ba9 tempest-VolumesGetTest-1118799669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:09 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-64d6eb17-3608-4cf3-b7d4-866c43989ba9 tempest-VolumesGetTest-1118799669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:03:09 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-64d6eb17-3608-4cf3-b7d4-866c43989ba9 tempest-VolumesGetTest-1118799669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:03:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-64d6eb17-3608-4cf3-b7d4-866c43989ba9 tempest-VolumesGetTest-1118799669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-64d6eb17-3608-4cf3-b7d4-866c43989ba9 tempest-VolumesGetTest-1118799669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:09 devstack sudo[102911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:03:09 devstack sudo[102911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:09 devstack sudo[102905]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-36d9760a-0ecc-4f99-8601-8ec1f2802c48 tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b4df5f2-73ba-4d23-b402-6251d845636c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b4df5f2-73ba-4d23-b402-6251d845636c.91212cfe-db13-400b-928e-99f16d395af8 1G" returned: 0 in 0.472s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-36d9760a-0ecc-4f99-8601-8ec1f2802c48 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b4df5f2-73ba-4d23-b402-6251d845636c -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b4df5f2-73ba-4d23-b402-6251d845636c.91212cfe-db13-400b-928e-99f16d395af8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:09 devstack sudo[102913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b4df5f2-73ba-4d23-b402-6251d845636c -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b4df5f2-73ba-4d23-b402-6251d845636c.91212cfe-db13-400b-928e-99f16d395af8 Jul 30 17:03:09 devstack sudo[102913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:09 devstack sudo[102911]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:09 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-1cc8628e-6a8c-4aac-bcf9-660124afe060 tempest-VolumesGetTest-1118799669 None] Acquiring lock "cinder-c9dcecfb-cb74-419b-84d8-f503e403c5ed-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-64d6eb17-3608-4cf3-b7d4-866c43989ba9 tempest-VolumesGetTest-1118799669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.286s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:09 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-64d6eb17-3608-4cf3-b7d4-866c43989ba9 tempest-VolumesGetTest-1118799669 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:03:09 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-64d6eb17-3608-4cf3-b7d4-866c43989ba9 tempest-VolumesGetTest-1118799669 None] Deleted volume successfully. Jul 30 17:03:09 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-1cc8628e-6a8c-4aac-bcf9-660124afe060 tempest-VolumesGetTest-1118799669 None] Lock "cinder-c9dcecfb-cb74-419b-84d8-f503e403c5ed-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:09 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-64d6eb17-3608-4cf3-b7d4-866c43989ba9 tempest-VolumesGetTest-1118799669 None] Lock "cinder-116c8fd7-7bb4-4ad6-b7ab-81d7be29b8b7-delete_volume" released by "delete_volume" :: held 1.286s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:09 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-1cc8628e-6a8c-4aac-bcf9-660124afe060 tempest-VolumesGetTest-1118799669 None] Acquiring lock "cinder-quobyte-c9dcecfb-cb74-419b-84d8-f503e403c5ed" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:09 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-1cc8628e-6a8c-4aac-bcf9-660124afe060 tempest-VolumesGetTest-1118799669 None] Lock "cinder-quobyte-c9dcecfb-cb74-419b-84d8-f503e403c5ed" acquired by "delete_volume" :: waited 0.015s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:09 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[75170442-01e1-421c-acf5-6f5ba7b58fee]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:03:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1cc8628e-6a8c-4aac-bcf9-660124afe060 tempest-VolumesGetTest-1118799669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:09 devstack sudo[102913]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-36d9760a-0ecc-4f99-8601-8ec1f2802c48 tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b4df5f2-73ba-4d23-b402-6251d845636c -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b4df5f2-73ba-4d23-b402-6251d845636c.91212cfe-db13-400b-928e-99f16d395af8" returned: 0 in 0.315s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:09 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-36d9760a-0ecc-4f99-8601-8ec1f2802c48 tempest-VolumeDependencyTests-893333359 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b4df5f2-73ba-4d23-b402-6251d845636c.91212cfe-db13-400b-928e-99f16d395af8 is being set with open permissions: ugo+rw Jul 30 17:03:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-36d9760a-0ecc-4f99-8601-8ec1f2802c48 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b4df5f2-73ba-4d23-b402-6251d845636c.91212cfe-db13-400b-928e-99f16d395af8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:09 devstack sudo[102920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b4df5f2-73ba-4d23-b402-6251d845636c.91212cfe-db13-400b-928e-99f16d395af8 Jul 30 17:03:09 devstack sudo[102920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:09 devstack sudo[102919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed Jul 30 17:03:09 devstack sudo[102919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:10 devstack sudo[102920]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-36d9760a-0ecc-4f99-8601-8ec1f2802c48 tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b4df5f2-73ba-4d23-b402-6251d845636c.91212cfe-db13-400b-928e-99f16d395af8" returned: 0 in 0.262s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-36d9760a-0ecc-4f99-8601-8ec1f2802c48 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b4df5f2-73ba-4d23-b402-6251d845636c.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:10 devstack sudo[102919]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1cc8628e-6a8c-4aac-bcf9-660124afe060 tempest-VolumesGetTest-1118799669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed" returned: 0 in 0.380s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1cc8628e-6a8c-4aac-bcf9-660124afe060 tempest-VolumesGetTest-1118799669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:10 devstack sudo[102928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b4df5f2-73ba-4d23-b402-6251d845636c.info Jul 30 17:03:10 devstack sudo[102928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:10 devstack sudo[102929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed Jul 30 17:03:10 devstack sudo[102929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:10 devstack sudo[102928]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-36d9760a-0ecc-4f99-8601-8ec1f2802c48 tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b4df5f2-73ba-4d23-b402-6251d845636c.info" returned: 0 in 0.254s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:10 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-36d9760a-0ecc-4f99-8601-8ec1f2802c48 tempest-VolumeDependencyTests-893333359 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b4df5f2-73ba-4d23-b402-6251d845636c.info is being set with open permissions: ugo+rw Jul 30 17:03:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-36d9760a-0ecc-4f99-8601-8ec1f2802c48 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b4df5f2-73ba-4d23-b402-6251d845636c.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:10 devstack sudo[102929]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1cc8628e-6a8c-4aac-bcf9-660124afe060 tempest-VolumesGetTest-1118799669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c9dcecfb-cb74-419b-84d8-f503e403c5ed" returned: 0 in 0.241s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:10 devstack sudo[102934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b4df5f2-73ba-4d23-b402-6251d845636c.info Jul 30 17:03:10 devstack sudo[102934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:10 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-1cc8628e-6a8c-4aac-bcf9-660124afe060 tempest-VolumesGetTest-1118799669 None] Lock "cinder-quobyte-c9dcecfb-cb74-419b-84d8-f503e403c5ed" released by "delete_volume" :: held 0.684s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:10 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-1cc8628e-6a8c-4aac-bcf9-660124afe060 tempest-VolumesGetTest-1118799669 None] Created reservations ['e973c0cd-fc8d-488c-be7a-9300fbcfa9ea', 'f2642a1d-b661-4ac1-b49f-e6252a7760bc', '8d97971b-b2f3-43e6-b619-e54b4d51f2f5', 'fc1b725d-54e4-46a3-84d4-f6aa272fc986'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:03:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1cc8628e-6a8c-4aac-bcf9-660124afe060 tempest-VolumesGetTest-1118799669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1cc8628e-6a8c-4aac-bcf9-660124afe060 tempest-VolumesGetTest-1118799669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:10 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-1cc8628e-6a8c-4aac-bcf9-660124afe060 tempest-VolumesGetTest-1118799669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:03:10 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-1cc8628e-6a8c-4aac-bcf9-660124afe060 tempest-VolumesGetTest-1118799669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:03:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1cc8628e-6a8c-4aac-bcf9-660124afe060 tempest-VolumesGetTest-1118799669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1cc8628e-6a8c-4aac-bcf9-660124afe060 tempest-VolumesGetTest-1118799669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:10 devstack sudo[102936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:03:10 devstack sudo[102936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:10 devstack sudo[102934]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-36d9760a-0ecc-4f99-8601-8ec1f2802c48 tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b4df5f2-73ba-4d23-b402-6251d845636c.info" returned: 0 in 0.250s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-36d9760a-0ecc-4f99-8601-8ec1f2802c48 tempest-VolumeDependencyTests-893333359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.068s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b6e8692d-c250-4f20-9933-ff8f620d7109 tempest-VolumesSnapshotListTestJSON-700740194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.395s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:10 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-b6e8692d-c250-4f20-9933-ff8f620d7109 tempest-VolumesSnapshotListTestJSON-700740194 None] Creating offline snapshot 6cec3532-f881-4ad3-ad2c-6f7a61567ce1 of volume b3160d2a-b30b-416b-a02e-429f73e00900 {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:03:10 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-36d9760a-0ecc-4f99-8601-8ec1f2802c48 tempest-VolumeDependencyTests-893333359 None] Create snapshot completed successfully Jul 30 17:03:10 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[646aaf4a-b1d3-430a-8413-ca59493f1e5a]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:03:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b6e8692d-c250-4f20-9933-ff8f620d7109 tempest-VolumesSnapshotListTestJSON-700740194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.60af7609-c76e-4d04-8313-95e1ecf3dcd1 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:10 devstack sudo[102936]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1cc8628e-6a8c-4aac-bcf9-660124afe060 tempest-VolumesGetTest-1118799669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.280s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:10 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-1cc8628e-6a8c-4aac-bcf9-660124afe060 tempest-VolumesGetTest-1118799669 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:03:10 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-1cc8628e-6a8c-4aac-bcf9-660124afe060 tempest-VolumesGetTest-1118799669 None] Deleted volume successfully. Jul 30 17:03:10 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-1cc8628e-6a8c-4aac-bcf9-660124afe060 tempest-VolumesGetTest-1118799669 None] Lock "cinder-c9dcecfb-cb74-419b-84d8-f503e403c5ed-delete_volume" released by "delete_volume" :: held 1.166s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:10 devstack sudo[102939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.60af7609-c76e-4d04-8313-95e1ecf3dcd1 Jul 30 17:03:10 devstack sudo[102939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:11 devstack sudo[102939]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b6e8692d-c250-4f20-9933-ff8f620d7109 tempest-VolumesSnapshotListTestJSON-700740194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.60af7609-c76e-4d04-8313-95e1ecf3dcd1" returned: 0 in 0.408s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:11 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-b6e8692d-c250-4f20-9933-ff8f620d7109 tempest-VolumesSnapshotListTestJSON-700740194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3160d2a-b30b-416b-a02e-429f73e00900(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:03:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b6e8692d-c250-4f20-9933-ff8f620d7109 tempest-VolumesSnapshotListTestJSON-700740194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.60af7609-c76e-4d04-8313-95e1ecf3dcd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.6cec3532-f881-4ad3-ad2c-6f7a61567ce1 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:11 devstack sudo[102946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.60af7609-c76e-4d04-8313-95e1ecf3dcd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.6cec3532-f881-4ad3-ad2c-6f7a61567ce1 1G Jul 30 17:03:11 devstack sudo[102946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:11 devstack sudo[102946]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b6e8692d-c250-4f20-9933-ff8f620d7109 tempest-VolumesSnapshotListTestJSON-700740194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.60af7609-c76e-4d04-8313-95e1ecf3dcd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.6cec3532-f881-4ad3-ad2c-6f7a61567ce1 1G" returned: 0 in 0.579s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b6e8692d-c250-4f20-9933-ff8f620d7109 tempest-VolumesSnapshotListTestJSON-700740194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3160d2a-b30b-416b-a02e-429f73e00900.60af7609-c76e-4d04-8313-95e1ecf3dcd1 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.6cec3532-f881-4ad3-ad2c-6f7a61567ce1 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:11 devstack sudo[102953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3160d2a-b30b-416b-a02e-429f73e00900.60af7609-c76e-4d04-8313-95e1ecf3dcd1 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.6cec3532-f881-4ad3-ad2c-6f7a61567ce1 Jul 30 17:03:11 devstack sudo[102953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:11 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:03:11 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] Flow 'volume_create_manager' (e76a49dd-a528-48e8-8b11-ff7837120e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:03:11 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bff004c-4f08-4364-bc21-9964d850b8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:11 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bff004c-4f08-4364-bc21-9964d850b8e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1980825987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6b2657f-9eac-4778-9ef0-5d5e750ce5a0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='19c6e94e27fa4ce98248b491a048f03e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:03:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:03:12Z,use_quota=True,user_id='58b251ff552e40e38310aedc71e0c3f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:11 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2945465-d857-4dfd-b975-b4f784cfd140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:11 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2945465-d857-4dfd-b975-b4f784cfd140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:11 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aac63aad-0de4-4719-a31e-47269a4ea4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:11 devstack cinder-volume[88591]: DEBUG cinder.image.glance [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] Creating Keystone auth plugin from conf {{(pid=88591) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 30 17:03:11 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-f993d70c-1729-475f-980c-ae11a5260866 tempest-VolumeDependencyTests-893333359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:03:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f993d70c-1729-475f-980c-ae11a5260866 tempest-VolumeDependencyTests-893333359 None] Flow 'volume_create_manager' (c049f73d-9598-4b63-8c8b-c8ad632652b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:03:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f993d70c-1729-475f-980c-ae11a5260866 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3af59958-52ad-4955-b51b-1f0e52226fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f993d70c-1729-475f-980c-ae11a5260866 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3af59958-52ad-4955-b51b-1f0e52226fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-823563634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=988dafa5-d9ee-4160-a89b-fc5bc9d09673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1142be8cf434dc9b1a32ef12a92e88b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:03:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=91212cfe-db13-400b-928e-99f16d395af8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:03:12Z,use_quota=True,user_id='db3e9fa2901f4abe9034e8c4a4f63fb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f993d70c-1729-475f-980c-ae11a5260866 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a90cbf3-9345-48f6-8d9b-e86281aa3d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f993d70c-1729-475f-980c-ae11a5260866 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a90cbf3-9345-48f6-8d9b-e86281aa3d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:12 devstack sudo[102953]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f993d70c-1729-475f-980c-ae11a5260866 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96e9bf3c-1f80-4afd-814e-a5b49002085c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f993d70c-1729-475f-980c-ae11a5260866 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96e9bf3c-1f80-4afd-814e-a5b49002085c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '988dafa5-d9ee-4160-a89b-fc5bc9d09673', 'volume_name': 'volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673', 'volume_size': 1, 'snapshot_id': '91212cfe-db13-400b-928e-99f16d395af8'}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f993d70c-1729-475f-980c-ae11a5260866 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (950729c9-abe4-441d-8405-3e101ade49d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f993d70c-1729-475f-980c-ae11a5260866 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (950729c9-abe4-441d-8405-3e101ade49d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f993d70c-1729-475f-980c-ae11a5260866 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fea6267b-389b-4019-a3d0-1b34f627e294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:12 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-f993d70c-1729-475f-980c-ae11a5260866 tempest-VolumeDependencyTests-893333359 None] Volume 988dafa5-d9ee-4160-a89b-fc5bc9d09673: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673', 'volume_size': 1, 'snapshot_id': '91212cfe-db13-400b-928e-99f16d395af8'} Jul 30 17:03:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b6e8692d-c250-4f20-9933-ff8f620d7109 tempest-VolumesSnapshotListTestJSON-700740194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3160d2a-b30b-416b-a02e-429f73e00900.60af7609-c76e-4d04-8313-95e1ecf3dcd1 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.6cec3532-f881-4ad3-ad2c-6f7a61567ce1" returned: 0 in 0.362s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:12 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-b6e8692d-c250-4f20-9933-ff8f620d7109 tempest-VolumesSnapshotListTestJSON-700740194 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.6cec3532-f881-4ad3-ad2c-6f7a61567ce1 is being set with open permissions: ugo+rw Jul 30 17:03:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b6e8692d-c250-4f20-9933-ff8f620d7109 tempest-VolumesSnapshotListTestJSON-700740194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.6cec3532-f881-4ad3-ad2c-6f7a61567ce1 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f993d70c-1729-475f-980c-ae11a5260866 tempest-VolumeDependencyTests-893333359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:12 devstack sudo[102959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.6cec3532-f881-4ad3-ad2c-6f7a61567ce1 Jul 30 17:03:12 devstack sudo[102959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aac63aad-0de4-4719-a31e-47269a4ea4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c6b2657f-9eac-4778-9ef0-5d5e750ce5a0', 'volume_name': 'volume-c6b2657f-9eac-4778-9ef0-5d5e750ce5a0', 'volume_size': 1, 'image_id': 'fb94d6e3-28d4-406f-8bad-19349d5f8454', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fb94d6e3-28d4-406f-8bad-19349d5f8454', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7e05c21dff7b441db433e2a7736519e9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fb94d6e3-28d4-406f-8bad-19349d5f8454', 'created_at': datetime.datetime(2026, 7, 30, 14, 42, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 42, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fb94d6e3-28d4-406f-8bad-19349d5f8454/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69e28c98-98ac-4483-afde-b1843e4bf831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69e28c98-98ac-4483-afde-b1843e4bf831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8195f482-4f42-4221-8cbd-9744dada5249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:12 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] Volume c6b2657f-9eac-4778-9ef0-5d5e750ce5a0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c6b2657f-9eac-4778-9ef0-5d5e750ce5a0', 'volume_size': 1, 'image_id': 'fb94d6e3-28d4-406f-8bad-19349d5f8454', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fb94d6e3-28d4-406f-8bad-19349d5f8454', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7e05c21dff7b441db433e2a7736519e9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fb94d6e3-28d4-406f-8bad-19349d5f8454', 'created_at': datetime.datetime(2026, 7, 30, 14, 42, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 42, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fb94d6e3-28d4-406f-8bad-19349d5f8454/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 30 17:03:12 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] Trying to clone c6b2657f-9eac-4778-9ef0-5d5e750ce5a0 from image fb94d6e3-28d4-406f-8bad-19349d5f8454 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fb94d6e3-28d4-406f-8bad-19349d5f8454', 'metadata': {}}]). {{(pid=88591) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 30 17:03:12 devstack sudo[102959]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b6e8692d-c250-4f20-9933-ff8f620d7109 tempest-VolumesSnapshotListTestJSON-700740194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.6cec3532-f881-4ad3-ad2c-6f7a61567ce1" returned: 0 in 0.266s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b6e8692d-c250-4f20-9933-ff8f620d7109 tempest-VolumesSnapshotListTestJSON-700740194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.739s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f993d70c-1729-475f-980c-ae11a5260866 tempest-VolumeDependencyTests-893333359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.290s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:12 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f993d70c-1729-475f-980c-ae11a5260866 tempest-VolumeDependencyTests-893333359 None] Acquiring lock "cinder-quobyte-91212cfe-db13-400b-928e-99f16d395af8-988dafa5-d9ee-4160-a89b-fc5bc9d09673" by "_create_volume_from_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:12 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f993d70c-1729-475f-980c-ae11a5260866 tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-91212cfe-db13-400b-928e-99f16d395af8-988dafa5-d9ee-4160-a89b-fc5bc9d09673" acquired by "_create_volume_from_snapshot" :: waited 0.043s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f993d70c-1729-475f-980c-ae11a5260866 tempest-VolumeDependencyTests-893333359 None] Creating volume 988dafa5-d9ee-4160-a89b-fc5bc9d09673 from snapshot 91212cfe-db13-400b-928e-99f16d395af8 {{(pid=88591) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 30 17:03:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f993d70c-1729-475f-980c-ae11a5260866 tempest-VolumeDependencyTests-893333359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f993d70c-1729-475f-980c-ae11a5260866 tempest-VolumeDependencyTests-893333359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f993d70c-1729-475f-980c-ae11a5260866 tempest-VolumeDependencyTests-893333359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:03:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f993d70c-1729-475f-980c-ae11a5260866 tempest-VolumeDependencyTests-893333359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:03:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f993d70c-1729-475f-980c-ae11a5260866 tempest-VolumeDependencyTests-893333359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f993d70c-1729-475f-980c-ae11a5260866 tempest-VolumeDependencyTests-893333359 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:03:12 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f993d70c-1729-475f-980c-ae11a5260866 tempest-VolumeDependencyTests-893333359 None] Acquiring lock "cinder-quobyte-988dafa5-d9ee-4160-a89b-fc5bc9d09673" by "_copy_volume_from_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:12 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f993d70c-1729-475f-980c-ae11a5260866 tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-988dafa5-d9ee-4160-a89b-fc5bc9d09673" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f993d70c-1729-475f-980c-ae11a5260866 tempest-VolumeDependencyTests-893333359 None] snapshot: 91212cfe-db13-400b-928e-99f16d395af8, volume: 988dafa5-d9ee-4160-a89b-fc5bc9d09673, {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 17:03:12 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-b6e8692d-c250-4f20-9933-ff8f620d7109 tempest-VolumesSnapshotListTestJSON-700740194 None] Create snapshot completed successfully Jul 30 17:03:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f993d70c-1729-475f-980c-ae11a5260866 tempest-VolumeDependencyTests-893333359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f993d70c-1729-475f-980c-ae11a5260866 tempest-VolumeDependencyTests-893333359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f993d70c-1729-475f-980c-ae11a5260866 tempest-VolumeDependencyTests-893333359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:03:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f993d70c-1729-475f-980c-ae11a5260866 tempest-VolumeDependencyTests-893333359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:03:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f993d70c-1729-475f-980c-ae11a5260866 tempest-VolumeDependencyTests-893333359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:12 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b592176b-cfea-41d2-881e-152e08af4aa6]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:03:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f993d70c-1729-475f-980c-ae11a5260866 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b4df5f2-73ba-4d23-b402-6251d845636c.91212cfe-db13-400b-928e-99f16d395af8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:12 devstack cinder-volume[88591]: DEBUG oslo_service.periodic_task [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 17:03:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:03:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:03:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:12 devstack sudo[102965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:03:12 devstack sudo[102965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:12 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_0okty804devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88591) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 30 17:03:12 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] Image download 20.69 MB at 20.69 MB/s Jul 30 17:03:12 devstack sudo[102964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b4df5f2-73ba-4d23-b402-6251d845636c.91212cfe-db13-400b-928e-99f16d395af8 Jul 30 17:03:12 devstack sudo[102964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:12 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d13d5b5-847c-4a69-8613-ca4258d92d04]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:03:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_0okty804devstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:12 devstack sudo[102968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_0okty804devstack@QuobyteHD Jul 30 17:03:12 devstack sudo[102968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:12 devstack sudo[102965]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.379s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:12 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:03:12 devstack cinder-volume[88591]: DEBUG oslo_service.periodic_task [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running periodic task VolumeManager._thread_info {{(pid=88591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 17:03:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] thread count: 28 {{(pid=88591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 17:03:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] thread info: [<_MainThread(MainThread, started 140677178003584)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 17:03:12 devstack sudo[102964]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f993d70c-1729-475f-980c-ae11a5260866 tempest-VolumeDependencyTests-893333359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b4df5f2-73ba-4d23-b402-6251d845636c.91212cfe-db13-400b-928e-99f16d395af8" returned: 0 in 0.438s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-f993d70c-1729-475f-980c-ae11a5260866 tempest-VolumeDependencyTests-893333359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b4df5f2-73ba-4d23-b402-6251d845636c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:03:13 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[10deda62-ea8e-47fe-9cf6-2074ed6aafdc]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:03:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f993d70c-1729-475f-980c-ae11a5260866 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b4df5f2-73ba-4d23-b402-6251d845636c {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:13 devstack sudo[102974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b4df5f2-73ba-4d23-b402-6251d845636c Jul 30 17:03:13 devstack sudo[102974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:13 devstack sudo[102968]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_0okty804devstack@QuobyteHD" returned: 0 in 0.412s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:13 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] Temporary image fb94d6e3-28d4-406f-8bad-19349d5f8454 is fetched for user 58b251ff552e40e38310aedc71e0c3f0. {{(pid=88591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 30 17:03:13 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32a393f-a0e0-446f-a581-31d2368bba5c]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:03:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_0okty804devstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:13 devstack sudo[102980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_0okty804devstack@QuobyteHD Jul 30 17:03:13 devstack sudo[102980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:13 devstack sudo[102974]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f993d70c-1729-475f-980c-ae11a5260866 tempest-VolumeDependencyTests-893333359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b4df5f2-73ba-4d23-b402-6251d845636c" returned: 0 in 0.444s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:13 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f993d70c-1729-475f-980c-ae11a5260866 tempest-VolumeDependencyTests-893333359 None] will copy from snapshot at /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b4df5f2-73ba-4d23-b402-6251d845636c {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 17:03:13 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f993d70c-1729-475f-980c-ae11a5260866 tempest-VolumeDependencyTests-893333359 None] Creating direct copy from snapshot {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 17:03:13 devstack cinder-volume[88591]: DEBUG cinder.utils [None req-f993d70c-1729-475f-980c-ae11a5260866 tempest-VolumeDependencyTests-893333359 None] Path /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673 not found in is_blk_device check {{(pid=88591) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 17:03:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f993d70c-1729-475f-980c-ae11a5260866 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b4df5f2-73ba-4d23-b402-6251d845636c /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:13 devstack sudo[102985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b4df5f2-73ba-4d23-b402-6251d845636c /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673 Jul 30 17:03:13 devstack sudo[102985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:13 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-166aca17-eb9b-4592-a0fc-434972987905 tempest-VolumesSnapshotListTestJSON-700740194 None] Acquiring lock "cinder-6cec3532-f881-4ad3-ad2c-6f7a61567ce1-delete_snapshot" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:13 devstack sudo[102980]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_0okty804devstack@QuobyteHD" returned: 0 in 0.361s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:13 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-166aca17-eb9b-4592-a0fc-434972987905 tempest-VolumesSnapshotListTestJSON-700740194 None] Lock "cinder-6cec3532-f881-4ad3-ad2c-6f7a61567ce1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:13 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-166aca17-eb9b-4592-a0fc-434972987905 tempest-VolumesSnapshotListTestJSON-700740194 None] Acquiring lock "cinder-quobyte-b3160d2a-b30b-416b-a02e-429f73e00900" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:13 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-166aca17-eb9b-4592-a0fc-434972987905 tempest-VolumesSnapshotListTestJSON-700740194 None] Lock "cinder-quobyte-b3160d2a-b30b-416b-a02e-429f73e00900" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:13 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-166aca17-eb9b-4592-a0fc-434972987905 tempest-VolumesSnapshotListTestJSON-700740194 None] Acquiring lock "cinder-quobyte-6cec3532-f881-4ad3-ad2c-6f7a61567ce1" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:13 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-166aca17-eb9b-4592-a0fc-434972987905 tempest-VolumesSnapshotListTestJSON-700740194 None] Lock "cinder-quobyte-6cec3532-f881-4ad3-ad2c-6f7a61567ce1" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:13 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-166aca17-eb9b-4592-a0fc-434972987905 tempest-VolumesSnapshotListTestJSON-700740194 None] Deleting offline snapshot 6cec3532-f881-4ad3-ad2c-6f7a61567ce1 of volume b3160d2a-b30b-416b-a02e-429f73e00900 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:03:13 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-166aca17-eb9b-4592-a0fc-434972987905 tempest-VolumesSnapshotListTestJSON-700740194 None] snapshot_file for this snap is: volume-b3160d2a-b30b-416b-a02e-429f73e00900.6cec3532-f881-4ad3-ad2c-6f7a61567ce1 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:03:13 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c532472-beb1-4f0d-986b-bcce842abab6]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:03:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-166aca17-eb9b-4592-a0fc-434972987905 tempest-VolumesSnapshotListTestJSON-700740194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.6cec3532-f881-4ad3-ad2c-6f7a61567ce1 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:13 devstack sudo[102992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.6cec3532-f881-4ad3-ad2c-6f7a61567ce1 Jul 30 17:03:13 devstack sudo[102992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:14 devstack sudo[102992]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-166aca17-eb9b-4592-a0fc-434972987905 tempest-VolumesSnapshotListTestJSON-700740194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.6cec3532-f881-4ad3-ad2c-6f7a61567ce1" returned: 0 in 0.485s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:14 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-166aca17-eb9b-4592-a0fc-434972987905 tempest-VolumesSnapshotListTestJSON-700740194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3160d2a-b30b-416b-a02e-429f73e00900(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:03:14 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[57fa12c5-d925-4431-8929-d2563c3b4217]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:03:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-166aca17-eb9b-4592-a0fc-434972987905 tempest-VolumesSnapshotListTestJSON-700740194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.60af7609-c76e-4d04-8313-95e1ecf3dcd1 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:14 devstack sudo[103005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.60af7609-c76e-4d04-8313-95e1ecf3dcd1 Jul 30 17:03:14 devstack sudo[103005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:14 devstack sudo[103005]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-166aca17-eb9b-4592-a0fc-434972987905 tempest-VolumesSnapshotListTestJSON-700740194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.60af7609-c76e-4d04-8313-95e1ecf3dcd1" returned: 0 in 0.738s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:15 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-166aca17-eb9b-4592-a0fc-434972987905 tempest-VolumesSnapshotListTestJSON-700740194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3160d2a-b30b-416b-a02e-429f73e00900(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:03:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-166aca17-eb9b-4592-a0fc-434972987905 tempest-VolumesSnapshotListTestJSON-700740194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.6cec3532-f881-4ad3-ad2c-6f7a61567ce1 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:15 devstack sudo[103012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.6cec3532-f881-4ad3-ad2c-6f7a61567ce1 Jul 30 17:03:15 devstack sudo[103012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:15 devstack sudo[103012]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-166aca17-eb9b-4592-a0fc-434972987905 tempest-VolumesSnapshotListTestJSON-700740194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.6cec3532-f881-4ad3-ad2c-6f7a61567ce1" returned: 0 in 0.845s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-166aca17-eb9b-4592-a0fc-434972987905 tempest-VolumesSnapshotListTestJSON-700740194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.6cec3532-f881-4ad3-ad2c-6f7a61567ce1 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:15 devstack sudo[103017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.6cec3532-f881-4ad3-ad2c-6f7a61567ce1 Jul 30 17:03:15 devstack sudo[103017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:16 devstack sudo[103017]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:16 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-166aca17-eb9b-4592-a0fc-434972987905 tempest-VolumesSnapshotListTestJSON-700740194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.6cec3532-f881-4ad3-ad2c-6f7a61567ce1" returned: 0 in 0.971s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:16 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-166aca17-eb9b-4592-a0fc-434972987905 tempest-VolumesSnapshotListTestJSON-700740194 None] Lock "cinder-quobyte-6cec3532-f881-4ad3-ad2c-6f7a61567ce1" released by "_delete_snapshot" :: held 3.228s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:16 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-166aca17-eb9b-4592-a0fc-434972987905 tempest-VolumesSnapshotListTestJSON-700740194 None] Lock "cinder-quobyte-b3160d2a-b30b-416b-a02e-429f73e00900" released by "delete_snapshot" :: held 3.268s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:17 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-166aca17-eb9b-4592-a0fc-434972987905 tempest-VolumesSnapshotListTestJSON-700740194 None] Created reservations ['e242a495-6628-4cfa-abee-d09c09e0c83c', '112e0098-2fbd-4ae4-a23a-931e2b209faa', '07a02990-006e-46f8-a2a3-91650fde133c', 'f49b8087-5e76-4f84-9114-e7d5d5625b0f'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:03:17 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-166aca17-eb9b-4592-a0fc-434972987905 tempest-VolumesSnapshotListTestJSON-700740194 None] Delete snapshot completed successfully. Jul 30 17:03:17 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-166aca17-eb9b-4592-a0fc-434972987905 tempest-VolumesSnapshotListTestJSON-700740194 None] Lock "cinder-6cec3532-f881-4ad3-ad2c-6f7a61567ce1-delete_snapshot" released by "delete_snapshot" :: held 3.610s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:18 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c541364f-d600-4189-9eee-83d5456ec36b tempest-VolumesSnapshotListTestJSON-700740194 None] Acquiring lock "cinder-60af7609-c76e-4d04-8313-95e1ecf3dcd1-delete_snapshot" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:18 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c541364f-d600-4189-9eee-83d5456ec36b tempest-VolumesSnapshotListTestJSON-700740194 None] Lock "cinder-60af7609-c76e-4d04-8313-95e1ecf3dcd1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:18 devstack sudo[102985]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:18 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c541364f-d600-4189-9eee-83d5456ec36b tempest-VolumesSnapshotListTestJSON-700740194 None] Acquiring lock "cinder-quobyte-b3160d2a-b30b-416b-a02e-429f73e00900" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f993d70c-1729-475f-980c-ae11a5260866 tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b4df5f2-73ba-4d23-b402-6251d845636c /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673" returned: 0 in 4.617s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:18 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-f993d70c-1729-475f-980c-ae11a5260866 tempest-VolumeDependencyTests-893333359 None] Image conversion details: src /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b4df5f2-73ba-4d23-b402-6251d845636c, size 1024.00 MB, duration 4.62 sec, destination /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673 {{(pid=88591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 17:03:18 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-f993d70c-1729-475f-980c-ae11a5260866 tempest-VolumeDependencyTests-893333359 None] Converted 1024.00 MB image at 221.74 MB/s Jul 30 17:03:18 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-f993d70c-1729-475f-980c-ae11a5260866 tempest-VolumeDependencyTests-893333359 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673 is being set with open permissions: ugo+rw Jul 30 17:03:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f993d70c-1729-475f-980c-ae11a5260866 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:18 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c541364f-d600-4189-9eee-83d5456ec36b tempest-VolumesSnapshotListTestJSON-700740194 None] Lock "cinder-quobyte-b3160d2a-b30b-416b-a02e-429f73e00900" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:18 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c541364f-d600-4189-9eee-83d5456ec36b tempest-VolumesSnapshotListTestJSON-700740194 None] Acquiring lock "cinder-quobyte-60af7609-c76e-4d04-8313-95e1ecf3dcd1" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:18 devstack sudo[103020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673 Jul 30 17:03:18 devstack sudo[103020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:18 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c541364f-d600-4189-9eee-83d5456ec36b tempest-VolumesSnapshotListTestJSON-700740194 None] Lock "cinder-quobyte-60af7609-c76e-4d04-8313-95e1ecf3dcd1" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:18 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-c541364f-d600-4189-9eee-83d5456ec36b tempest-VolumesSnapshotListTestJSON-700740194 None] Deleting offline snapshot 60af7609-c76e-4d04-8313-95e1ecf3dcd1 of volume b3160d2a-b30b-416b-a02e-429f73e00900 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:03:18 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-c541364f-d600-4189-9eee-83d5456ec36b tempest-VolumesSnapshotListTestJSON-700740194 None] snapshot_file for this snap is: volume-b3160d2a-b30b-416b-a02e-429f73e00900.60af7609-c76e-4d04-8313-95e1ecf3dcd1 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:03:18 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f9190f-9fbd-4101-aebd-897ab0ef7ad5]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:03:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c541364f-d600-4189-9eee-83d5456ec36b tempest-VolumesSnapshotListTestJSON-700740194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.60af7609-c76e-4d04-8313-95e1ecf3dcd1 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:18 devstack sudo[103022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.60af7609-c76e-4d04-8313-95e1ecf3dcd1 Jul 30 17:03:18 devstack sudo[103022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:18 devstack sudo[103020]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f993d70c-1729-475f-980c-ae11a5260866 tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673" returned: 0 in 0.258s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:18 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f993d70c-1729-475f-980c-ae11a5260866 tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-988dafa5-d9ee-4160-a89b-fc5bc9d09673" released by "_copy_volume_from_snapshot" :: held 5.893s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:18 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f993d70c-1729-475f-980c-ae11a5260866 tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-91212cfe-db13-400b-928e-99f16d395af8-988dafa5-d9ee-4160-a89b-fc5bc9d09673" released by "_create_volume_from_snapshot" :: held 5.967s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f993d70c-1729-475f-980c-ae11a5260866 tempest-VolumeDependencyTests-893333359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.011s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.794s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:18 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1980825987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6b2657f-9eac-4778-9ef0-5d5e750ce5a0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='19c6e94e27fa4ce98248b491a048f03e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:03:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:03:12Z,use_quota=True,user_id='58b251ff552e40e38310aedc71e0c3f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:03:18 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] Creating volume c6b2657f-9eac-4778-9ef0-5d5e750ce5a0 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:03:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:18 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:03:18 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:03:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:18 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:03:18 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:03:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c6b2657f-9eac-4778-9ef0-5d5e750ce5a0 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:18 devstack sudo[103025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c6b2657f-9eac-4778-9ef0-5d5e750ce5a0 1073741824 Jul 30 17:03:18 devstack sudo[103025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:18 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f993d70c-1729-475f-980c-ae11a5260866 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fea6267b-389b-4019-a3d0-1b34f627e294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673', 'volume_size': 1, 'snapshot_id': '91212cfe-db13-400b-928e-99f16d395af8'}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:18 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f993d70c-1729-475f-980c-ae11a5260866 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df45ca96-a414-4236-a68d-0d1423f6a6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:18 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-f993d70c-1729-475f-980c-ae11a5260866 tempest-VolumeDependencyTests-893333359 None] Volume volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673 (988dafa5-d9ee-4160-a89b-fc5bc9d09673): created successfully Jul 30 17:03:18 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f993d70c-1729-475f-980c-ae11a5260866 tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df45ca96-a414-4236-a68d-0d1423f6a6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:18 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f993d70c-1729-475f-980c-ae11a5260866 tempest-VolumeDependencyTests-893333359 None] Flow 'volume_create_manager' (c049f73d-9598-4b63-8c8b-c8ad632652b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:03:18 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-f993d70c-1729-475f-980c-ae11a5260866 tempest-VolumeDependencyTests-893333359 None] Created volume successfully. Jul 30 17:03:18 devstack sudo[103022]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c541364f-d600-4189-9eee-83d5456ec36b tempest-VolumesSnapshotListTestJSON-700740194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.60af7609-c76e-4d04-8313-95e1ecf3dcd1" returned: 0 in 0.395s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:18 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-c541364f-d600-4189-9eee-83d5456ec36b tempest-VolumesSnapshotListTestJSON-700740194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3160d2a-b30b-416b-a02e-429f73e00900(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:03:18 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf7341e-8f6b-4cf4-9e67-38a180cb8e07]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:03:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c541364f-d600-4189-9eee-83d5456ec36b tempest-VolumesSnapshotListTestJSON-700740194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.2a6443c7-d667-40e4-acfa-e7a96b33f01e {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:18 devstack sudo[103031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.2a6443c7-d667-40e4-acfa-e7a96b33f01e Jul 30 17:03:18 devstack sudo[103031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:18 devstack sudo[103025]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c6b2657f-9eac-4778-9ef0-5d5e750ce5a0 1073741824" returned: 0 in 0.426s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c6b2657f-9eac-4778-9ef0-5d5e750ce5a0 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:18 devstack sudo[103038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c6b2657f-9eac-4778-9ef0-5d5e750ce5a0 Jul 30 17:03:18 devstack sudo[103038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:18 devstack sudo[103031]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c541364f-d600-4189-9eee-83d5456ec36b tempest-VolumesSnapshotListTestJSON-700740194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.2a6443c7-d667-40e4-acfa-e7a96b33f01e" returned: 0 in 0.377s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:18 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-c541364f-d600-4189-9eee-83d5456ec36b tempest-VolumesSnapshotListTestJSON-700740194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3160d2a-b30b-416b-a02e-429f73e00900(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:03:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c541364f-d600-4189-9eee-83d5456ec36b tempest-VolumesSnapshotListTestJSON-700740194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.60af7609-c76e-4d04-8313-95e1ecf3dcd1 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:18 devstack sudo[103041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.60af7609-c76e-4d04-8313-95e1ecf3dcd1 Jul 30 17:03:18 devstack sudo[103041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:19 devstack sudo[103038]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c6b2657f-9eac-4778-9ef0-5d5e750ce5a0" returned: 0 in 0.266s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:19 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:03:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:19 devstack cinder-volume[88591]: DEBUG cinder.volume.volume_utils [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] Attempting download of fb94d6e3-28d4-406f-8bad-19349d5f8454 ((None, [{'url': 'file:///opt/stack/data/glance/images/fb94d6e3-28d4-406f-8bad-19349d5f8454', 'metadata': {}}])) to volume c6b2657f-9eac-4778-9ef0-5d5e750ce5a0. {{(pid=88591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 30 17:03:19 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c997b80f-ce10-4cf9-a40e-4c40b8f8317a]: (4, 'raw') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:03:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fb94d6e3-28d4-406f-8bad-19349d5f8454_havk6e_i {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:19 devstack sudo[103041]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:19 devstack sudo[103047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fb94d6e3-28d4-406f-8bad-19349d5f8454_havk6e_i Jul 30 17:03:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c541364f-d600-4189-9eee-83d5456ec36b tempest-VolumesSnapshotListTestJSON-700740194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.60af7609-c76e-4d04-8313-95e1ecf3dcd1" returned: 0 in 0.385s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:19 devstack sudo[103047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c541364f-d600-4189-9eee-83d5456ec36b tempest-VolumesSnapshotListTestJSON-700740194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.60af7609-c76e-4d04-8313-95e1ecf3dcd1 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:19 devstack sudo[103049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.60af7609-c76e-4d04-8313-95e1ecf3dcd1 Jul 30 17:03:19 devstack sudo[103049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:19 devstack sudo[103047]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fb94d6e3-28d4-406f-8bad-19349d5f8454_havk6e_i" returned: 0 in 0.346s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fb94d6e3-28d4-406f-8bad-19349d5f8454_havk6e_i {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:19 devstack sudo[103049]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c541364f-d600-4189-9eee-83d5456ec36b tempest-VolumesSnapshotListTestJSON-700740194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.60af7609-c76e-4d04-8313-95e1ecf3dcd1" returned: 0 in 0.267s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:19 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c541364f-d600-4189-9eee-83d5456ec36b tempest-VolumesSnapshotListTestJSON-700740194 None] Lock "cinder-quobyte-60af7609-c76e-4d04-8313-95e1ecf3dcd1" released by "_delete_snapshot" :: held 1.545s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:19 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c541364f-d600-4189-9eee-83d5456ec36b tempest-VolumesSnapshotListTestJSON-700740194 None] Lock "cinder-quobyte-b3160d2a-b30b-416b-a02e-429f73e00900" released by "delete_snapshot" :: held 1.571s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5c954a1a-e514-4cc7-af05-d2135e55fc98 tempest-VolumeDependencyTests-893333359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5c954a1a-e514-4cc7-af05-d2135e55fc98 tempest-VolumeDependencyTests-893333359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:19 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-5c954a1a-e514-4cc7-af05-d2135e55fc98 tempest-VolumeDependencyTests-893333359 None] Creating offline snapshot 2cc870cb-93ed-41c4-b082-808d5290d00d of volume 988dafa5-d9ee-4160-a89b-fc5bc9d09673 {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:03:19 devstack sudo[103054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fb94d6e3-28d4-406f-8bad-19349d5f8454_havk6e_i Jul 30 17:03:19 devstack sudo[103054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:19 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee85fd8-7ff2-411f-b7b6-384cbb2f1644]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:03:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5c954a1a-e514-4cc7-af05-d2135e55fc98 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:19 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-c541364f-d600-4189-9eee-83d5456ec36b tempest-VolumesSnapshotListTestJSON-700740194 None] Created reservations ['78a0a47a-4acb-4bdc-83d6-cd9a41981cef', '5ce76128-2b39-4c54-8e81-7adc0fe34db8', 'f4b06906-66fb-49e7-ba90-8f65deb40347', '1b5943f3-23fe-4b22-a2c8-510aa0f68c5a'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:03:19 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-c541364f-d600-4189-9eee-83d5456ec36b tempest-VolumesSnapshotListTestJSON-700740194 None] Delete snapshot completed successfully. Jul 30 17:03:19 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c541364f-d600-4189-9eee-83d5456ec36b tempest-VolumesSnapshotListTestJSON-700740194 None] Lock "cinder-60af7609-c76e-4d04-8313-95e1ecf3dcd1-delete_snapshot" released by "delete_snapshot" :: held 1.766s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:19 devstack sudo[103056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673 Jul 30 17:03:19 devstack sudo[103056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:19 devstack sudo[103054]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fb94d6e3-28d4-406f-8bad-19349d5f8454_havk6e_i" returned: 1 in 0.355s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fb94d6e3-28d4-406f-8bad-19349d5f8454_havk6e_i' failed. Not Retrying. {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 17:03:19 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7fb3efb-4ef7-4ccb-98ef-e3625c219e4e]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:03:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_0okty804devstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:20 devstack sudo[103060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_0okty804devstack@QuobyteHD Jul 30 17:03:20 devstack sudo[103060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:20 devstack sudo[103056]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5c954a1a-e514-4cc7-af05-d2135e55fc98 tempest-VolumeDependencyTests-893333359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673" returned: 0 in 0.403s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5c954a1a-e514-4cc7-af05-d2135e55fc98 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673.2cc870cb-93ed-41c4-b082-808d5290d00d 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:20 devstack sudo[103065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673.2cc870cb-93ed-41c4-b082-808d5290d00d 1G Jul 30 17:03:20 devstack sudo[103065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:20 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9c456344-fbd1-41e0-9fc8-9ffd1bce7a72 tempest-VolumesSnapshotListTestJSON-700740194 None] Acquiring lock "cinder-2a6443c7-d667-40e4-acfa-e7a96b33f01e-delete_snapshot" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:20 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9c456344-fbd1-41e0-9fc8-9ffd1bce7a72 tempest-VolumesSnapshotListTestJSON-700740194 None] Lock "cinder-2a6443c7-d667-40e4-acfa-e7a96b33f01e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:20 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9c456344-fbd1-41e0-9fc8-9ffd1bce7a72 tempest-VolumesSnapshotListTestJSON-700740194 None] Acquiring lock "cinder-quobyte-b3160d2a-b30b-416b-a02e-429f73e00900" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:20 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9c456344-fbd1-41e0-9fc8-9ffd1bce7a72 tempest-VolumesSnapshotListTestJSON-700740194 None] Lock "cinder-quobyte-b3160d2a-b30b-416b-a02e-429f73e00900" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:20 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9c456344-fbd1-41e0-9fc8-9ffd1bce7a72 tempest-VolumesSnapshotListTestJSON-700740194 None] Acquiring lock "cinder-quobyte-2a6443c7-d667-40e4-acfa-e7a96b33f01e" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:20 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9c456344-fbd1-41e0-9fc8-9ffd1bce7a72 tempest-VolumesSnapshotListTestJSON-700740194 None] Lock "cinder-quobyte-2a6443c7-d667-40e4-acfa-e7a96b33f01e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:20 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-9c456344-fbd1-41e0-9fc8-9ffd1bce7a72 tempest-VolumesSnapshotListTestJSON-700740194 None] Deleting offline snapshot 2a6443c7-d667-40e4-acfa-e7a96b33f01e of volume b3160d2a-b30b-416b-a02e-429f73e00900 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:03:20 devstack sudo[103060]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:20 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-9c456344-fbd1-41e0-9fc8-9ffd1bce7a72 tempest-VolumesSnapshotListTestJSON-700740194 None] snapshot_file for this snap is: volume-b3160d2a-b30b-416b-a02e-429f73e00900.2a6443c7-d667-40e4-acfa-e7a96b33f01e {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:03:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_0okty804devstack@QuobyteHD" returned: 0 in 0.361s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:20 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] fb94d6e3-28d4-406f-8bad-19349d5f8454 was qcow2, converting to qcow2 {{(pid=88591) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 30 17:03:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_0okty804devstack@QuobyteHD /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c6b2657f-9eac-4778-9ef0-5d5e750ce5a0 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:20 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15204e4-a194-40d1-8fe5-e2662f48be0c]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:03:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9c456344-fbd1-41e0-9fc8-9ffd1bce7a72 tempest-VolumesSnapshotListTestJSON-700740194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.2a6443c7-d667-40e4-acfa-e7a96b33f01e {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:20 devstack sudo[103071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_0okty804devstack@QuobyteHD /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c6b2657f-9eac-4778-9ef0-5d5e750ce5a0 Jul 30 17:03:20 devstack sudo[103071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:20 devstack sudo[103072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.2a6443c7-d667-40e4-acfa-e7a96b33f01e Jul 30 17:03:20 devstack sudo[103072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:20 devstack sudo[103065]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5c954a1a-e514-4cc7-af05-d2135e55fc98 tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673.2cc870cb-93ed-41c4-b082-808d5290d00d 1G" returned: 0 in 0.471s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5c954a1a-e514-4cc7-af05-d2135e55fc98 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673.2cc870cb-93ed-41c4-b082-808d5290d00d {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:20 devstack sudo[103082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673.2cc870cb-93ed-41c4-b082-808d5290d00d Jul 30 17:03:20 devstack sudo[103082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:20 devstack sudo[103072]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9c456344-fbd1-41e0-9fc8-9ffd1bce7a72 tempest-VolumesSnapshotListTestJSON-700740194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.2a6443c7-d667-40e4-acfa-e7a96b33f01e" returned: 0 in 0.422s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:20 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-9c456344-fbd1-41e0-9fc8-9ffd1bce7a72 tempest-VolumesSnapshotListTestJSON-700740194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3160d2a-b30b-416b-a02e-429f73e00900(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:03:20 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95b054b-e0ff-4693-b551-3e29113997e2]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:03:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9c456344-fbd1-41e0-9fc8-9ffd1bce7a72 tempest-VolumesSnapshotListTestJSON-700740194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:20 devstack sudo[103095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900 Jul 30 17:03:20 devstack sudo[103095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:20 devstack sudo[103082]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5c954a1a-e514-4cc7-af05-d2135e55fc98 tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673.2cc870cb-93ed-41c4-b082-808d5290d00d" returned: 0 in 0.335s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:20 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-5c954a1a-e514-4cc7-af05-d2135e55fc98 tempest-VolumeDependencyTests-893333359 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673.2cc870cb-93ed-41c4-b082-808d5290d00d is being set with open permissions: ugo+rw Jul 30 17:03:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5c954a1a-e514-4cc7-af05-d2135e55fc98 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673.2cc870cb-93ed-41c4-b082-808d5290d00d {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:20 devstack sudo[103100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673.2cc870cb-93ed-41c4-b082-808d5290d00d Jul 30 17:03:20 devstack sudo[103100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:21 devstack sudo[103100]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5c954a1a-e514-4cc7-af05-d2135e55fc98 tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673.2cc870cb-93ed-41c4-b082-808d5290d00d" returned: 0 in 0.291s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:21 devstack sudo[103095]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9c456344-fbd1-41e0-9fc8-9ffd1bce7a72 tempest-VolumesSnapshotListTestJSON-700740194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900" returned: 0 in 0.488s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9c456344-fbd1-41e0-9fc8-9ffd1bce7a72 tempest-VolumesSnapshotListTestJSON-700740194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.2a6443c7-d667-40e4-acfa-e7a96b33f01e {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:21 devstack sudo[103106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.2a6443c7-d667-40e4-acfa-e7a96b33f01e Jul 30 17:03:21 devstack sudo[103106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5c954a1a-e514-4cc7-af05-d2135e55fc98 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:21 devstack sudo[103108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673.info Jul 30 17:03:21 devstack sudo[103108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:21 devstack sudo[103108]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5c954a1a-e514-4cc7-af05-d2135e55fc98 tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673.info" returned: 0 in 0.291s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:21 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-5c954a1a-e514-4cc7-af05-d2135e55fc98 tempest-VolumeDependencyTests-893333359 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673.info is being set with open permissions: ugo+rw Jul 30 17:03:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5c954a1a-e514-4cc7-af05-d2135e55fc98 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:21 devstack sudo[103115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673.info Jul 30 17:03:21 devstack sudo[103115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:21 devstack sudo[103106]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9c456344-fbd1-41e0-9fc8-9ffd1bce7a72 tempest-VolumesSnapshotListTestJSON-700740194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.2a6443c7-d667-40e4-acfa-e7a96b33f01e" returned: 0 in 0.427s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9c456344-fbd1-41e0-9fc8-9ffd1bce7a72 tempest-VolumesSnapshotListTestJSON-700740194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.2a6443c7-d667-40e4-acfa-e7a96b33f01e {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:21 devstack sudo[103117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.2a6443c7-d667-40e4-acfa-e7a96b33f01e Jul 30 17:03:21 devstack sudo[103117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:21 devstack sudo[103115]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5c954a1a-e514-4cc7-af05-d2135e55fc98 tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673.info" returned: 0 in 0.261s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5c954a1a-e514-4cc7-af05-d2135e55fc98 tempest-VolumeDependencyTests-893333359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.199s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:21 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-5c954a1a-e514-4cc7-af05-d2135e55fc98 tempest-VolumeDependencyTests-893333359 None] Create snapshot completed successfully Jul 30 17:03:22 devstack sudo[103117]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9c456344-fbd1-41e0-9fc8-9ffd1bce7a72 tempest-VolumesSnapshotListTestJSON-700740194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900.2a6443c7-d667-40e4-acfa-e7a96b33f01e" returned: 0 in 0.332s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:22 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9c456344-fbd1-41e0-9fc8-9ffd1bce7a72 tempest-VolumesSnapshotListTestJSON-700740194 None] Lock "cinder-quobyte-2a6443c7-d667-40e4-acfa-e7a96b33f01e" released by "_delete_snapshot" :: held 1.796s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:22 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9c456344-fbd1-41e0-9fc8-9ffd1bce7a72 tempest-VolumesSnapshotListTestJSON-700740194 None] Lock "cinder-quobyte-b3160d2a-b30b-416b-a02e-429f73e00900" released by "delete_snapshot" :: held 1.820s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:22 devstack sudo[103071]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_0okty804devstack@QuobyteHD /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c6b2657f-9eac-4778-9ef0-5d5e750ce5a0" returned: 0 in 1.816s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:22 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fb94d6e3-28d4-406f-8bad-19349d5f8454_0okty804devstack@QuobyteHD, size 112.00 MB, duration 1.82 sec, destination /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c6b2657f-9eac-4778-9ef0-5d5e750ce5a0 {{(pid=88591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 17:03:22 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] Converted 112.00 MB image at 61.66 MB/s Jul 30 17:03:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c6b2657f-9eac-4778-9ef0-5d5e750ce5a0 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:22 devstack sudo[103123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c6b2657f-9eac-4778-9ef0-5d5e750ce5a0 1G Jul 30 17:03:22 devstack sudo[103123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:22 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-9c456344-fbd1-41e0-9fc8-9ffd1bce7a72 tempest-VolumesSnapshotListTestJSON-700740194 None] Created reservations ['fdf27db1-abe2-45db-8b32-5d3e7ad82f6f', '71a9fb2a-eda5-4f70-9b3b-75c98c2d320e', 'e65cc678-6e4f-46cb-b6e3-92aede7f847f', '15484956-6630-4e0b-a730-c721a6c6ce51'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:03:22 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-9c456344-fbd1-41e0-9fc8-9ffd1bce7a72 tempest-VolumesSnapshotListTestJSON-700740194 None] Delete snapshot completed successfully. Jul 30 17:03:22 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9c456344-fbd1-41e0-9fc8-9ffd1bce7a72 tempest-VolumesSnapshotListTestJSON-700740194 None] Lock "cinder-2a6443c7-d667-40e4-acfa-e7a96b33f01e-delete_snapshot" released by "delete_snapshot" :: held 1.979s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:22 devstack sudo[103123]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:22 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-bf81e364-d471-4adf-b434-5322c960f49f tempest-VolumesSnapshotListTestJSON-700740194 None] Acquiring lock "cinder-b3160d2a-b30b-416b-a02e-429f73e00900-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c6b2657f-9eac-4778-9ef0-5d5e750ce5a0 1G" returned: 0 in 0.350s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:22 devstack cinder-volume[88591]: DEBUG cinder.volume.volume_utils [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] Downloaded image fb94d6e3-28d4-406f-8bad-19349d5f8454 ((None, [{'url': 'file:///opt/stack/data/glance/images/fb94d6e3-28d4-406f-8bad-19349d5f8454', 'metadata': {}}])) to volume c6b2657f-9eac-4778-9ef0-5d5e750ce5a0 successfully. {{(pid=88591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 30 17:03:22 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] Temporary image fb94d6e3-28d4-406f-8bad-19349d5f8454 for user 58b251ff552e40e38310aedc71e0c3f0 is deleted. {{(pid=88591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 30 17:03:22 devstack cinder-volume[88591]: DEBUG cinder.volume.volume_utils [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] Marking volume c6b2657f-9eac-4778-9ef0-5d5e750ce5a0 as bootable. {{(pid=88591) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 30 17:03:22 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] Copying metadata from image fb94d6e3-28d4-406f-8bad-19349d5f8454 to c6b2657f-9eac-4778-9ef0-5d5e750ce5a0. {{(pid=88591) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 30 17:03:22 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] Creating volume glance metadata for volume c6b2657f-9eac-4778-9ef0-5d5e750ce5a0 backed by image fb94d6e3-28d4-406f-8bad-19349d5f8454 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fb94d6e3-28d4-406f-8bad-19349d5f8454', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88591) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 30 17:03:22 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-bf81e364-d471-4adf-b434-5322c960f49f tempest-VolumesSnapshotListTestJSON-700740194 None] Lock "cinder-b3160d2a-b30b-416b-a02e-429f73e00900-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:22 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-bf81e364-d471-4adf-b434-5322c960f49f tempest-VolumesSnapshotListTestJSON-700740194 None] Acquiring lock "cinder-quobyte-b3160d2a-b30b-416b-a02e-429f73e00900" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:22 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-bf81e364-d471-4adf-b434-5322c960f49f tempest-VolumesSnapshotListTestJSON-700740194 None] Lock "cinder-quobyte-b3160d2a-b30b-416b-a02e-429f73e00900" acquired by "delete_volume" :: waited 0.023s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:22 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[252e584d-0552-49dd-9b1b-19dee088cc73]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:03:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bf81e364-d471-4adf-b434-5322c960f49f tempest-VolumesSnapshotListTestJSON-700740194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:22 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8195f482-4f42-4221-8cbd-9744dada5249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6b2657f-9eac-4778-9ef0-5d5e750ce5a0', 'volume_size': 1, 'image_id': 'fb94d6e3-28d4-406f-8bad-19349d5f8454', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fb94d6e3-28d4-406f-8bad-19349d5f8454', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7e05c21dff7b441db433e2a7736519e9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fb94d6e3-28d4-406f-8bad-19349d5f8454', 'created_at': datetime.datetime(2026, 7, 30, 14, 42, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 42, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fb94d6e3-28d4-406f-8bad-19349d5f8454/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:22 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75af5e6e-b3a4-46fe-95d6-4fb85388bc82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:22 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] Volume volume-c6b2657f-9eac-4778-9ef0-5d5e750ce5a0 (c6b2657f-9eac-4778-9ef0-5d5e750ce5a0): created successfully Jul 30 17:03:22 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75af5e6e-b3a4-46fe-95d6-4fb85388bc82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:22 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] Flow 'volume_create_manager' (e76a49dd-a528-48e8-8b11-ff7837120e8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:03:22 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-57138310-a526-4696-b7a3-f55d9e79d846 tempest-VolumesGetTest-1118799669 None] Created volume successfully. Jul 30 17:03:22 devstack sudo[103129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900 Jul 30 17:03:22 devstack sudo[103129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:23 devstack sudo[103129]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bf81e364-d471-4adf-b434-5322c960f49f tempest-VolumesSnapshotListTestJSON-700740194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900" returned: 0 in 0.388s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bf81e364-d471-4adf-b434-5322c960f49f tempest-VolumesSnapshotListTestJSON-700740194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:23 devstack sudo[103134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900 Jul 30 17:03:23 devstack sudo[103134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:23 devstack sudo[103134]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bf81e364-d471-4adf-b434-5322c960f49f tempest-VolumesSnapshotListTestJSON-700740194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b3160d2a-b30b-416b-a02e-429f73e00900" returned: 0 in 0.262s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:23 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-bf81e364-d471-4adf-b434-5322c960f49f tempest-VolumesSnapshotListTestJSON-700740194 None] Lock "cinder-quobyte-b3160d2a-b30b-416b-a02e-429f73e00900" released by "delete_volume" :: held 0.715s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:23 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-db64a7f8-e379-43d3-84eb-497d6c3cedee tempest-VolumeDependencyTests-893333359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:03:23 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-bf81e364-d471-4adf-b434-5322c960f49f tempest-VolumesSnapshotListTestJSON-700740194 None] Created reservations ['ca026d09-81d4-4ca5-a9b0-cdb2a33b35a0', '3e00b8ff-38b0-434d-b8e6-d24a5102fb5f', '11220132-37a4-41bd-9ba3-87451282a2c2', 'ed3377a2-15a9-4e28-9365-3ab9d69c4467'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:03:23 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-db64a7f8-e379-43d3-84eb-497d6c3cedee tempest-VolumeDependencyTests-893333359 None] Flow 'volume_create_manager' (3c8e79f6-6a9c-464e-a52b-62e8868a4e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:03:23 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-db64a7f8-e379-43d3-84eb-497d6c3cedee tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eee5ed68-9d9c-4014-8196-0296fd9c3284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:23 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-db64a7f8-e379-43d3-84eb-497d6c3cedee tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eee5ed68-9d9c-4014-8196-0296fd9c3284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:03:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1530429282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26bd0b33-e889-4381-8b04-b3cd5f25739f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1142be8cf434dc9b1a32ef12a92e88b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:03:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2cc870cb-93ed-41c4-b082-808d5290d00d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:03:23Z,use_quota=True,user_id='db3e9fa2901f4abe9034e8c4a4f63fb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:23 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-db64a7f8-e379-43d3-84eb-497d6c3cedee tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a5b6696-5c03-42cb-9e21-0291a3200cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:23 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-db64a7f8-e379-43d3-84eb-497d6c3cedee tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a5b6696-5c03-42cb-9e21-0291a3200cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:23 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-db64a7f8-e379-43d3-84eb-497d6c3cedee tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f975767-33d0-4c68-a8ff-ecded990ef04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:23 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-db64a7f8-e379-43d3-84eb-497d6c3cedee tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f975767-33d0-4c68-a8ff-ecded990ef04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '26bd0b33-e889-4381-8b04-b3cd5f25739f', 'volume_name': 'volume-26bd0b33-e889-4381-8b04-b3cd5f25739f', 'volume_size': 1, 'snapshot_id': '2cc870cb-93ed-41c4-b082-808d5290d00d'}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:23 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-db64a7f8-e379-43d3-84eb-497d6c3cedee tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70985522-bd30-4797-ac34-91c7046d86dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:23 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-db64a7f8-e379-43d3-84eb-497d6c3cedee tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70985522-bd30-4797-ac34-91c7046d86dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:23 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-db64a7f8-e379-43d3-84eb-497d6c3cedee tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0400500c-fb10-4c20-84df-d56cadbfce1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:23 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-db64a7f8-e379-43d3-84eb-497d6c3cedee tempest-VolumeDependencyTests-893333359 None] Volume 26bd0b33-e889-4381-8b04-b3cd5f25739f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-26bd0b33-e889-4381-8b04-b3cd5f25739f', 'volume_size': 1, 'snapshot_id': '2cc870cb-93ed-41c4-b082-808d5290d00d'} Jul 30 17:03:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-db64a7f8-e379-43d3-84eb-497d6c3cedee tempest-VolumeDependencyTests-893333359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-db64a7f8-e379-43d3-84eb-497d6c3cedee tempest-VolumeDependencyTests-893333359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:23 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-db64a7f8-e379-43d3-84eb-497d6c3cedee tempest-VolumeDependencyTests-893333359 None] Acquiring lock "cinder-quobyte-2cc870cb-93ed-41c4-b082-808d5290d00d-26bd0b33-e889-4381-8b04-b3cd5f25739f" by "_create_volume_from_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:23 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-db64a7f8-e379-43d3-84eb-497d6c3cedee tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-2cc870cb-93ed-41c4-b082-808d5290d00d-26bd0b33-e889-4381-8b04-b3cd5f25739f" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:23 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-db64a7f8-e379-43d3-84eb-497d6c3cedee tempest-VolumeDependencyTests-893333359 None] Creating volume 26bd0b33-e889-4381-8b04-b3cd5f25739f from snapshot 2cc870cb-93ed-41c4-b082-808d5290d00d {{(pid=88591) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 30 17:03:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-db64a7f8-e379-43d3-84eb-497d6c3cedee tempest-VolumeDependencyTests-893333359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-db64a7f8-e379-43d3-84eb-497d6c3cedee tempest-VolumeDependencyTests-893333359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:23 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-db64a7f8-e379-43d3-84eb-497d6c3cedee tempest-VolumeDependencyTests-893333359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:03:23 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-db64a7f8-e379-43d3-84eb-497d6c3cedee tempest-VolumeDependencyTests-893333359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:03:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-db64a7f8-e379-43d3-84eb-497d6c3cedee tempest-VolumeDependencyTests-893333359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:23 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-db64a7f8-e379-43d3-84eb-497d6c3cedee tempest-VolumeDependencyTests-893333359 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:03:23 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-db64a7f8-e379-43d3-84eb-497d6c3cedee tempest-VolumeDependencyTests-893333359 None] Acquiring lock "cinder-quobyte-26bd0b33-e889-4381-8b04-b3cd5f25739f" by "_copy_volume_from_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:23 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-db64a7f8-e379-43d3-84eb-497d6c3cedee tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-26bd0b33-e889-4381-8b04-b3cd5f25739f" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:23 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-db64a7f8-e379-43d3-84eb-497d6c3cedee tempest-VolumeDependencyTests-893333359 None] snapshot: 2cc870cb-93ed-41c4-b082-808d5290d00d, volume: 26bd0b33-e889-4381-8b04-b3cd5f25739f, {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 17:03:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-bf81e364-d471-4adf-b434-5322c960f49f tempest-VolumesSnapshotListTestJSON-700740194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-bf81e364-d471-4adf-b434-5322c960f49f tempest-VolumesSnapshotListTestJSON-700740194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:23 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-bf81e364-d471-4adf-b434-5322c960f49f tempest-VolumesSnapshotListTestJSON-700740194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:03:23 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-bf81e364-d471-4adf-b434-5322c960f49f tempest-VolumesSnapshotListTestJSON-700740194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:03:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-bf81e364-d471-4adf-b434-5322c960f49f tempest-VolumesSnapshotListTestJSON-700740194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bf81e364-d471-4adf-b434-5322c960f49f tempest-VolumesSnapshotListTestJSON-700740194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:23 devstack sudo[103137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:03:23 devstack sudo[103137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-db64a7f8-e379-43d3-84eb-497d6c3cedee tempest-VolumeDependencyTests-893333359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-db64a7f8-e379-43d3-84eb-497d6c3cedee tempest-VolumeDependencyTests-893333359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:23 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-db64a7f8-e379-43d3-84eb-497d6c3cedee tempest-VolumeDependencyTests-893333359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:03:23 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-db64a7f8-e379-43d3-84eb-497d6c3cedee tempest-VolumeDependencyTests-893333359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:03:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-db64a7f8-e379-43d3-84eb-497d6c3cedee tempest-VolumeDependencyTests-893333359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:23 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da43db6-3a41-43c7-90d9-311980d7061c]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:03:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-db64a7f8-e379-43d3-84eb-497d6c3cedee tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673.2cc870cb-93ed-41c4-b082-808d5290d00d {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:23 devstack sudo[103139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673.2cc870cb-93ed-41c4-b082-808d5290d00d Jul 30 17:03:23 devstack sudo[103139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:23 devstack sudo[103137]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bf81e364-d471-4adf-b434-5322c960f49f tempest-VolumesSnapshotListTestJSON-700740194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.275s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:23 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-bf81e364-d471-4adf-b434-5322c960f49f tempest-VolumesSnapshotListTestJSON-700740194 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:03:23 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-bf81e364-d471-4adf-b434-5322c960f49f tempest-VolumesSnapshotListTestJSON-700740194 None] Deleted volume successfully. Jul 30 17:03:23 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-bf81e364-d471-4adf-b434-5322c960f49f tempest-VolumesSnapshotListTestJSON-700740194 None] Lock "cinder-b3160d2a-b30b-416b-a02e-429f73e00900-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:23 devstack sudo[103139]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-db64a7f8-e379-43d3-84eb-497d6c3cedee tempest-VolumeDependencyTests-893333359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673.2cc870cb-93ed-41c4-b082-808d5290d00d" returned: 0 in 0.394s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:24 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-db64a7f8-e379-43d3-84eb-497d6c3cedee tempest-VolumeDependencyTests-893333359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:03:24 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f16bea-2951-44ad-8ea3-316e1ba65c83]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:03:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-db64a7f8-e379-43d3-84eb-497d6c3cedee tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:24 devstack sudo[103145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673 Jul 30 17:03:24 devstack sudo[103145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:24 devstack sudo[103145]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-db64a7f8-e379-43d3-84eb-497d6c3cedee tempest-VolumeDependencyTests-893333359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673" returned: 0 in 0.451s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:24 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-db64a7f8-e379-43d3-84eb-497d6c3cedee tempest-VolumeDependencyTests-893333359 None] will copy from snapshot at /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673 {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 17:03:24 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-db64a7f8-e379-43d3-84eb-497d6c3cedee tempest-VolumeDependencyTests-893333359 None] Creating direct copy from snapshot {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 17:03:24 devstack cinder-volume[88591]: DEBUG cinder.utils [None req-db64a7f8-e379-43d3-84eb-497d6c3cedee tempest-VolumeDependencyTests-893333359 None] Path /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-26bd0b33-e889-4381-8b04-b3cd5f25739f not found in is_blk_device check {{(pid=88591) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 17:03:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-db64a7f8-e379-43d3-84eb-497d6c3cedee tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-26bd0b33-e889-4381-8b04-b3cd5f25739f {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:24 devstack sudo[103152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-26bd0b33-e889-4381-8b04-b3cd5f25739f Jul 30 17:03:24 devstack sudo[103152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:24 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-da8018ee-4ae2-439d-906f-73837703d28e tempest-VolumesGetTest-1118799669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:03:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-da8018ee-4ae2-439d-906f-73837703d28e tempest-VolumesGetTest-1118799669 None] Flow 'volume_create_manager' (fb543739-9620-43aa-9b52-8a4c27949882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:03:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-da8018ee-4ae2-439d-906f-73837703d28e tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7823f061-1f5c-478a-9bc2-8ea5001e0d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-da8018ee-4ae2-439d-906f-73837703d28e tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7823f061-1f5c-478a-9bc2-8ea5001e0d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:03:24Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1945264675',display_name='tempest-VolumesGetTest-Volume-1771795203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb5a21e8-7f3d-491b-b238-5e60a85d4d0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c6e94e27fa4ce98248b491a048f03e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:03:25Z,use_quota=True,user_id='58b251ff552e40e38310aedc71e0c3f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-da8018ee-4ae2-439d-906f-73837703d28e tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12b16a60-bd17-4351-942b-a2b7a33bf529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-da8018ee-4ae2-439d-906f-73837703d28e tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12b16a60-bd17-4351-942b-a2b7a33bf529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-da8018ee-4ae2-439d-906f-73837703d28e tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bb702ed-dfc0-4c80-b185-9a2cf94c0893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-da8018ee-4ae2-439d-906f-73837703d28e tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bb702ed-dfc0-4c80-b185-9a2cf94c0893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb5a21e8-7f3d-491b-b238-5e60a85d4d0e', 'volume_name': 'volume-fb5a21e8-7f3d-491b-b238-5e60a85d4d0e', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-da8018ee-4ae2-439d-906f-73837703d28e tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46ebcc9e-0d7a-43c9-b24b-e72821e8cf58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-da8018ee-4ae2-439d-906f-73837703d28e tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46ebcc9e-0d7a-43c9-b24b-e72821e8cf58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-da8018ee-4ae2-439d-906f-73837703d28e tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f918cfbb-6f5f-4a0e-9ac3-a8f65a4735a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:24 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-da8018ee-4ae2-439d-906f-73837703d28e tempest-VolumesGetTest-1118799669 None] Volume fb5a21e8-7f3d-491b-b238-5e60a85d4d0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb5a21e8-7f3d-491b-b238-5e60a85d4d0e', 'volume_size': 1} Jul 30 17:03:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-da8018ee-4ae2-439d-906f-73837703d28e tempest-VolumesGetTest-1118799669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:25 devstack sudo[103152]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-db64a7f8-e379-43d3-84eb-497d6c3cedee tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-26bd0b33-e889-4381-8b04-b3cd5f25739f" returned: 0 in 0.539s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:25 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-db64a7f8-e379-43d3-84eb-497d6c3cedee tempest-VolumeDependencyTests-893333359 None] Image conversion details: src /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-26bd0b33-e889-4381-8b04-b3cd5f25739f {{(pid=88591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 17:03:25 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-db64a7f8-e379-43d3-84eb-497d6c3cedee tempest-VolumeDependencyTests-893333359 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 30 17:03:25 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-db64a7f8-e379-43d3-84eb-497d6c3cedee tempest-VolumeDependencyTests-893333359 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-26bd0b33-e889-4381-8b04-b3cd5f25739f is being set with open permissions: ugo+rw Jul 30 17:03:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-db64a7f8-e379-43d3-84eb-497d6c3cedee tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-26bd0b33-e889-4381-8b04-b3cd5f25739f {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:25 devstack sudo[103159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-26bd0b33-e889-4381-8b04-b3cd5f25739f Jul 30 17:03:25 devstack sudo[103159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:25 devstack sudo[103159]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-db64a7f8-e379-43d3-84eb-497d6c3cedee tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-26bd0b33-e889-4381-8b04-b3cd5f25739f" returned: 0 in 0.267s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:25 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-db64a7f8-e379-43d3-84eb-497d6c3cedee tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-26bd0b33-e889-4381-8b04-b3cd5f25739f" released by "_copy_volume_from_snapshot" :: held 1.778s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:25 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-db64a7f8-e379-43d3-84eb-497d6c3cedee tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-2cc870cb-93ed-41c4-b082-808d5290d00d-26bd0b33-e889-4381-8b04-b3cd5f25739f" released by "_create_volume_from_snapshot" :: held 1.851s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-db64a7f8-e379-43d3-84eb-497d6c3cedee tempest-VolumeDependencyTests-893333359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 1.875s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-da8018ee-4ae2-439d-906f-73837703d28e tempest-VolumesGetTest-1118799669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.582s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:25 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-da8018ee-4ae2-439d-906f-73837703d28e tempest-VolumesGetTest-1118799669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:03:24Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1945264675',display_name='tempest-VolumesGetTest-Volume-1771795203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb5a21e8-7f3d-491b-b238-5e60a85d4d0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c6e94e27fa4ce98248b491a048f03e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:03:25Z,use_quota=True,user_id='58b251ff552e40e38310aedc71e0c3f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:03:25 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-da8018ee-4ae2-439d-906f-73837703d28e tempest-VolumesGetTest-1118799669 None] Creating volume fb5a21e8-7f3d-491b-b238-5e60a85d4d0e {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:03:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-da8018ee-4ae2-439d-906f-73837703d28e tempest-VolumesGetTest-1118799669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-da8018ee-4ae2-439d-906f-73837703d28e tempest-VolumesGetTest-1118799669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:25 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-da8018ee-4ae2-439d-906f-73837703d28e tempest-VolumesGetTest-1118799669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:03:25 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-da8018ee-4ae2-439d-906f-73837703d28e tempest-VolumesGetTest-1118799669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:03:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-da8018ee-4ae2-439d-906f-73837703d28e tempest-VolumesGetTest-1118799669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:25 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-da8018ee-4ae2-439d-906f-73837703d28e tempest-VolumesGetTest-1118799669 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:03:25 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-da8018ee-4ae2-439d-906f-73837703d28e tempest-VolumesGetTest-1118799669 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:03:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-da8018ee-4ae2-439d-906f-73837703d28e tempest-VolumesGetTest-1118799669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fb5a21e8-7f3d-491b-b238-5e60a85d4d0e 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:25 devstack sudo[103162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fb5a21e8-7f3d-491b-b238-5e60a85d4d0e 1073741824 Jul 30 17:03:25 devstack sudo[103162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-db64a7f8-e379-43d3-84eb-497d6c3cedee tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0400500c-fb10-4c20-84df-d56cadbfce1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26bd0b33-e889-4381-8b04-b3cd5f25739f', 'volume_size': 1, 'snapshot_id': '2cc870cb-93ed-41c4-b082-808d5290d00d'}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-db64a7f8-e379-43d3-84eb-497d6c3cedee tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36bc19df-ec66-4c1d-835f-9c1fb68ed839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:25 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-db64a7f8-e379-43d3-84eb-497d6c3cedee tempest-VolumeDependencyTests-893333359 None] Volume volume-26bd0b33-e889-4381-8b04-b3cd5f25739f (26bd0b33-e889-4381-8b04-b3cd5f25739f): created successfully Jul 30 17:03:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-db64a7f8-e379-43d3-84eb-497d6c3cedee tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36bc19df-ec66-4c1d-835f-9c1fb68ed839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-db64a7f8-e379-43d3-84eb-497d6c3cedee tempest-VolumeDependencyTests-893333359 None] Flow 'volume_create_manager' (3c8e79f6-6a9c-464e-a52b-62e8868a4e39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:03:25 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-db64a7f8-e379-43d3-84eb-497d6c3cedee tempest-VolumeDependencyTests-893333359 None] Created volume successfully. Jul 30 17:03:25 devstack sudo[103162]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-da8018ee-4ae2-439d-906f-73837703d28e tempest-VolumesGetTest-1118799669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fb5a21e8-7f3d-491b-b238-5e60a85d4d0e 1073741824" returned: 0 in 0.468s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-da8018ee-4ae2-439d-906f-73837703d28e tempest-VolumesGetTest-1118799669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fb5a21e8-7f3d-491b-b238-5e60a85d4d0e {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:25 devstack sudo[103168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fb5a21e8-7f3d-491b-b238-5e60a85d4d0e Jul 30 17:03:25 devstack sudo[103168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:26 devstack sudo[103168]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-da8018ee-4ae2-439d-906f-73837703d28e tempest-VolumesGetTest-1118799669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fb5a21e8-7f3d-491b-b238-5e60a85d4d0e" returned: 0 in 0.256s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:26 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-da8018ee-4ae2-439d-906f-73837703d28e tempest-VolumesGetTest-1118799669 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:03:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-da8018ee-4ae2-439d-906f-73837703d28e tempest-VolumesGetTest-1118799669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-da8018ee-4ae2-439d-906f-73837703d28e tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f918cfbb-6f5f-4a0e-9ac3-a8f65a4735a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb5a21e8-7f3d-491b-b238-5e60a85d4d0e', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-da8018ee-4ae2-439d-906f-73837703d28e tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dea128b-6e46-4ef2-8fe4-f4d87f139d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:26 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-da8018ee-4ae2-439d-906f-73837703d28e tempest-VolumesGetTest-1118799669 None] Volume volume-fb5a21e8-7f3d-491b-b238-5e60a85d4d0e (fb5a21e8-7f3d-491b-b238-5e60a85d4d0e): created successfully Jul 30 17:03:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-da8018ee-4ae2-439d-906f-73837703d28e tempest-VolumesGetTest-1118799669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dea128b-6e46-4ef2-8fe4-f4d87f139d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-da8018ee-4ae2-439d-906f-73837703d28e tempest-VolumesGetTest-1118799669 None] Flow 'volume_create_manager' (fb543739-9620-43aa-9b52-8a4c27949882) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:03:26 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-da8018ee-4ae2-439d-906f-73837703d28e tempest-VolumesGetTest-1118799669 None] Created volume successfully. Jul 30 17:03:26 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-30feda32-4cf8-4845-bd80-3992aa5f179c tempest-VolumeDependencyTests-893333359 None] Acquiring lock "cinder-91212cfe-db13-400b-928e-99f16d395af8-delete_snapshot" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:26 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-30feda32-4cf8-4845-bd80-3992aa5f179c tempest-VolumeDependencyTests-893333359 None] Lock "cinder-91212cfe-db13-400b-928e-99f16d395af8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:26 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-30feda32-4cf8-4845-bd80-3992aa5f179c tempest-VolumeDependencyTests-893333359 None] Acquiring lock "cinder-quobyte-8b4df5f2-73ba-4d23-b402-6251d845636c" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:26 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-30feda32-4cf8-4845-bd80-3992aa5f179c tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-8b4df5f2-73ba-4d23-b402-6251d845636c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:26 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-30feda32-4cf8-4845-bd80-3992aa5f179c tempest-VolumeDependencyTests-893333359 None] Acquiring lock "cinder-quobyte-91212cfe-db13-400b-928e-99f16d395af8" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:26 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-30feda32-4cf8-4845-bd80-3992aa5f179c tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-91212cfe-db13-400b-928e-99f16d395af8" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:26 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-30feda32-4cf8-4845-bd80-3992aa5f179c tempest-VolumeDependencyTests-893333359 None] Deleting offline snapshot 91212cfe-db13-400b-928e-99f16d395af8 of volume 8b4df5f2-73ba-4d23-b402-6251d845636c {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:03:26 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-30feda32-4cf8-4845-bd80-3992aa5f179c tempest-VolumeDependencyTests-893333359 None] snapshot_file for this snap is: volume-8b4df5f2-73ba-4d23-b402-6251d845636c.91212cfe-db13-400b-928e-99f16d395af8 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:03:26 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ba2a1b-6f3c-4c80-8ad3-a709a9d5eba6]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:03:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-30feda32-4cf8-4845-bd80-3992aa5f179c tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b4df5f2-73ba-4d23-b402-6251d845636c.91212cfe-db13-400b-928e-99f16d395af8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:26 devstack sudo[103171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b4df5f2-73ba-4d23-b402-6251d845636c.91212cfe-db13-400b-928e-99f16d395af8 Jul 30 17:03:26 devstack sudo[103171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:26 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-6fb38885-07dc-487f-b720-18b4c8a22a53 tempest-VolumesGetTest-1118799669 None] Acquiring lock "cinder-fb5a21e8-7f3d-491b-b238-5e60a85d4d0e-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:26 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-6fb38885-07dc-487f-b720-18b4c8a22a53 tempest-VolumesGetTest-1118799669 None] Lock "cinder-fb5a21e8-7f3d-491b-b238-5e60a85d4d0e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:26 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-6fb38885-07dc-487f-b720-18b4c8a22a53 tempest-VolumesGetTest-1118799669 None] Acquiring lock "cinder-quobyte-fb5a21e8-7f3d-491b-b238-5e60a85d4d0e" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:27 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-6fb38885-07dc-487f-b720-18b4c8a22a53 tempest-VolumesGetTest-1118799669 None] Lock "cinder-quobyte-fb5a21e8-7f3d-491b-b238-5e60a85d4d0e" acquired by "delete_volume" :: waited 0.026s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:27 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18116fe-e059-4f3e-ae77-84fd998d10cc]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:03:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6fb38885-07dc-487f-b720-18b4c8a22a53 tempest-VolumesGetTest-1118799669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fb5a21e8-7f3d-491b-b238-5e60a85d4d0e {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:27 devstack sudo[103171]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-30feda32-4cf8-4845-bd80-3992aa5f179c tempest-VolumeDependencyTests-893333359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b4df5f2-73ba-4d23-b402-6251d845636c.91212cfe-db13-400b-928e-99f16d395af8" returned: 0 in 0.475s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:27 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-30feda32-4cf8-4845-bd80-3992aa5f179c tempest-VolumeDependencyTests-893333359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b4df5f2-73ba-4d23-b402-6251d845636c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:03:27 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99ee10d-ca99-4280-8f41-48fe663f79b7]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:03:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-30feda32-4cf8-4845-bd80-3992aa5f179c tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b4df5f2-73ba-4d23-b402-6251d845636c {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:27 devstack sudo[103176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fb5a21e8-7f3d-491b-b238-5e60a85d4d0e Jul 30 17:03:27 devstack sudo[103176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:27 devstack sudo[103177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b4df5f2-73ba-4d23-b402-6251d845636c Jul 30 17:03:27 devstack sudo[103177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:27 devstack sudo[103176]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6fb38885-07dc-487f-b720-18b4c8a22a53 tempest-VolumesGetTest-1118799669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fb5a21e8-7f3d-491b-b238-5e60a85d4d0e" returned: 0 in 0.439s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6fb38885-07dc-487f-b720-18b4c8a22a53 tempest-VolumesGetTest-1118799669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fb5a21e8-7f3d-491b-b238-5e60a85d4d0e {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:27 devstack sudo[103185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fb5a21e8-7f3d-491b-b238-5e60a85d4d0e Jul 30 17:03:27 devstack sudo[103185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:27 devstack sudo[103177]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-30feda32-4cf8-4845-bd80-3992aa5f179c tempest-VolumeDependencyTests-893333359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b4df5f2-73ba-4d23-b402-6251d845636c" returned: 0 in 0.600s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-30feda32-4cf8-4845-bd80-3992aa5f179c tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b4df5f2-73ba-4d23-b402-6251d845636c.91212cfe-db13-400b-928e-99f16d395af8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:27 devstack sudo[103189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b4df5f2-73ba-4d23-b402-6251d845636c.91212cfe-db13-400b-928e-99f16d395af8 Jul 30 17:03:27 devstack sudo[103189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:27 devstack sudo[103185]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6fb38885-07dc-487f-b720-18b4c8a22a53 tempest-VolumesGetTest-1118799669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fb5a21e8-7f3d-491b-b238-5e60a85d4d0e" returned: 0 in 0.311s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:27 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-6fb38885-07dc-487f-b720-18b4c8a22a53 tempest-VolumesGetTest-1118799669 None] Lock "cinder-quobyte-fb5a21e8-7f3d-491b-b238-5e60a85d4d0e" released by "delete_volume" :: held 0.808s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:27 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-6fb38885-07dc-487f-b720-18b4c8a22a53 tempest-VolumesGetTest-1118799669 None] Created reservations ['93949746-da21-4c0e-b92b-11a1e2a29271', '341a1a80-51e5-450e-ae04-383eed6dafc4', '680a9ec1-1184-4380-a4ba-88e822965d9c', '04004bd3-7dd1-402a-a8ec-ee779f67a22a'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:03:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-6fb38885-07dc-487f-b720-18b4c8a22a53 tempest-VolumesGetTest-1118799669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-6fb38885-07dc-487f-b720-18b4c8a22a53 tempest-VolumesGetTest-1118799669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:27 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-6fb38885-07dc-487f-b720-18b4c8a22a53 tempest-VolumesGetTest-1118799669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:03:27 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-6fb38885-07dc-487f-b720-18b4c8a22a53 tempest-VolumesGetTest-1118799669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:03:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-6fb38885-07dc-487f-b720-18b4c8a22a53 tempest-VolumesGetTest-1118799669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6fb38885-07dc-487f-b720-18b4c8a22a53 tempest-VolumesGetTest-1118799669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:28 devstack sudo[103193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:03:28 devstack sudo[103193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:28 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c3b00946-e01b-4879-961d-70fd2eeb9485 tempest-VolumesGetTest-1118799669 None] Acquiring lock "cinder-c6b2657f-9eac-4778-9ef0-5d5e750ce5a0-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:28 devstack sudo[103189]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-30feda32-4cf8-4845-bd80-3992aa5f179c tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b4df5f2-73ba-4d23-b402-6251d845636c.91212cfe-db13-400b-928e-99f16d395af8" returned: 0 in 0.429s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-30feda32-4cf8-4845-bd80-3992aa5f179c tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b4df5f2-73ba-4d23-b402-6251d845636c.91212cfe-db13-400b-928e-99f16d395af8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:28 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c3b00946-e01b-4879-961d-70fd2eeb9485 tempest-VolumesGetTest-1118799669 None] Lock "cinder-c6b2657f-9eac-4778-9ef0-5d5e750ce5a0-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:28 devstack sudo[103198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b4df5f2-73ba-4d23-b402-6251d845636c.91212cfe-db13-400b-928e-99f16d395af8 Jul 30 17:03:28 devstack sudo[103198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:28 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c3b00946-e01b-4879-961d-70fd2eeb9485 tempest-VolumesGetTest-1118799669 None] Acquiring lock "cinder-quobyte-c6b2657f-9eac-4778-9ef0-5d5e750ce5a0" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:28 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c3b00946-e01b-4879-961d-70fd2eeb9485 tempest-VolumesGetTest-1118799669 None] Lock "cinder-quobyte-c6b2657f-9eac-4778-9ef0-5d5e750ce5a0" acquired by "delete_volume" :: waited 0.019s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:28 devstack sudo[103193]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6fb38885-07dc-487f-b720-18b4c8a22a53 tempest-VolumesGetTest-1118799669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.330s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:28 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-6fb38885-07dc-487f-b720-18b4c8a22a53 tempest-VolumesGetTest-1118799669 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:03:28 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-6fb38885-07dc-487f-b720-18b4c8a22a53 tempest-VolumesGetTest-1118799669 None] Deleted volume successfully. Jul 30 17:03:28 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e9f69e-db5b-4899-9567-f7b096a4b3f1]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:03:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c3b00946-e01b-4879-961d-70fd2eeb9485 tempest-VolumesGetTest-1118799669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c6b2657f-9eac-4778-9ef0-5d5e750ce5a0 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:28 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-6fb38885-07dc-487f-b720-18b4c8a22a53 tempest-VolumesGetTest-1118799669 None] Lock "cinder-fb5a21e8-7f3d-491b-b238-5e60a85d4d0e-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:28 devstack sudo[103201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c6b2657f-9eac-4778-9ef0-5d5e750ce5a0 Jul 30 17:03:28 devstack sudo[103201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:28 devstack sudo[103198]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-30feda32-4cf8-4845-bd80-3992aa5f179c tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b4df5f2-73ba-4d23-b402-6251d845636c.91212cfe-db13-400b-928e-99f16d395af8" returned: 0 in 0.300s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:28 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-30feda32-4cf8-4845-bd80-3992aa5f179c tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-91212cfe-db13-400b-928e-99f16d395af8" released by "_delete_snapshot" :: held 1.933s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:28 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-30feda32-4cf8-4845-bd80-3992aa5f179c tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-8b4df5f2-73ba-4d23-b402-6251d845636c" released by "delete_snapshot" :: held 1.960s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:28 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-30feda32-4cf8-4845-bd80-3992aa5f179c tempest-VolumeDependencyTests-893333359 None] Created reservations ['461f8e11-ef61-4110-981e-366fe275d2b3', '869b54d5-86f9-4f8f-9709-f52ac187dc0f', 'de73d770-9868-4ac4-9ca5-6b9f1add6943', 'bc7074ea-4922-4112-96a4-2cd0dcf62b43'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:03:28 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-30feda32-4cf8-4845-bd80-3992aa5f179c tempest-VolumeDependencyTests-893333359 None] Delete snapshot completed successfully. Jul 30 17:03:28 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-30feda32-4cf8-4845-bd80-3992aa5f179c tempest-VolumeDependencyTests-893333359 None] Lock "cinder-91212cfe-db13-400b-928e-99f16d395af8-delete_snapshot" released by "delete_snapshot" :: held 2.125s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:28 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-37aa676f-0627-4bbb-b280-80bf54d97870 tempest-VolumeDependencyTests-893333359 None] Acquiring lock "cinder-2cc870cb-93ed-41c4-b082-808d5290d00d-delete_snapshot" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:28 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-37aa676f-0627-4bbb-b280-80bf54d97870 tempest-VolumeDependencyTests-893333359 None] Lock "cinder-2cc870cb-93ed-41c4-b082-808d5290d00d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:28 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-37aa676f-0627-4bbb-b280-80bf54d97870 tempest-VolumeDependencyTests-893333359 None] Acquiring lock "cinder-quobyte-988dafa5-d9ee-4160-a89b-fc5bc9d09673" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:28 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-37aa676f-0627-4bbb-b280-80bf54d97870 tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-988dafa5-d9ee-4160-a89b-fc5bc9d09673" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:28 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-37aa676f-0627-4bbb-b280-80bf54d97870 tempest-VolumeDependencyTests-893333359 None] Acquiring lock "cinder-quobyte-2cc870cb-93ed-41c4-b082-808d5290d00d" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:28 devstack sudo[103201]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c3b00946-e01b-4879-961d-70fd2eeb9485 tempest-VolumesGetTest-1118799669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c6b2657f-9eac-4778-9ef0-5d5e750ce5a0" returned: 0 in 0.475s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c3b00946-e01b-4879-961d-70fd2eeb9485 tempest-VolumesGetTest-1118799669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c6b2657f-9eac-4778-9ef0-5d5e750ce5a0 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:28 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-37aa676f-0627-4bbb-b280-80bf54d97870 tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-2cc870cb-93ed-41c4-b082-808d5290d00d" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:28 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-37aa676f-0627-4bbb-b280-80bf54d97870 tempest-VolumeDependencyTests-893333359 None] Deleting offline snapshot 2cc870cb-93ed-41c4-b082-808d5290d00d of volume 988dafa5-d9ee-4160-a89b-fc5bc9d09673 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:03:28 devstack sudo[103207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c6b2657f-9eac-4778-9ef0-5d5e750ce5a0 Jul 30 17:03:28 devstack sudo[103207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:28 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-37aa676f-0627-4bbb-b280-80bf54d97870 tempest-VolumeDependencyTests-893333359 None] snapshot_file for this snap is: volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673.2cc870cb-93ed-41c4-b082-808d5290d00d {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:03:28 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d727c9-1004-414c-816a-717a40cfe464]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:03:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-37aa676f-0627-4bbb-b280-80bf54d97870 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673.2cc870cb-93ed-41c4-b082-808d5290d00d {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:28 devstack sudo[103209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673.2cc870cb-93ed-41c4-b082-808d5290d00d Jul 30 17:03:28 devstack sudo[103209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:29 devstack sudo[103207]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c3b00946-e01b-4879-961d-70fd2eeb9485 tempest-VolumesGetTest-1118799669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c6b2657f-9eac-4778-9ef0-5d5e750ce5a0" returned: 0 in 0.270s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:29 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c3b00946-e01b-4879-961d-70fd2eeb9485 tempest-VolumesGetTest-1118799669 None] Lock "cinder-quobyte-c6b2657f-9eac-4778-9ef0-5d5e750ce5a0" released by "delete_volume" :: held 0.798s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:29 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-c3b00946-e01b-4879-961d-70fd2eeb9485 tempest-VolumesGetTest-1118799669 None] Created reservations ['80413483-c879-47c9-8292-7ab61889b920', '6df75e39-39a2-417a-91f2-6e3cfb46e03b', 'c739f1eb-f01b-4253-afb5-68f4ccd65ebf', '98fae3a2-b25e-46ad-a991-2f4f4cae897e'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:03:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c3b00946-e01b-4879-961d-70fd2eeb9485 tempest-VolumesGetTest-1118799669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c3b00946-e01b-4879-961d-70fd2eeb9485 tempest-VolumesGetTest-1118799669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:29 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-c3b00946-e01b-4879-961d-70fd2eeb9485 tempest-VolumesGetTest-1118799669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:03:29 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-c3b00946-e01b-4879-961d-70fd2eeb9485 tempest-VolumesGetTest-1118799669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:03:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c3b00946-e01b-4879-961d-70fd2eeb9485 tempest-VolumesGetTest-1118799669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c3b00946-e01b-4879-961d-70fd2eeb9485 tempest-VolumesGetTest-1118799669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:29 devstack sudo[103214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:03:29 devstack sudo[103214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:29 devstack sudo[103209]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-37aa676f-0627-4bbb-b280-80bf54d97870 tempest-VolumeDependencyTests-893333359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673.2cc870cb-93ed-41c4-b082-808d5290d00d" returned: 0 in 0.451s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:29 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-37aa676f-0627-4bbb-b280-80bf54d97870 tempest-VolumeDependencyTests-893333359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:03:29 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ab53ef-a09a-4162-a2d0-0a0b76a16807]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:03:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-37aa676f-0627-4bbb-b280-80bf54d97870 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:29 devstack sudo[103217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673 Jul 30 17:03:29 devstack sudo[103217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:29 devstack sudo[103214]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c3b00946-e01b-4879-961d-70fd2eeb9485 tempest-VolumesGetTest-1118799669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.296s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:29 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-c3b00946-e01b-4879-961d-70fd2eeb9485 tempest-VolumesGetTest-1118799669 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:03:29 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-c3b00946-e01b-4879-961d-70fd2eeb9485 tempest-VolumesGetTest-1118799669 None] Deleted volume successfully. Jul 30 17:03:29 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c3b00946-e01b-4879-961d-70fd2eeb9485 tempest-VolumesGetTest-1118799669 None] Lock "cinder-c6b2657f-9eac-4778-9ef0-5d5e750ce5a0-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:29 devstack sudo[103217]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-37aa676f-0627-4bbb-b280-80bf54d97870 tempest-VolumeDependencyTests-893333359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673" returned: 0 in 0.448s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-37aa676f-0627-4bbb-b280-80bf54d97870 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673.2cc870cb-93ed-41c4-b082-808d5290d00d {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:29 devstack sudo[103224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673.2cc870cb-93ed-41c4-b082-808d5290d00d Jul 30 17:03:29 devstack sudo[103224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:30 devstack sudo[103224]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-37aa676f-0627-4bbb-b280-80bf54d97870 tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673.2cc870cb-93ed-41c4-b082-808d5290d00d" returned: 0 in 0.464s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-37aa676f-0627-4bbb-b280-80bf54d97870 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673.2cc870cb-93ed-41c4-b082-808d5290d00d {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:30 devstack sudo[103229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673.2cc870cb-93ed-41c4-b082-808d5290d00d Jul 30 17:03:30 devstack sudo[103229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:30 devstack sudo[103229]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-37aa676f-0627-4bbb-b280-80bf54d97870 tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673.2cc870cb-93ed-41c4-b082-808d5290d00d" returned: 0 in 0.272s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:30 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-37aa676f-0627-4bbb-b280-80bf54d97870 tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-2cc870cb-93ed-41c4-b082-808d5290d00d" released by "_delete_snapshot" :: held 1.769s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:30 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-37aa676f-0627-4bbb-b280-80bf54d97870 tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-988dafa5-d9ee-4160-a89b-fc5bc9d09673" released by "delete_snapshot" :: held 1.804s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:30 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-37aa676f-0627-4bbb-b280-80bf54d97870 tempest-VolumeDependencyTests-893333359 None] Created reservations ['95af5597-aefa-4b4e-9f37-82568aadc2c9', '2887ad6d-161a-4ec0-9aae-3f971a3b975d', 'dbf7347e-bcd7-46a6-88d5-f5222cd0bee1', 'eae6c46a-0316-40a0-ae54-2d83d73e9b51'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:03:30 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-37aa676f-0627-4bbb-b280-80bf54d97870 tempest-VolumeDependencyTests-893333359 None] Delete snapshot completed successfully. Jul 30 17:03:30 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-37aa676f-0627-4bbb-b280-80bf54d97870 tempest-VolumeDependencyTests-893333359 None] Lock "cinder-2cc870cb-93ed-41c4-b082-808d5290d00d-delete_snapshot" released by "delete_snapshot" :: held 1.965s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:30 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-fb0a0b8f-d4e7-4f70-a2e3-c30906c13414 tempest-VolumeDependencyTests-893333359 None] Acquiring lock "cinder-8b4df5f2-73ba-4d23-b402-6251d845636c-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:30 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-fb0a0b8f-d4e7-4f70-a2e3-c30906c13414 tempest-VolumeDependencyTests-893333359 None] Lock "cinder-8b4df5f2-73ba-4d23-b402-6251d845636c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:31 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-fb0a0b8f-d4e7-4f70-a2e3-c30906c13414 tempest-VolumeDependencyTests-893333359 None] Acquiring lock "cinder-quobyte-8b4df5f2-73ba-4d23-b402-6251d845636c" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:31 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-fb0a0b8f-d4e7-4f70-a2e3-c30906c13414 tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-8b4df5f2-73ba-4d23-b402-6251d845636c" acquired by "delete_volume" :: waited 0.027s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:31 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[0918b561-a720-4887-bdc0-8ba1e29511df]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:03:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fb0a0b8f-d4e7-4f70-a2e3-c30906c13414 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b4df5f2-73ba-4d23-b402-6251d845636c {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:31 devstack sudo[103232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b4df5f2-73ba-4d23-b402-6251d845636c Jul 30 17:03:31 devstack sudo[103232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:31 devstack sudo[103232]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fb0a0b8f-d4e7-4f70-a2e3-c30906c13414 tempest-VolumeDependencyTests-893333359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b4df5f2-73ba-4d23-b402-6251d845636c" returned: 0 in 0.483s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fb0a0b8f-d4e7-4f70-a2e3-c30906c13414 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b4df5f2-73ba-4d23-b402-6251d845636c {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:31 devstack sudo[103237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b4df5f2-73ba-4d23-b402-6251d845636c Jul 30 17:03:31 devstack sudo[103237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:31 devstack sudo[103237]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fb0a0b8f-d4e7-4f70-a2e3-c30906c13414 tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b4df5f2-73ba-4d23-b402-6251d845636c" returned: 0 in 0.351s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:31 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-fb0a0b8f-d4e7-4f70-a2e3-c30906c13414 tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-8b4df5f2-73ba-4d23-b402-6251d845636c" released by "delete_volume" :: held 0.928s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:32 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-fb0a0b8f-d4e7-4f70-a2e3-c30906c13414 tempest-VolumeDependencyTests-893333359 None] Created reservations ['38bc75ab-8bba-419a-b007-191cc9248612', 'bc707d3a-5f16-4205-947f-04a0ceb49020', 'c7c5d702-96bf-465b-a227-b615d730014a', '0a9117a4-79a5-4174-a76f-8a684743dfa5'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:03:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-fb0a0b8f-d4e7-4f70-a2e3-c30906c13414 tempest-VolumeDependencyTests-893333359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-fb0a0b8f-d4e7-4f70-a2e3-c30906c13414 tempest-VolumeDependencyTests-893333359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:32 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-fb0a0b8f-d4e7-4f70-a2e3-c30906c13414 tempest-VolumeDependencyTests-893333359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:03:32 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-fb0a0b8f-d4e7-4f70-a2e3-c30906c13414 tempest-VolumeDependencyTests-893333359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:03:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-fb0a0b8f-d4e7-4f70-a2e3-c30906c13414 tempest-VolumeDependencyTests-893333359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fb0a0b8f-d4e7-4f70-a2e3-c30906c13414 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:32 devstack sudo[103241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:03:32 devstack sudo[103241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:32 devstack sudo[103241]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fb0a0b8f-d4e7-4f70-a2e3-c30906c13414 tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.289s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:32 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-fb0a0b8f-d4e7-4f70-a2e3-c30906c13414 tempest-VolumeDependencyTests-893333359 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:03:32 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-fb0a0b8f-d4e7-4f70-a2e3-c30906c13414 tempest-VolumeDependencyTests-893333359 None] Deleted volume successfully. Jul 30 17:03:32 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-fb0a0b8f-d4e7-4f70-a2e3-c30906c13414 tempest-VolumeDependencyTests-893333359 None] Lock "cinder-8b4df5f2-73ba-4d23-b402-6251d845636c-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:33 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d165c7aa-4940-41b4-a6b4-3d57af9d47de tempest-VolumeDependencyTests-893333359 None] Acquiring lock "cinder-988dafa5-d9ee-4160-a89b-fc5bc9d09673-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:33 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d165c7aa-4940-41b4-a6b4-3d57af9d47de tempest-VolumeDependencyTests-893333359 None] Lock "cinder-988dafa5-d9ee-4160-a89b-fc5bc9d09673-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:33 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d165c7aa-4940-41b4-a6b4-3d57af9d47de tempest-VolumeDependencyTests-893333359 None] Acquiring lock "cinder-quobyte-988dafa5-d9ee-4160-a89b-fc5bc9d09673" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:33 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d165c7aa-4940-41b4-a6b4-3d57af9d47de tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-988dafa5-d9ee-4160-a89b-fc5bc9d09673" acquired by "delete_volume" :: waited 0.018s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:33 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b5d629-157e-485e-8796-e749b2aba1f5]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:03:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d165c7aa-4940-41b4-a6b4-3d57af9d47de tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:33 devstack sudo[103244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673 Jul 30 17:03:33 devstack sudo[103244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:33 devstack sudo[103244]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d165c7aa-4940-41b4-a6b4-3d57af9d47de tempest-VolumeDependencyTests-893333359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673" returned: 0 in 0.450s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d165c7aa-4940-41b4-a6b4-3d57af9d47de tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:33 devstack sudo[103249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673 Jul 30 17:03:33 devstack sudo[103249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:34 devstack sudo[103249]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d165c7aa-4940-41b4-a6b4-3d57af9d47de tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-988dafa5-d9ee-4160-a89b-fc5bc9d09673" returned: 0 in 0.402s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:34 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d165c7aa-4940-41b4-a6b4-3d57af9d47de tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-988dafa5-d9ee-4160-a89b-fc5bc9d09673" released by "delete_volume" :: held 0.935s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:34 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-d165c7aa-4940-41b4-a6b4-3d57af9d47de tempest-VolumeDependencyTests-893333359 None] Created reservations ['36e3e57a-5277-4edb-915c-dfeeed9b9417', 'b1fe465a-0892-4ddf-b8d9-72605a56f9cf', '94530e14-f3f7-4988-92db-cf466dd773c5', '16413d27-0e5f-46b8-b722-b7dafbc65c33'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:03:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d165c7aa-4940-41b4-a6b4-3d57af9d47de tempest-VolumeDependencyTests-893333359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d165c7aa-4940-41b4-a6b4-3d57af9d47de tempest-VolumeDependencyTests-893333359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:34 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d165c7aa-4940-41b4-a6b4-3d57af9d47de tempest-VolumeDependencyTests-893333359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:03:34 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d165c7aa-4940-41b4-a6b4-3d57af9d47de tempest-VolumeDependencyTests-893333359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:03:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d165c7aa-4940-41b4-a6b4-3d57af9d47de tempest-VolumeDependencyTests-893333359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d165c7aa-4940-41b4-a6b4-3d57af9d47de tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:34 devstack sudo[103252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:03:34 devstack sudo[103252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:34 devstack sudo[103252]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d165c7aa-4940-41b4-a6b4-3d57af9d47de tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.283s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:34 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-d165c7aa-4940-41b4-a6b4-3d57af9d47de tempest-VolumeDependencyTests-893333359 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:03:34 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-d165c7aa-4940-41b4-a6b4-3d57af9d47de tempest-VolumeDependencyTests-893333359 None] Deleted volume successfully. Jul 30 17:03:34 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d165c7aa-4940-41b4-a6b4-3d57af9d47de tempest-VolumeDependencyTests-893333359 None] Lock "cinder-988dafa5-d9ee-4160-a89b-fc5bc9d09673-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:35 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-247a9482-7e4e-456a-a2a1-924fd1dedfce tempest-VolumeDependencyTests-893333359 None] Acquiring lock "cinder-26bd0b33-e889-4381-8b04-b3cd5f25739f-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:35 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-247a9482-7e4e-456a-a2a1-924fd1dedfce tempest-VolumeDependencyTests-893333359 None] Lock "cinder-26bd0b33-e889-4381-8b04-b3cd5f25739f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:35 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-247a9482-7e4e-456a-a2a1-924fd1dedfce tempest-VolumeDependencyTests-893333359 None] Acquiring lock "cinder-quobyte-26bd0b33-e889-4381-8b04-b3cd5f25739f" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:35 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-247a9482-7e4e-456a-a2a1-924fd1dedfce tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-26bd0b33-e889-4381-8b04-b3cd5f25739f" acquired by "delete_volume" :: waited 0.023s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:35 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-841c1cd1-741e-40d9-80e2-19cefd7e242d tempest-VolumesListTestJSON-915604785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:03:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-841c1cd1-741e-40d9-80e2-19cefd7e242d tempest-VolumesListTestJSON-915604785 None] Flow 'volume_create_manager' (42a5f988-693b-4a2f-9b80-fc8a00e762d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:03:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-841c1cd1-741e-40d9-80e2-19cefd7e242d tempest-VolumesListTestJSON-915604785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bfa05c1-8f22-4f77-8919-999909fdb0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:35 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[265b9bf8-e674-41fa-a2b2-fbb36fcf07dc]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:03:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-247a9482-7e4e-456a-a2a1-924fd1dedfce tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-26bd0b33-e889-4381-8b04-b3cd5f25739f {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-841c1cd1-741e-40d9-80e2-19cefd7e242d tempest-VolumesListTestJSON-915604785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bfa05c1-8f22-4f77-8919-999909fdb0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1643599302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71dabcfe-33fd-4c8e-a4f0-24daa71d76c5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ef40349f5c8c4855b84a9ef4c08f37d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:03:36Z,use_quota=True,user_id='7fdfb30096394fe2ac4cdc713d31f5ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-841c1cd1-741e-40d9-80e2-19cefd7e242d tempest-VolumesListTestJSON-915604785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4994b8cb-ec2c-4221-b163-b743e005514a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-841c1cd1-741e-40d9-80e2-19cefd7e242d tempest-VolumesListTestJSON-915604785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4994b8cb-ec2c-4221-b163-b743e005514a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-841c1cd1-741e-40d9-80e2-19cefd7e242d tempest-VolumesListTestJSON-915604785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b53a676-0624-4c7f-b2e1-01d247ba076f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-841c1cd1-741e-40d9-80e2-19cefd7e242d tempest-VolumesListTestJSON-915604785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b53a676-0624-4c7f-b2e1-01d247ba076f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71dabcfe-33fd-4c8e-a4f0-24daa71d76c5', 'volume_name': 'volume-71dabcfe-33fd-4c8e-a4f0-24daa71d76c5', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-841c1cd1-741e-40d9-80e2-19cefd7e242d tempest-VolumesListTestJSON-915604785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb879d75-665e-4f7d-a933-ccbde4a84bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-841c1cd1-741e-40d9-80e2-19cefd7e242d tempest-VolumesListTestJSON-915604785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb879d75-665e-4f7d-a933-ccbde4a84bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-841c1cd1-741e-40d9-80e2-19cefd7e242d tempest-VolumesListTestJSON-915604785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcfbfc7e-381b-4f5f-b48c-07e690fcd8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:35 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-841c1cd1-741e-40d9-80e2-19cefd7e242d tempest-VolumesListTestJSON-915604785 None] Volume 71dabcfe-33fd-4c8e-a4f0-24daa71d76c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71dabcfe-33fd-4c8e-a4f0-24daa71d76c5', 'volume_size': 1} Jul 30 17:03:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-841c1cd1-741e-40d9-80e2-19cefd7e242d tempest-VolumesListTestJSON-915604785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-841c1cd1-741e-40d9-80e2-19cefd7e242d tempest-VolumesListTestJSON-915604785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:35 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-841c1cd1-741e-40d9-80e2-19cefd7e242d tempest-VolumesListTestJSON-915604785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1643599302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71dabcfe-33fd-4c8e-a4f0-24daa71d76c5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ef40349f5c8c4855b84a9ef4c08f37d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:03:36Z,use_quota=True,user_id='7fdfb30096394fe2ac4cdc713d31f5ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:03:35 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-841c1cd1-741e-40d9-80e2-19cefd7e242d tempest-VolumesListTestJSON-915604785 None] Creating volume 71dabcfe-33fd-4c8e-a4f0-24daa71d76c5 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:03:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-841c1cd1-741e-40d9-80e2-19cefd7e242d tempest-VolumesListTestJSON-915604785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-841c1cd1-741e-40d9-80e2-19cefd7e242d tempest-VolumesListTestJSON-915604785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:35 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-841c1cd1-741e-40d9-80e2-19cefd7e242d tempest-VolumesListTestJSON-915604785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:03:35 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-841c1cd1-741e-40d9-80e2-19cefd7e242d tempest-VolumesListTestJSON-915604785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:03:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-841c1cd1-741e-40d9-80e2-19cefd7e242d tempest-VolumesListTestJSON-915604785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:35 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-841c1cd1-741e-40d9-80e2-19cefd7e242d tempest-VolumesListTestJSON-915604785 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:03:35 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-841c1cd1-741e-40d9-80e2-19cefd7e242d tempest-VolumesListTestJSON-915604785 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:03:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-841c1cd1-741e-40d9-80e2-19cefd7e242d tempest-VolumesListTestJSON-915604785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71dabcfe-33fd-4c8e-a4f0-24daa71d76c5 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:35 devstack sudo[103256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71dabcfe-33fd-4c8e-a4f0-24daa71d76c5 1073741824 Jul 30 17:03:35 devstack sudo[103256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:35 devstack sudo[103255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-26bd0b33-e889-4381-8b04-b3cd5f25739f Jul 30 17:03:35 devstack sudo[103255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:36 devstack sudo[103255]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-247a9482-7e4e-456a-a2a1-924fd1dedfce tempest-VolumeDependencyTests-893333359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-26bd0b33-e889-4381-8b04-b3cd5f25739f" returned: 0 in 0.438s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-247a9482-7e4e-456a-a2a1-924fd1dedfce tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-26bd0b33-e889-4381-8b04-b3cd5f25739f {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:36 devstack sudo[103265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-26bd0b33-e889-4381-8b04-b3cd5f25739f Jul 30 17:03:36 devstack sudo[103265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:36 devstack sudo[103256]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-841c1cd1-741e-40d9-80e2-19cefd7e242d tempest-VolumesListTestJSON-915604785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71dabcfe-33fd-4c8e-a4f0-24daa71d76c5 1073741824" returned: 0 in 0.606s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-841c1cd1-741e-40d9-80e2-19cefd7e242d tempest-VolumesListTestJSON-915604785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71dabcfe-33fd-4c8e-a4f0-24daa71d76c5 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:36 devstack sudo[103265]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-247a9482-7e4e-456a-a2a1-924fd1dedfce tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-26bd0b33-e889-4381-8b04-b3cd5f25739f" returned: 0 in 0.343s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:36 devstack sudo[103268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71dabcfe-33fd-4c8e-a4f0-24daa71d76c5 Jul 30 17:03:36 devstack sudo[103268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:36 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-247a9482-7e4e-456a-a2a1-924fd1dedfce tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-26bd0b33-e889-4381-8b04-b3cd5f25739f" released by "delete_volume" :: held 0.861s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:36 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-247a9482-7e4e-456a-a2a1-924fd1dedfce tempest-VolumeDependencyTests-893333359 None] Created reservations ['6cc82f71-979b-416c-ba67-6c77eb2ff5fb', 'c5395932-c570-49bf-bb16-8cac588913ad', 'a6772025-a1dc-4431-9ba1-30a3ef0876a3', 'd055d7ee-8018-49e1-8e71-6d2e2e7bf38c'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:03:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-247a9482-7e4e-456a-a2a1-924fd1dedfce tempest-VolumeDependencyTests-893333359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-247a9482-7e4e-456a-a2a1-924fd1dedfce tempest-VolumeDependencyTests-893333359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:36 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-247a9482-7e4e-456a-a2a1-924fd1dedfce tempest-VolumeDependencyTests-893333359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:03:36 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-247a9482-7e4e-456a-a2a1-924fd1dedfce tempest-VolumeDependencyTests-893333359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:03:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-247a9482-7e4e-456a-a2a1-924fd1dedfce tempest-VolumeDependencyTests-893333359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-247a9482-7e4e-456a-a2a1-924fd1dedfce tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:36 devstack sudo[103270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:03:36 devstack sudo[103270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:36 devstack sudo[103268]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-841c1cd1-741e-40d9-80e2-19cefd7e242d tempest-VolumesListTestJSON-915604785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71dabcfe-33fd-4c8e-a4f0-24daa71d76c5" returned: 0 in 0.454s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:36 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-841c1cd1-741e-40d9-80e2-19cefd7e242d tempest-VolumesListTestJSON-915604785 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:03:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-841c1cd1-741e-40d9-80e2-19cefd7e242d tempest-VolumesListTestJSON-915604785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:36 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-841c1cd1-741e-40d9-80e2-19cefd7e242d tempest-VolumesListTestJSON-915604785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcfbfc7e-381b-4f5f-b48c-07e690fcd8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71dabcfe-33fd-4c8e-a4f0-24daa71d76c5', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:36 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-841c1cd1-741e-40d9-80e2-19cefd7e242d tempest-VolumesListTestJSON-915604785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26447277-7a5c-4dba-8e7b-c553244b304c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:36 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-841c1cd1-741e-40d9-80e2-19cefd7e242d tempest-VolumesListTestJSON-915604785 None] Volume volume-71dabcfe-33fd-4c8e-a4f0-24daa71d76c5 (71dabcfe-33fd-4c8e-a4f0-24daa71d76c5): created successfully Jul 30 17:03:36 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-841c1cd1-741e-40d9-80e2-19cefd7e242d tempest-VolumesListTestJSON-915604785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26447277-7a5c-4dba-8e7b-c553244b304c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:36 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-841c1cd1-741e-40d9-80e2-19cefd7e242d tempest-VolumesListTestJSON-915604785 None] Flow 'volume_create_manager' (42a5f988-693b-4a2f-9b80-fc8a00e762d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:03:37 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-841c1cd1-741e-40d9-80e2-19cefd7e242d tempest-VolumesListTestJSON-915604785 None] Created volume successfully. Jul 30 17:03:37 devstack sudo[103270]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-247a9482-7e4e-456a-a2a1-924fd1dedfce tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.429s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:37 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-247a9482-7e4e-456a-a2a1-924fd1dedfce tempest-VolumeDependencyTests-893333359 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:03:37 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-247a9482-7e4e-456a-a2a1-924fd1dedfce tempest-VolumeDependencyTests-893333359 None] Deleted volume successfully. Jul 30 17:03:37 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-247a9482-7e4e-456a-a2a1-924fd1dedfce tempest-VolumeDependencyTests-893333359 None] Lock "cinder-26bd0b33-e889-4381-8b04-b3cd5f25739f-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:37 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2b0250d-2ea4-47ec-be9d-862809cfa9ef tempest-VolumeDependencyTests-893333359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:03:37 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b2b0250d-2ea4-47ec-be9d-862809cfa9ef tempest-VolumeDependencyTests-893333359 None] Flow 'volume_create_manager' (7088c2b0-4290-4e1c-953e-5619cd7a6cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:03:37 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b2b0250d-2ea4-47ec-be9d-862809cfa9ef tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f08ead55-13ae-4458-b4ee-bf55f11c7783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:37 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b2b0250d-2ea4-47ec-be9d-862809cfa9ef tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f08ead55-13ae-4458-b4ee-bf55f11c7783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:03:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1697089428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e68687d0-ddf5-4910-bb70-5ca79cc59433,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1142be8cf434dc9b1a32ef12a92e88b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:03:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:03:37Z,use_quota=True,user_id='db3e9fa2901f4abe9034e8c4a4f63fb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:37 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b2b0250d-2ea4-47ec-be9d-862809cfa9ef tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd0fc20e-121f-4553-984c-f38e3cf33e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:37 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b2b0250d-2ea4-47ec-be9d-862809cfa9ef tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd0fc20e-121f-4553-984c-f38e3cf33e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:37 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b2b0250d-2ea4-47ec-be9d-862809cfa9ef tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (117a67bf-8cc5-4beb-b7dc-0fe1cfbb4f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:37 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b2b0250d-2ea4-47ec-be9d-862809cfa9ef tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (117a67bf-8cc5-4beb-b7dc-0fe1cfbb4f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e68687d0-ddf5-4910-bb70-5ca79cc59433', 'volume_name': 'volume-e68687d0-ddf5-4910-bb70-5ca79cc59433', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:37 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b2b0250d-2ea4-47ec-be9d-862809cfa9ef tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99f5107c-e288-4a5b-9ca2-407b2df9170f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:37 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b2b0250d-2ea4-47ec-be9d-862809cfa9ef tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99f5107c-e288-4a5b-9ca2-407b2df9170f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:37 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b2b0250d-2ea4-47ec-be9d-862809cfa9ef tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65e944e1-39a1-445c-82ff-154b6999a514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:37 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-b2b0250d-2ea4-47ec-be9d-862809cfa9ef tempest-VolumeDependencyTests-893333359 None] Volume e68687d0-ddf5-4910-bb70-5ca79cc59433: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e68687d0-ddf5-4910-bb70-5ca79cc59433', 'volume_size': 1} Jul 30 17:03:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b2b0250d-2ea4-47ec-be9d-862809cfa9ef tempest-VolumeDependencyTests-893333359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b2b0250d-2ea4-47ec-be9d-862809cfa9ef tempest-VolumeDependencyTests-893333359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:37 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b2b0250d-2ea4-47ec-be9d-862809cfa9ef tempest-VolumeDependencyTests-893333359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:03:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1697089428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e68687d0-ddf5-4910-bb70-5ca79cc59433,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1142be8cf434dc9b1a32ef12a92e88b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:03:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:03:37Z,use_quota=True,user_id='db3e9fa2901f4abe9034e8c4a4f63fb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:03:37 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-b2b0250d-2ea4-47ec-be9d-862809cfa9ef tempest-VolumeDependencyTests-893333359 None] Creating volume e68687d0-ddf5-4910-bb70-5ca79cc59433 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:03:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b2b0250d-2ea4-47ec-be9d-862809cfa9ef tempest-VolumeDependencyTests-893333359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b2b0250d-2ea4-47ec-be9d-862809cfa9ef tempest-VolumeDependencyTests-893333359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:37 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b2b0250d-2ea4-47ec-be9d-862809cfa9ef tempest-VolumeDependencyTests-893333359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:03:37 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b2b0250d-2ea4-47ec-be9d-862809cfa9ef tempest-VolumeDependencyTests-893333359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:03:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b2b0250d-2ea4-47ec-be9d-862809cfa9ef tempest-VolumeDependencyTests-893333359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:37 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b2b0250d-2ea4-47ec-be9d-862809cfa9ef tempest-VolumeDependencyTests-893333359 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:03:37 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-b2b0250d-2ea4-47ec-be9d-862809cfa9ef tempest-VolumeDependencyTests-893333359 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:03:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b2b0250d-2ea4-47ec-be9d-862809cfa9ef tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e68687d0-ddf5-4910-bb70-5ca79cc59433 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:37 devstack sudo[103274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e68687d0-ddf5-4910-bb70-5ca79cc59433 1073741824 Jul 30 17:03:37 devstack sudo[103274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:37 devstack sudo[103274]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b2b0250d-2ea4-47ec-be9d-862809cfa9ef tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e68687d0-ddf5-4910-bb70-5ca79cc59433 1073741824" returned: 0 in 0.527s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b2b0250d-2ea4-47ec-be9d-862809cfa9ef tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e68687d0-ddf5-4910-bb70-5ca79cc59433 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:38 devstack sudo[103280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e68687d0-ddf5-4910-bb70-5ca79cc59433 Jul 30 17:03:38 devstack sudo[103280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:38 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-644bdf49-9fd0-4450-a0f2-96455c57a512 tempest-VolumesListTestJSON-915604785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:03:38 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-644bdf49-9fd0-4450-a0f2-96455c57a512 tempest-VolumesListTestJSON-915604785 None] Flow 'volume_create_manager' (e76b31e1-9c34-4d49-9739-563feff18ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:03:38 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-644bdf49-9fd0-4450-a0f2-96455c57a512 tempest-VolumesListTestJSON-915604785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18466a97-bf02-43e3-a558-9bcb170434b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:38 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-644bdf49-9fd0-4450-a0f2-96455c57a512 tempest-VolumesListTestJSON-915604785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18466a97-bf02-43e3-a558-9bcb170434b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-10138032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09461cd2-4a55-45e2-8359-16ec9f3b3560,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ef40349f5c8c4855b84a9ef4c08f37d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:03:38Z,use_quota=True,user_id='7fdfb30096394fe2ac4cdc713d31f5ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:38 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-644bdf49-9fd0-4450-a0f2-96455c57a512 tempest-VolumesListTestJSON-915604785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0188c935-4f0b-45f8-8c87-8dc71b87f7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:38 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-644bdf49-9fd0-4450-a0f2-96455c57a512 tempest-VolumesListTestJSON-915604785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0188c935-4f0b-45f8-8c87-8dc71b87f7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:38 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-644bdf49-9fd0-4450-a0f2-96455c57a512 tempest-VolumesListTestJSON-915604785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af182ece-08f5-4152-b758-736002929827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:38 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-644bdf49-9fd0-4450-a0f2-96455c57a512 tempest-VolumesListTestJSON-915604785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af182ece-08f5-4152-b758-736002929827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09461cd2-4a55-45e2-8359-16ec9f3b3560', 'volume_name': 'volume-09461cd2-4a55-45e2-8359-16ec9f3b3560', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:38 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-644bdf49-9fd0-4450-a0f2-96455c57a512 tempest-VolumesListTestJSON-915604785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aa5dd45-d938-4bc8-b839-5ee06c779d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:38 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-644bdf49-9fd0-4450-a0f2-96455c57a512 tempest-VolumesListTestJSON-915604785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aa5dd45-d938-4bc8-b839-5ee06c779d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:38 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-644bdf49-9fd0-4450-a0f2-96455c57a512 tempest-VolumesListTestJSON-915604785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13576660-8305-4f63-9157-2b5f82e1d4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:38 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-644bdf49-9fd0-4450-a0f2-96455c57a512 tempest-VolumesListTestJSON-915604785 None] Volume 09461cd2-4a55-45e2-8359-16ec9f3b3560: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09461cd2-4a55-45e2-8359-16ec9f3b3560', 'volume_size': 1} Jul 30 17:03:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-644bdf49-9fd0-4450-a0f2-96455c57a512 tempest-VolumesListTestJSON-915604785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:38 devstack sudo[103280]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b2b0250d-2ea4-47ec-be9d-862809cfa9ef tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e68687d0-ddf5-4910-bb70-5ca79cc59433" returned: 0 in 0.309s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:38 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b2b0250d-2ea4-47ec-be9d-862809cfa9ef tempest-VolumeDependencyTests-893333359 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:03:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b2b0250d-2ea4-47ec-be9d-862809cfa9ef tempest-VolumeDependencyTests-893333359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-644bdf49-9fd0-4450-a0f2-96455c57a512 tempest-VolumesListTestJSON-915604785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.095s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:38 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-644bdf49-9fd0-4450-a0f2-96455c57a512 tempest-VolumesListTestJSON-915604785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-10138032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09461cd2-4a55-45e2-8359-16ec9f3b3560,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ef40349f5c8c4855b84a9ef4c08f37d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:03:38Z,use_quota=True,user_id='7fdfb30096394fe2ac4cdc713d31f5ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:03:38 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-644bdf49-9fd0-4450-a0f2-96455c57a512 tempest-VolumesListTestJSON-915604785 None] Creating volume 09461cd2-4a55-45e2-8359-16ec9f3b3560 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:03:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-644bdf49-9fd0-4450-a0f2-96455c57a512 tempest-VolumesListTestJSON-915604785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-644bdf49-9fd0-4450-a0f2-96455c57a512 tempest-VolumesListTestJSON-915604785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:38 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-644bdf49-9fd0-4450-a0f2-96455c57a512 tempest-VolumesListTestJSON-915604785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:03:38 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-644bdf49-9fd0-4450-a0f2-96455c57a512 tempest-VolumesListTestJSON-915604785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:03:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-644bdf49-9fd0-4450-a0f2-96455c57a512 tempest-VolumesListTestJSON-915604785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:38 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-644bdf49-9fd0-4450-a0f2-96455c57a512 tempest-VolumesListTestJSON-915604785 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:03:38 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-644bdf49-9fd0-4450-a0f2-96455c57a512 tempest-VolumesListTestJSON-915604785 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:03:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-644bdf49-9fd0-4450-a0f2-96455c57a512 tempest-VolumesListTestJSON-915604785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-09461cd2-4a55-45e2-8359-16ec9f3b3560 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:38 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b2b0250d-2ea4-47ec-be9d-862809cfa9ef tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65e944e1-39a1-445c-82ff-154b6999a514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e68687d0-ddf5-4910-bb70-5ca79cc59433', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:38 devstack sudo[103283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-09461cd2-4a55-45e2-8359-16ec9f3b3560 1073741824 Jul 30 17:03:38 devstack sudo[103283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:38 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b2b0250d-2ea4-47ec-be9d-862809cfa9ef tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ad66475-6f7f-492d-8a14-99c72dd1e41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:38 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-b2b0250d-2ea4-47ec-be9d-862809cfa9ef tempest-VolumeDependencyTests-893333359 None] Volume volume-e68687d0-ddf5-4910-bb70-5ca79cc59433 (e68687d0-ddf5-4910-bb70-5ca79cc59433): created successfully Jul 30 17:03:38 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b2b0250d-2ea4-47ec-be9d-862809cfa9ef tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ad66475-6f7f-492d-8a14-99c72dd1e41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:38 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b2b0250d-2ea4-47ec-be9d-862809cfa9ef tempest-VolumeDependencyTests-893333359 None] Flow 'volume_create_manager' (7088c2b0-4290-4e1c-953e-5619cd7a6cd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:03:38 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-b2b0250d-2ea4-47ec-be9d-862809cfa9ef tempest-VolumeDependencyTests-893333359 None] Created volume successfully. Jul 30 17:03:38 devstack sudo[103283]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-644bdf49-9fd0-4450-a0f2-96455c57a512 tempest-VolumesListTestJSON-915604785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-09461cd2-4a55-45e2-8359-16ec9f3b3560 1073741824" returned: 0 in 0.447s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-644bdf49-9fd0-4450-a0f2-96455c57a512 tempest-VolumesListTestJSON-915604785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-09461cd2-4a55-45e2-8359-16ec9f3b3560 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:38 devstack sudo[103289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-09461cd2-4a55-45e2-8359-16ec9f3b3560 Jul 30 17:03:38 devstack sudo[103289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:39 devstack sudo[103289]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-644bdf49-9fd0-4450-a0f2-96455c57a512 tempest-VolumesListTestJSON-915604785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-09461cd2-4a55-45e2-8359-16ec9f3b3560" returned: 0 in 0.324s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:39 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-644bdf49-9fd0-4450-a0f2-96455c57a512 tempest-VolumesListTestJSON-915604785 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:03:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-644bdf49-9fd0-4450-a0f2-96455c57a512 tempest-VolumesListTestJSON-915604785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:39 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:UPDATE=214,cinder:DELETE=20,cinder:SELECT=185,cinder:INSERT=70 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:03:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-644bdf49-9fd0-4450-a0f2-96455c57a512 tempest-VolumesListTestJSON-915604785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13576660-8305-4f63-9157-2b5f82e1d4da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09461cd2-4a55-45e2-8359-16ec9f3b3560', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-644bdf49-9fd0-4450-a0f2-96455c57a512 tempest-VolumesListTestJSON-915604785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c517179b-c288-4886-b6a5-d4b7e455bb8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:39 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:UPDATE=249,cinder:SELECT=186,cinder:INSERT=59,cinder:DELETE=18 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:03:39 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-644bdf49-9fd0-4450-a0f2-96455c57a512 tempest-VolumesListTestJSON-915604785 None] Volume volume-09461cd2-4a55-45e2-8359-16ec9f3b3560 (09461cd2-4a55-45e2-8359-16ec9f3b3560): created successfully Jul 30 17:03:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-644bdf49-9fd0-4450-a0f2-96455c57a512 tempest-VolumesListTestJSON-915604785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c517179b-c288-4886-b6a5-d4b7e455bb8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-644bdf49-9fd0-4450-a0f2-96455c57a512 tempest-VolumesListTestJSON-915604785 None] Flow 'volume_create_manager' (e76b31e1-9c34-4d49-9739-563feff18ace) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:03:39 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-644bdf49-9fd0-4450-a0f2-96455c57a512 tempest-VolumesListTestJSON-915604785 None] Created volume successfully. Jul 30 17:03:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-69245930-fd87-4b81-89c7-fa31a2556f7e tempest-VolumeDependencyTests-893333359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-69245930-fd87-4b81-89c7-fa31a2556f7e tempest-VolumeDependencyTests-893333359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:39 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-69245930-fd87-4b81-89c7-fa31a2556f7e tempest-VolumeDependencyTests-893333359 None] Creating offline snapshot c6432d5e-a81f-45d4-8c3d-45b4e4fc2ae4 of volume e68687d0-ddf5-4910-bb70-5ca79cc59433 {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:03:39 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53c26c8-95ae-4282-b46a-e42ec4108e24]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:03:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-69245930-fd87-4b81-89c7-fa31a2556f7e tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e68687d0-ddf5-4910-bb70-5ca79cc59433 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:39 devstack sudo[103292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e68687d0-ddf5-4910-bb70-5ca79cc59433 Jul 30 17:03:39 devstack sudo[103292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:39 devstack sudo[103292]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-69245930-fd87-4b81-89c7-fa31a2556f7e tempest-VolumeDependencyTests-893333359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e68687d0-ddf5-4910-bb70-5ca79cc59433" returned: 0 in 0.376s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-69245930-fd87-4b81-89c7-fa31a2556f7e tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e68687d0-ddf5-4910-bb70-5ca79cc59433,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e68687d0-ddf5-4910-bb70-5ca79cc59433.c6432d5e-a81f-45d4-8c3d-45b4e4fc2ae4 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:40 devstack sudo[103297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e68687d0-ddf5-4910-bb70-5ca79cc59433,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e68687d0-ddf5-4910-bb70-5ca79cc59433.c6432d5e-a81f-45d4-8c3d-45b4e4fc2ae4 1G Jul 30 17:03:40 devstack sudo[103297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:40 devstack sudo[103297]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-69245930-fd87-4b81-89c7-fa31a2556f7e tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e68687d0-ddf5-4910-bb70-5ca79cc59433,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e68687d0-ddf5-4910-bb70-5ca79cc59433.c6432d5e-a81f-45d4-8c3d-45b4e4fc2ae4 1G" returned: 0 in 0.468s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-69245930-fd87-4b81-89c7-fa31a2556f7e tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e68687d0-ddf5-4910-bb70-5ca79cc59433 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e68687d0-ddf5-4910-bb70-5ca79cc59433.c6432d5e-a81f-45d4-8c3d-45b4e4fc2ae4 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:40 devstack sudo[103302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e68687d0-ddf5-4910-bb70-5ca79cc59433 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e68687d0-ddf5-4910-bb70-5ca79cc59433.c6432d5e-a81f-45d4-8c3d-45b4e4fc2ae4 Jul 30 17:03:40 devstack sudo[103302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:40 devstack sudo[103302]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-69245930-fd87-4b81-89c7-fa31a2556f7e tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e68687d0-ddf5-4910-bb70-5ca79cc59433 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e68687d0-ddf5-4910-bb70-5ca79cc59433.c6432d5e-a81f-45d4-8c3d-45b4e4fc2ae4" returned: 0 in 0.362s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:40 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-69245930-fd87-4b81-89c7-fa31a2556f7e tempest-VolumeDependencyTests-893333359 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e68687d0-ddf5-4910-bb70-5ca79cc59433.c6432d5e-a81f-45d4-8c3d-45b4e4fc2ae4 is being set with open permissions: ugo+rw Jul 30 17:03:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-69245930-fd87-4b81-89c7-fa31a2556f7e tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e68687d0-ddf5-4910-bb70-5ca79cc59433.c6432d5e-a81f-45d4-8c3d-45b4e4fc2ae4 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:40 devstack sudo[103307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e68687d0-ddf5-4910-bb70-5ca79cc59433.c6432d5e-a81f-45d4-8c3d-45b4e4fc2ae4 Jul 30 17:03:40 devstack sudo[103307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:40 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eed368c-9dbf-4cf0-ae3f-63f01cf90640 tempest-VolumesListTestJSON-915604785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:03:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8eed368c-9dbf-4cf0-ae3f-63f01cf90640 tempest-VolumesListTestJSON-915604785 None] Flow 'volume_create_manager' (5cdd68d7-da93-4160-9223-4bf4cd5bc59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:03:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8eed368c-9dbf-4cf0-ae3f-63f01cf90640 tempest-VolumesListTestJSON-915604785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81805e3f-5de5-4ecb-b089-f3bf0a34966f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8eed368c-9dbf-4cf0-ae3f-63f01cf90640 tempest-VolumesListTestJSON-915604785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81805e3f-5de5-4ecb-b089-f3bf0a34966f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2025608855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=474cf7fe-b56c-4528-8384-c88147bf368f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ef40349f5c8c4855b84a9ef4c08f37d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:03:41Z,use_quota=True,user_id='7fdfb30096394fe2ac4cdc713d31f5ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8eed368c-9dbf-4cf0-ae3f-63f01cf90640 tempest-VolumesListTestJSON-915604785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7308713-ad99-4536-bf12-a5d28047389d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8eed368c-9dbf-4cf0-ae3f-63f01cf90640 tempest-VolumesListTestJSON-915604785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7308713-ad99-4536-bf12-a5d28047389d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8eed368c-9dbf-4cf0-ae3f-63f01cf90640 tempest-VolumesListTestJSON-915604785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d6af92d-ea3e-428d-b2e7-13311670d95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8eed368c-9dbf-4cf0-ae3f-63f01cf90640 tempest-VolumesListTestJSON-915604785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d6af92d-ea3e-428d-b2e7-13311670d95e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '474cf7fe-b56c-4528-8384-c88147bf368f', 'volume_name': 'volume-474cf7fe-b56c-4528-8384-c88147bf368f', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8eed368c-9dbf-4cf0-ae3f-63f01cf90640 tempest-VolumesListTestJSON-915604785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aedd1cc5-82e7-423b-9381-e2d3257a8501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8eed368c-9dbf-4cf0-ae3f-63f01cf90640 tempest-VolumesListTestJSON-915604785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aedd1cc5-82e7-423b-9381-e2d3257a8501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8eed368c-9dbf-4cf0-ae3f-63f01cf90640 tempest-VolumesListTestJSON-915604785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc299195-904c-4b9f-8c4f-6c602181bd76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:40 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-8eed368c-9dbf-4cf0-ae3f-63f01cf90640 tempest-VolumesListTestJSON-915604785 None] Volume 474cf7fe-b56c-4528-8384-c88147bf368f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-474cf7fe-b56c-4528-8384-c88147bf368f', 'volume_size': 1} Jul 30 17:03:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8eed368c-9dbf-4cf0-ae3f-63f01cf90640 tempest-VolumesListTestJSON-915604785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:41 devstack sudo[103307]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-69245930-fd87-4b81-89c7-fa31a2556f7e tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e68687d0-ddf5-4910-bb70-5ca79cc59433.c6432d5e-a81f-45d4-8c3d-45b4e4fc2ae4" returned: 0 in 0.267s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-69245930-fd87-4b81-89c7-fa31a2556f7e tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e68687d0-ddf5-4910-bb70-5ca79cc59433.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:41 devstack sudo[103310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e68687d0-ddf5-4910-bb70-5ca79cc59433.info Jul 30 17:03:41 devstack sudo[103310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:41 devstack sudo[103310]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-69245930-fd87-4b81-89c7-fa31a2556f7e tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e68687d0-ddf5-4910-bb70-5ca79cc59433.info" returned: 0 in 0.263s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:41 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-69245930-fd87-4b81-89c7-fa31a2556f7e tempest-VolumeDependencyTests-893333359 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e68687d0-ddf5-4910-bb70-5ca79cc59433.info is being set with open permissions: ugo+rw Jul 30 17:03:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-69245930-fd87-4b81-89c7-fa31a2556f7e tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e68687d0-ddf5-4910-bb70-5ca79cc59433.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:41 devstack sudo[103313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e68687d0-ddf5-4910-bb70-5ca79cc59433.info Jul 30 17:03:41 devstack sudo[103313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:41 devstack sudo[103313]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-69245930-fd87-4b81-89c7-fa31a2556f7e tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e68687d0-ddf5-4910-bb70-5ca79cc59433.info" returned: 0 in 0.261s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-69245930-fd87-4b81-89c7-fa31a2556f7e tempest-VolumeDependencyTests-893333359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.088s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8eed368c-9dbf-4cf0-ae3f-63f01cf90640 tempest-VolumesListTestJSON-915604785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.693s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:41 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-8eed368c-9dbf-4cf0-ae3f-63f01cf90640 tempest-VolumesListTestJSON-915604785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2025608855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=474cf7fe-b56c-4528-8384-c88147bf368f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ef40349f5c8c4855b84a9ef4c08f37d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:03:41Z,use_quota=True,user_id='7fdfb30096394fe2ac4cdc713d31f5ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:03:41 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-8eed368c-9dbf-4cf0-ae3f-63f01cf90640 tempest-VolumesListTestJSON-915604785 None] Creating volume 474cf7fe-b56c-4528-8384-c88147bf368f {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:03:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8eed368c-9dbf-4cf0-ae3f-63f01cf90640 tempest-VolumesListTestJSON-915604785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8eed368c-9dbf-4cf0-ae3f-63f01cf90640 tempest-VolumesListTestJSON-915604785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:41 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-8eed368c-9dbf-4cf0-ae3f-63f01cf90640 tempest-VolumesListTestJSON-915604785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:03:41 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-8eed368c-9dbf-4cf0-ae3f-63f01cf90640 tempest-VolumesListTestJSON-915604785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:03:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8eed368c-9dbf-4cf0-ae3f-63f01cf90640 tempest-VolumesListTestJSON-915604785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:41 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-8eed368c-9dbf-4cf0-ae3f-63f01cf90640 tempest-VolumesListTestJSON-915604785 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:03:41 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-8eed368c-9dbf-4cf0-ae3f-63f01cf90640 tempest-VolumesListTestJSON-915604785 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:03:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8eed368c-9dbf-4cf0-ae3f-63f01cf90640 tempest-VolumesListTestJSON-915604785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-474cf7fe-b56c-4528-8384-c88147bf368f 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:41 devstack sudo[103316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-474cf7fe-b56c-4528-8384-c88147bf368f 1073741824 Jul 30 17:03:41 devstack sudo[103316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:41 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-69245930-fd87-4b81-89c7-fa31a2556f7e tempest-VolumeDependencyTests-893333359 None] Create snapshot completed successfully Jul 30 17:03:42 devstack sudo[103316]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8eed368c-9dbf-4cf0-ae3f-63f01cf90640 tempest-VolumesListTestJSON-915604785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-474cf7fe-b56c-4528-8384-c88147bf368f 1073741824" returned: 0 in 0.470s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8eed368c-9dbf-4cf0-ae3f-63f01cf90640 tempest-VolumesListTestJSON-915604785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-474cf7fe-b56c-4528-8384-c88147bf368f {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:42 devstack sudo[103323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-474cf7fe-b56c-4528-8384-c88147bf368f Jul 30 17:03:42 devstack sudo[103323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:42 devstack sudo[103323]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8eed368c-9dbf-4cf0-ae3f-63f01cf90640 tempest-VolumesListTestJSON-915604785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-474cf7fe-b56c-4528-8384-c88147bf368f" returned: 0 in 0.273s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:42 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-8eed368c-9dbf-4cf0-ae3f-63f01cf90640 tempest-VolumesListTestJSON-915604785 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:03:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8eed368c-9dbf-4cf0-ae3f-63f01cf90640 tempest-VolumesListTestJSON-915604785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:42 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8eed368c-9dbf-4cf0-ae3f-63f01cf90640 tempest-VolumesListTestJSON-915604785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc299195-904c-4b9f-8c4f-6c602181bd76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-474cf7fe-b56c-4528-8384-c88147bf368f', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:42 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8eed368c-9dbf-4cf0-ae3f-63f01cf90640 tempest-VolumesListTestJSON-915604785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aa40089-1c9e-4825-a530-c0b1ce27ee96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:42 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-8eed368c-9dbf-4cf0-ae3f-63f01cf90640 tempest-VolumesListTestJSON-915604785 None] Volume volume-474cf7fe-b56c-4528-8384-c88147bf368f (474cf7fe-b56c-4528-8384-c88147bf368f): created successfully Jul 30 17:03:42 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8eed368c-9dbf-4cf0-ae3f-63f01cf90640 tempest-VolumesListTestJSON-915604785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aa40089-1c9e-4825-a530-c0b1ce27ee96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:42 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8eed368c-9dbf-4cf0-ae3f-63f01cf90640 tempest-VolumesListTestJSON-915604785 None] Flow 'volume_create_manager' (5cdd68d7-da93-4160-9223-4bf4cd5bc59b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:03:42 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-8eed368c-9dbf-4cf0-ae3f-63f01cf90640 tempest-VolumesListTestJSON-915604785 None] Created volume successfully. Jul 30 17:03:43 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a94abe8-c984-40cc-8d3f-50f60efc2afa tempest-VolumeDependencyTests-893333359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:03:43 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0a94abe8-c984-40cc-8d3f-50f60efc2afa tempest-VolumeDependencyTests-893333359 None] Flow 'volume_create_manager' (04cdf68b-13da-4cf2-96b3-ed4de43a2492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:03:43 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0a94abe8-c984-40cc-8d3f-50f60efc2afa tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10ec8126-1bd8-45ac-9431-2d07a0c09356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:43 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0a94abe8-c984-40cc-8d3f-50f60efc2afa tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10ec8126-1bd8-45ac-9431-2d07a0c09356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:03:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1608851692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ae21019-9255-4f96-b461-5bd8cd0bb32f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1142be8cf434dc9b1a32ef12a92e88b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:03:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c6432d5e-a81f-45d4-8c3d-45b4e4fc2ae4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:03:43Z,use_quota=True,user_id='db3e9fa2901f4abe9034e8c4a4f63fb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:43 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0a94abe8-c984-40cc-8d3f-50f60efc2afa tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bde3210-e691-46b4-8013-4a2edf20983a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:43 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0a94abe8-c984-40cc-8d3f-50f60efc2afa tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bde3210-e691-46b4-8013-4a2edf20983a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:43 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0a94abe8-c984-40cc-8d3f-50f60efc2afa tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80c4a40b-a76b-4334-91e3-83218cb12887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:43 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0a94abe8-c984-40cc-8d3f-50f60efc2afa tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80c4a40b-a76b-4334-91e3-83218cb12887) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2ae21019-9255-4f96-b461-5bd8cd0bb32f', 'volume_name': 'volume-2ae21019-9255-4f96-b461-5bd8cd0bb32f', 'volume_size': 1, 'snapshot_id': 'c6432d5e-a81f-45d4-8c3d-45b4e4fc2ae4'}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:43 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0a94abe8-c984-40cc-8d3f-50f60efc2afa tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4caf6260-3361-44b1-b7c1-e760cb7c1950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:43 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0a94abe8-c984-40cc-8d3f-50f60efc2afa tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4caf6260-3361-44b1-b7c1-e760cb7c1950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:43 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0a94abe8-c984-40cc-8d3f-50f60efc2afa tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5fdfad5-9bdb-444d-b8a0-26633741813f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:43 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-0a94abe8-c984-40cc-8d3f-50f60efc2afa tempest-VolumeDependencyTests-893333359 None] Volume 2ae21019-9255-4f96-b461-5bd8cd0bb32f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2ae21019-9255-4f96-b461-5bd8cd0bb32f', 'volume_size': 1, 'snapshot_id': 'c6432d5e-a81f-45d4-8c3d-45b4e4fc2ae4'} Jul 30 17:03:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0a94abe8-c984-40cc-8d3f-50f60efc2afa tempest-VolumeDependencyTests-893333359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0a94abe8-c984-40cc-8d3f-50f60efc2afa tempest-VolumeDependencyTests-893333359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:43 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-0a94abe8-c984-40cc-8d3f-50f60efc2afa tempest-VolumeDependencyTests-893333359 None] Acquiring lock "cinder-quobyte-c6432d5e-a81f-45d4-8c3d-45b4e4fc2ae4-2ae21019-9255-4f96-b461-5bd8cd0bb32f" by "_create_volume_from_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:43 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-0a94abe8-c984-40cc-8d3f-50f60efc2afa tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-c6432d5e-a81f-45d4-8c3d-45b4e4fc2ae4-2ae21019-9255-4f96-b461-5bd8cd0bb32f" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:43 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-0a94abe8-c984-40cc-8d3f-50f60efc2afa tempest-VolumeDependencyTests-893333359 None] Creating volume 2ae21019-9255-4f96-b461-5bd8cd0bb32f from snapshot c6432d5e-a81f-45d4-8c3d-45b4e4fc2ae4 {{(pid=88591) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 30 17:03:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0a94abe8-c984-40cc-8d3f-50f60efc2afa tempest-VolumeDependencyTests-893333359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0a94abe8-c984-40cc-8d3f-50f60efc2afa tempest-VolumeDependencyTests-893333359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:43 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-0a94abe8-c984-40cc-8d3f-50f60efc2afa tempest-VolumeDependencyTests-893333359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:03:43 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-0a94abe8-c984-40cc-8d3f-50f60efc2afa tempest-VolumeDependencyTests-893333359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:03:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0a94abe8-c984-40cc-8d3f-50f60efc2afa tempest-VolumeDependencyTests-893333359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:43 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-0a94abe8-c984-40cc-8d3f-50f60efc2afa tempest-VolumeDependencyTests-893333359 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:03:43 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-0a94abe8-c984-40cc-8d3f-50f60efc2afa tempest-VolumeDependencyTests-893333359 None] Acquiring lock "cinder-quobyte-2ae21019-9255-4f96-b461-5bd8cd0bb32f" by "_copy_volume_from_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:43 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-0a94abe8-c984-40cc-8d3f-50f60efc2afa tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-2ae21019-9255-4f96-b461-5bd8cd0bb32f" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:43 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-0a94abe8-c984-40cc-8d3f-50f60efc2afa tempest-VolumeDependencyTests-893333359 None] snapshot: c6432d5e-a81f-45d4-8c3d-45b4e4fc2ae4, volume: 2ae21019-9255-4f96-b461-5bd8cd0bb32f, {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 17:03:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0a94abe8-c984-40cc-8d3f-50f60efc2afa tempest-VolumeDependencyTests-893333359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0a94abe8-c984-40cc-8d3f-50f60efc2afa tempest-VolumeDependencyTests-893333359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:43 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-0a94abe8-c984-40cc-8d3f-50f60efc2afa tempest-VolumeDependencyTests-893333359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:03:43 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-0a94abe8-c984-40cc-8d3f-50f60efc2afa tempest-VolumeDependencyTests-893333359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:03:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0a94abe8-c984-40cc-8d3f-50f60efc2afa tempest-VolumeDependencyTests-893333359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:43 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a23145c-c444-46db-8856-604bc7a11364]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:03:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0a94abe8-c984-40cc-8d3f-50f60efc2afa tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e68687d0-ddf5-4910-bb70-5ca79cc59433.c6432d5e-a81f-45d4-8c3d-45b4e4fc2ae4 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:43 devstack sudo[103326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e68687d0-ddf5-4910-bb70-5ca79cc59433.c6432d5e-a81f-45d4-8c3d-45b4e4fc2ae4 Jul 30 17:03:43 devstack sudo[103326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:44 devstack sudo[103326]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0a94abe8-c984-40cc-8d3f-50f60efc2afa tempest-VolumeDependencyTests-893333359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e68687d0-ddf5-4910-bb70-5ca79cc59433.c6432d5e-a81f-45d4-8c3d-45b4e4fc2ae4" returned: 0 in 0.430s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:44 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-0a94abe8-c984-40cc-8d3f-50f60efc2afa tempest-VolumeDependencyTests-893333359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e68687d0-ddf5-4910-bb70-5ca79cc59433(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:03:44 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[791dbf05-236f-4672-90cc-410097b2aaee]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:03:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0a94abe8-c984-40cc-8d3f-50f60efc2afa tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e68687d0-ddf5-4910-bb70-5ca79cc59433 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:44 devstack sudo[103331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e68687d0-ddf5-4910-bb70-5ca79cc59433 Jul 30 17:03:44 devstack sudo[103331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:44 devstack sudo[103331]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0a94abe8-c984-40cc-8d3f-50f60efc2afa tempest-VolumeDependencyTests-893333359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e68687d0-ddf5-4910-bb70-5ca79cc59433" returned: 0 in 0.411s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:44 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-0a94abe8-c984-40cc-8d3f-50f60efc2afa tempest-VolumeDependencyTests-893333359 None] will copy from snapshot at /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e68687d0-ddf5-4910-bb70-5ca79cc59433 {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 17:03:44 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-0a94abe8-c984-40cc-8d3f-50f60efc2afa tempest-VolumeDependencyTests-893333359 None] Creating direct copy from snapshot {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 17:03:44 devstack cinder-volume[88591]: DEBUG cinder.utils [None req-0a94abe8-c984-40cc-8d3f-50f60efc2afa tempest-VolumeDependencyTests-893333359 None] Path /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2ae21019-9255-4f96-b461-5bd8cd0bb32f not found in is_blk_device check {{(pid=88591) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 17:03:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0a94abe8-c984-40cc-8d3f-50f60efc2afa tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e68687d0-ddf5-4910-bb70-5ca79cc59433 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2ae21019-9255-4f96-b461-5bd8cd0bb32f {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:44 devstack sudo[103336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e68687d0-ddf5-4910-bb70-5ca79cc59433 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2ae21019-9255-4f96-b461-5bd8cd0bb32f Jul 30 17:03:44 devstack sudo[103336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:45 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ecb6f102-bf90-45fd-bd55-4dd1d5a9c748 tempest-VolumesListTestJSON-915604785 None] Acquiring lock "cinder-474cf7fe-b56c-4528-8384-c88147bf368f-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:45 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ecb6f102-bf90-45fd-bd55-4dd1d5a9c748 tempest-VolumesListTestJSON-915604785 None] Lock "cinder-474cf7fe-b56c-4528-8384-c88147bf368f-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:45 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ecb6f102-bf90-45fd-bd55-4dd1d5a9c748 tempest-VolumesListTestJSON-915604785 None] Acquiring lock "cinder-quobyte-474cf7fe-b56c-4528-8384-c88147bf368f" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:45 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ecb6f102-bf90-45fd-bd55-4dd1d5a9c748 tempest-VolumesListTestJSON-915604785 None] Lock "cinder-quobyte-474cf7fe-b56c-4528-8384-c88147bf368f" acquired by "delete_volume" :: waited 0.055s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:46 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d91a55-ed54-4725-8bb3-2e1fe25305ea]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:03:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ecb6f102-bf90-45fd-bd55-4dd1d5a9c748 tempest-VolumesListTestJSON-915604785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-474cf7fe-b56c-4528-8384-c88147bf368f {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:46 devstack sudo[103348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-474cf7fe-b56c-4528-8384-c88147bf368f Jul 30 17:03:46 devstack sudo[103348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:47 devstack sudo[103348]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ecb6f102-bf90-45fd-bd55-4dd1d5a9c748 tempest-VolumesListTestJSON-915604785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-474cf7fe-b56c-4528-8384-c88147bf368f" returned: 0 in 1.115s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ecb6f102-bf90-45fd-bd55-4dd1d5a9c748 tempest-VolumesListTestJSON-915604785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-474cf7fe-b56c-4528-8384-c88147bf368f {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:47 devstack sudo[103355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-474cf7fe-b56c-4528-8384-c88147bf368f Jul 30 17:03:47 devstack sudo[103355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:47 devstack sudo[103355]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ecb6f102-bf90-45fd-bd55-4dd1d5a9c748 tempest-VolumesListTestJSON-915604785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-474cf7fe-b56c-4528-8384-c88147bf368f" returned: 0 in 0.659s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:47 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ecb6f102-bf90-45fd-bd55-4dd1d5a9c748 tempest-VolumesListTestJSON-915604785 None] Lock "cinder-quobyte-474cf7fe-b56c-4528-8384-c88147bf368f" released by "delete_volume" :: held 1.896s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:48 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-ecb6f102-bf90-45fd-bd55-4dd1d5a9c748 tempest-VolumesListTestJSON-915604785 None] Created reservations ['04ecb7e2-3a2c-40ec-9aff-f828e7a93084', '1e915401-3f90-414a-bfa1-b6ae18df4276', '5d7f6d57-051b-4ed6-9f72-560a9845474b', 'bff09545-4647-4cd0-bdd9-9d266bb6f1c3'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:03:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ecb6f102-bf90-45fd-bd55-4dd1d5a9c748 tempest-VolumesListTestJSON-915604785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ecb6f102-bf90-45fd-bd55-4dd1d5a9c748 tempest-VolumesListTestJSON-915604785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:48 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ecb6f102-bf90-45fd-bd55-4dd1d5a9c748 tempest-VolumesListTestJSON-915604785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:03:48 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ecb6f102-bf90-45fd-bd55-4dd1d5a9c748 tempest-VolumesListTestJSON-915604785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:03:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ecb6f102-bf90-45fd-bd55-4dd1d5a9c748 tempest-VolumesListTestJSON-915604785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ecb6f102-bf90-45fd-bd55-4dd1d5a9c748 tempest-VolumesListTestJSON-915604785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:48 devstack sudo[103372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:03:48 devstack sudo[103372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:48 devstack sudo[103372]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ecb6f102-bf90-45fd-bd55-4dd1d5a9c748 tempest-VolumesListTestJSON-915604785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.431s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:48 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-ecb6f102-bf90-45fd-bd55-4dd1d5a9c748 tempest-VolumesListTestJSON-915604785 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:03:48 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-ecb6f102-bf90-45fd-bd55-4dd1d5a9c748 tempest-VolumesListTestJSON-915604785 None] Deleted volume successfully. Jul 30 17:03:48 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ecb6f102-bf90-45fd-bd55-4dd1d5a9c748 tempest-VolumesListTestJSON-915604785 None] Lock "cinder-474cf7fe-b56c-4528-8384-c88147bf368f-delete_volume" released by "delete_volume" :: held 2.935s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:48 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d4b940c9-2d09-41a1-b95b-e19e3efdf75d tempest-VolumesListTestJSON-915604785 None] Acquiring lock "cinder-09461cd2-4a55-45e2-8359-16ec9f3b3560-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:48 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d4b940c9-2d09-41a1-b95b-e19e3efdf75d tempest-VolumesListTestJSON-915604785 None] Lock "cinder-09461cd2-4a55-45e2-8359-16ec9f3b3560-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:48 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d4b940c9-2d09-41a1-b95b-e19e3efdf75d tempest-VolumesListTestJSON-915604785 None] Acquiring lock "cinder-quobyte-09461cd2-4a55-45e2-8359-16ec9f3b3560" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:49 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d4b940c9-2d09-41a1-b95b-e19e3efdf75d tempest-VolumesListTestJSON-915604785 None] Lock "cinder-quobyte-09461cd2-4a55-45e2-8359-16ec9f3b3560" acquired by "delete_volume" :: waited 0.036s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:49 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11eed0a-f229-485c-b5f7-e4ae98511928]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:03:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d4b940c9-2d09-41a1-b95b-e19e3efdf75d tempest-VolumesListTestJSON-915604785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-09461cd2-4a55-45e2-8359-16ec9f3b3560 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:49 devstack sudo[103395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-09461cd2-4a55-45e2-8359-16ec9f3b3560 Jul 30 17:03:49 devstack sudo[103395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:49 devstack sudo[103395]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d4b940c9-2d09-41a1-b95b-e19e3efdf75d tempest-VolumesListTestJSON-915604785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-09461cd2-4a55-45e2-8359-16ec9f3b3560" returned: 0 in 0.819s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d4b940c9-2d09-41a1-b95b-e19e3efdf75d tempest-VolumesListTestJSON-915604785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-09461cd2-4a55-45e2-8359-16ec9f3b3560 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:50 devstack sudo[103402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-09461cd2-4a55-45e2-8359-16ec9f3b3560 Jul 30 17:03:50 devstack sudo[103402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:50 devstack sudo[103402]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d4b940c9-2d09-41a1-b95b-e19e3efdf75d tempest-VolumesListTestJSON-915604785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-09461cd2-4a55-45e2-8359-16ec9f3b3560" returned: 0 in 0.588s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:50 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d4b940c9-2d09-41a1-b95b-e19e3efdf75d tempest-VolumesListTestJSON-915604785 None] Lock "cinder-quobyte-09461cd2-4a55-45e2-8359-16ec9f3b3560" released by "delete_volume" :: held 1.611s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:50 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-d4b940c9-2d09-41a1-b95b-e19e3efdf75d tempest-VolumesListTestJSON-915604785 None] Created reservations ['c930614c-25b4-4742-8983-e1f31f52e1be', 'c2a10671-ac5c-42c5-acc8-5b6eae61cb71', '12997b36-144c-49c1-b97a-b9542117e763', 'fbbc70e0-4293-4523-8ab2-b7bb8f8180c0'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:03:50 devstack sudo[103336]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0a94abe8-c984-40cc-8d3f-50f60efc2afa tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e68687d0-ddf5-4910-bb70-5ca79cc59433 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2ae21019-9255-4f96-b461-5bd8cd0bb32f" returned: 0 in 6.153s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:50 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-0a94abe8-c984-40cc-8d3f-50f60efc2afa tempest-VolumeDependencyTests-893333359 None] Image conversion details: src /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e68687d0-ddf5-4910-bb70-5ca79cc59433, size 1024.00 MB, duration 6.15 sec, destination /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2ae21019-9255-4f96-b461-5bd8cd0bb32f {{(pid=88591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 17:03:50 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-0a94abe8-c984-40cc-8d3f-50f60efc2afa tempest-VolumeDependencyTests-893333359 None] Converted 1024.00 MB image at 166.37 MB/s Jul 30 17:03:50 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-0a94abe8-c984-40cc-8d3f-50f60efc2afa tempest-VolumeDependencyTests-893333359 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2ae21019-9255-4f96-b461-5bd8cd0bb32f is being set with open permissions: ugo+rw Jul 30 17:03:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0a94abe8-c984-40cc-8d3f-50f60efc2afa tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2ae21019-9255-4f96-b461-5bd8cd0bb32f {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:50 devstack sudo[103411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2ae21019-9255-4f96-b461-5bd8cd0bb32f Jul 30 17:03:50 devstack sudo[103411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d4b940c9-2d09-41a1-b95b-e19e3efdf75d tempest-VolumesListTestJSON-915604785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d4b940c9-2d09-41a1-b95b-e19e3efdf75d tempest-VolumesListTestJSON-915604785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:50 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d4b940c9-2d09-41a1-b95b-e19e3efdf75d tempest-VolumesListTestJSON-915604785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:03:50 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d4b940c9-2d09-41a1-b95b-e19e3efdf75d tempest-VolumesListTestJSON-915604785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:03:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d4b940c9-2d09-41a1-b95b-e19e3efdf75d tempest-VolumesListTestJSON-915604785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d4b940c9-2d09-41a1-b95b-e19e3efdf75d tempest-VolumesListTestJSON-915604785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:50 devstack sudo[103413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:03:50 devstack sudo[103413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:51 devstack sudo[103411]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0a94abe8-c984-40cc-8d3f-50f60efc2afa tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2ae21019-9255-4f96-b461-5bd8cd0bb32f" returned: 0 in 0.298s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:51 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-0a94abe8-c984-40cc-8d3f-50f60efc2afa tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-2ae21019-9255-4f96-b461-5bd8cd0bb32f" released by "_copy_volume_from_snapshot" :: held 7.407s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:51 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-0a94abe8-c984-40cc-8d3f-50f60efc2afa tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-c6432d5e-a81f-45d4-8c3d-45b4e4fc2ae4-2ae21019-9255-4f96-b461-5bd8cd0bb32f" released by "_create_volume_from_snapshot" :: held 7.512s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:51 devstack sudo[103413]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0a94abe8-c984-40cc-8d3f-50f60efc2afa tempest-VolumeDependencyTests-893333359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.537s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d4b940c9-2d09-41a1-b95b-e19e3efdf75d tempest-VolumesListTestJSON-915604785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.330s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:51 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-d4b940c9-2d09-41a1-b95b-e19e3efdf75d tempest-VolumesListTestJSON-915604785 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:03:51 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-d4b940c9-2d09-41a1-b95b-e19e3efdf75d tempest-VolumesListTestJSON-915604785 None] Deleted volume successfully. Jul 30 17:03:51 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0a94abe8-c984-40cc-8d3f-50f60efc2afa tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5fdfad5-9bdb-444d-b8a0-26633741813f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ae21019-9255-4f96-b461-5bd8cd0bb32f', 'volume_size': 1, 'snapshot_id': 'c6432d5e-a81f-45d4-8c3d-45b4e4fc2ae4'}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:51 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0a94abe8-c984-40cc-8d3f-50f60efc2afa tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4ffa5f7-865d-433b-b899-966df8b43673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:51 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d4b940c9-2d09-41a1-b95b-e19e3efdf75d tempest-VolumesListTestJSON-915604785 None] Lock "cinder-09461cd2-4a55-45e2-8359-16ec9f3b3560-delete_volume" released by "delete_volume" :: held 2.420s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:51 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-0a94abe8-c984-40cc-8d3f-50f60efc2afa tempest-VolumeDependencyTests-893333359 None] Volume volume-2ae21019-9255-4f96-b461-5bd8cd0bb32f (2ae21019-9255-4f96-b461-5bd8cd0bb32f): created successfully Jul 30 17:03:51 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0a94abe8-c984-40cc-8d3f-50f60efc2afa tempest-VolumeDependencyTests-893333359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4ffa5f7-865d-433b-b899-966df8b43673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:51 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0a94abe8-c984-40cc-8d3f-50f60efc2afa tempest-VolumeDependencyTests-893333359 None] Flow 'volume_create_manager' (04cdf68b-13da-4cf2-96b3-ed4de43a2492) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:03:51 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-0a94abe8-c984-40cc-8d3f-50f60efc2afa tempest-VolumeDependencyTests-893333359 None] Created volume successfully. Jul 30 17:03:51 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-efbe37a1-32e4-42ba-857b-7b2773320bd1 tempest-VolumesListTestJSON-915604785 None] Acquiring lock "cinder-71dabcfe-33fd-4c8e-a4f0-24daa71d76c5-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:51 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-efbe37a1-32e4-42ba-857b-7b2773320bd1 tempest-VolumesListTestJSON-915604785 None] Lock "cinder-71dabcfe-33fd-4c8e-a4f0-24daa71d76c5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:51 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-efbe37a1-32e4-42ba-857b-7b2773320bd1 tempest-VolumesListTestJSON-915604785 None] Acquiring lock "cinder-quobyte-71dabcfe-33fd-4c8e-a4f0-24daa71d76c5" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:51 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-efbe37a1-32e4-42ba-857b-7b2773320bd1 tempest-VolumesListTestJSON-915604785 None] Lock "cinder-quobyte-71dabcfe-33fd-4c8e-a4f0-24daa71d76c5" acquired by "delete_volume" :: waited 0.018s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:51 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd5abf4-bc6e-4dc3-b1bd-caf6f1958fa6]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:03:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-efbe37a1-32e4-42ba-857b-7b2773320bd1 tempest-VolumesListTestJSON-915604785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71dabcfe-33fd-4c8e-a4f0-24daa71d76c5 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:51 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-847b17e4-ac68-4d09-8c63-5679cc1f0c3f tempest-VolumeDependencyTests-893333359 None] Acquiring lock "cinder-c6432d5e-a81f-45d4-8c3d-45b4e4fc2ae4-delete_snapshot" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:51 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-847b17e4-ac68-4d09-8c63-5679cc1f0c3f tempest-VolumeDependencyTests-893333359 None] Lock "cinder-c6432d5e-a81f-45d4-8c3d-45b4e4fc2ae4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:51 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-847b17e4-ac68-4d09-8c63-5679cc1f0c3f tempest-VolumeDependencyTests-893333359 None] Acquiring lock "cinder-quobyte-e68687d0-ddf5-4910-bb70-5ca79cc59433" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:51 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-847b17e4-ac68-4d09-8c63-5679cc1f0c3f tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-e68687d0-ddf5-4910-bb70-5ca79cc59433" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:51 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-847b17e4-ac68-4d09-8c63-5679cc1f0c3f tempest-VolumeDependencyTests-893333359 None] Acquiring lock "cinder-quobyte-c6432d5e-a81f-45d4-8c3d-45b4e4fc2ae4" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:51 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-847b17e4-ac68-4d09-8c63-5679cc1f0c3f tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-c6432d5e-a81f-45d4-8c3d-45b4e4fc2ae4" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:51 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-847b17e4-ac68-4d09-8c63-5679cc1f0c3f tempest-VolumeDependencyTests-893333359 None] Deleting offline snapshot c6432d5e-a81f-45d4-8c3d-45b4e4fc2ae4 of volume e68687d0-ddf5-4910-bb70-5ca79cc59433 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:03:51 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-847b17e4-ac68-4d09-8c63-5679cc1f0c3f tempest-VolumeDependencyTests-893333359 None] snapshot_file for this snap is: volume-e68687d0-ddf5-4910-bb70-5ca79cc59433.c6432d5e-a81f-45d4-8c3d-45b4e4fc2ae4 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:03:51 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9350c65-5c62-4d35-85d4-b541c8c90808]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:03:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-847b17e4-ac68-4d09-8c63-5679cc1f0c3f tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e68687d0-ddf5-4910-bb70-5ca79cc59433.c6432d5e-a81f-45d4-8c3d-45b4e4fc2ae4 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:51 devstack sudo[103417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71dabcfe-33fd-4c8e-a4f0-24daa71d76c5 Jul 30 17:03:51 devstack sudo[103417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:51 devstack sudo[103419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e68687d0-ddf5-4910-bb70-5ca79cc59433.c6432d5e-a81f-45d4-8c3d-45b4e4fc2ae4 Jul 30 17:03:51 devstack sudo[103419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:52 devstack sudo[103417]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-efbe37a1-32e4-42ba-857b-7b2773320bd1 tempest-VolumesListTestJSON-915604785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71dabcfe-33fd-4c8e-a4f0-24daa71d76c5" returned: 0 in 0.486s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-efbe37a1-32e4-42ba-857b-7b2773320bd1 tempest-VolumesListTestJSON-915604785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71dabcfe-33fd-4c8e-a4f0-24daa71d76c5 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:52 devstack sudo[103425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71dabcfe-33fd-4c8e-a4f0-24daa71d76c5 Jul 30 17:03:52 devstack sudo[103425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:52 devstack sudo[103419]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-847b17e4-ac68-4d09-8c63-5679cc1f0c3f tempest-VolumeDependencyTests-893333359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e68687d0-ddf5-4910-bb70-5ca79cc59433.c6432d5e-a81f-45d4-8c3d-45b4e4fc2ae4" returned: 0 in 0.422s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:52 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-847b17e4-ac68-4d09-8c63-5679cc1f0c3f tempest-VolumeDependencyTests-893333359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e68687d0-ddf5-4910-bb70-5ca79cc59433(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:03:52 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cfa5fdc-51b9-4a5a-8a5d-c7ac4a2b3f3f]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:03:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-847b17e4-ac68-4d09-8c63-5679cc1f0c3f tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e68687d0-ddf5-4910-bb70-5ca79cc59433 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:52 devstack sudo[103425]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-efbe37a1-32e4-42ba-857b-7b2773320bd1 tempest-VolumesListTestJSON-915604785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71dabcfe-33fd-4c8e-a4f0-24daa71d76c5" returned: 0 in 0.279s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:52 devstack sudo[103430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e68687d0-ddf5-4910-bb70-5ca79cc59433 Jul 30 17:03:52 devstack sudo[103430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:52 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-efbe37a1-32e4-42ba-857b-7b2773320bd1 tempest-VolumesListTestJSON-915604785 None] Lock "cinder-quobyte-71dabcfe-33fd-4c8e-a4f0-24daa71d76c5" released by "delete_volume" :: held 0.821s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:52 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-efbe37a1-32e4-42ba-857b-7b2773320bd1 tempest-VolumesListTestJSON-915604785 None] Created reservations ['16ed49b3-402a-451c-a0fa-364a027dcfba', '309a7ba2-170e-4c52-812c-969baa5e609d', '855f3143-a448-4f77-899b-08db16829a2f', 'f072174b-8d2b-4a9f-8355-dba3743f6d66'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:03:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-efbe37a1-32e4-42ba-857b-7b2773320bd1 tempest-VolumesListTestJSON-915604785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-efbe37a1-32e4-42ba-857b-7b2773320bd1 tempest-VolumesListTestJSON-915604785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:52 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-efbe37a1-32e4-42ba-857b-7b2773320bd1 tempest-VolumesListTestJSON-915604785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:03:52 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-efbe37a1-32e4-42ba-857b-7b2773320bd1 tempest-VolumesListTestJSON-915604785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:03:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-efbe37a1-32e4-42ba-857b-7b2773320bd1 tempest-VolumesListTestJSON-915604785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-efbe37a1-32e4-42ba-857b-7b2773320bd1 tempest-VolumesListTestJSON-915604785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:52 devstack sudo[103433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:03:52 devstack sudo[103433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:52 devstack sudo[103433]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-efbe37a1-32e4-42ba-857b-7b2773320bd1 tempest-VolumesListTestJSON-915604785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.349s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:52 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-efbe37a1-32e4-42ba-857b-7b2773320bd1 tempest-VolumesListTestJSON-915604785 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:03:52 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-efbe37a1-32e4-42ba-857b-7b2773320bd1 tempest-VolumesListTestJSON-915604785 None] Deleted volume successfully. Jul 30 17:03:52 devstack sudo[103430]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-847b17e4-ac68-4d09-8c63-5679cc1f0c3f tempest-VolumeDependencyTests-893333359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e68687d0-ddf5-4910-bb70-5ca79cc59433" returned: 0 in 0.687s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-847b17e4-ac68-4d09-8c63-5679cc1f0c3f tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e68687d0-ddf5-4910-bb70-5ca79cc59433.c6432d5e-a81f-45d4-8c3d-45b4e4fc2ae4 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:52 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-efbe37a1-32e4-42ba-857b-7b2773320bd1 tempest-VolumesListTestJSON-915604785 None] Lock "cinder-71dabcfe-33fd-4c8e-a4f0-24daa71d76c5-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:52 devstack sudo[103440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e68687d0-ddf5-4910-bb70-5ca79cc59433.c6432d5e-a81f-45d4-8c3d-45b4e4fc2ae4 Jul 30 17:03:52 devstack sudo[103440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:53 devstack sudo[103440]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-847b17e4-ac68-4d09-8c63-5679cc1f0c3f tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e68687d0-ddf5-4910-bb70-5ca79cc59433.c6432d5e-a81f-45d4-8c3d-45b4e4fc2ae4" returned: 0 in 0.447s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-847b17e4-ac68-4d09-8c63-5679cc1f0c3f tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e68687d0-ddf5-4910-bb70-5ca79cc59433.c6432d5e-a81f-45d4-8c3d-45b4e4fc2ae4 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:53 devstack sudo[103446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e68687d0-ddf5-4910-bb70-5ca79cc59433.c6432d5e-a81f-45d4-8c3d-45b4e4fc2ae4 Jul 30 17:03:53 devstack sudo[103446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:53 devstack sudo[103446]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-847b17e4-ac68-4d09-8c63-5679cc1f0c3f tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e68687d0-ddf5-4910-bb70-5ca79cc59433.c6432d5e-a81f-45d4-8c3d-45b4e4fc2ae4" returned: 0 in 0.321s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:53 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-847b17e4-ac68-4d09-8c63-5679cc1f0c3f tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-c6432d5e-a81f-45d4-8c3d-45b4e4fc2ae4" released by "_delete_snapshot" :: held 2.013s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:53 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-847b17e4-ac68-4d09-8c63-5679cc1f0c3f tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-e68687d0-ddf5-4910-bb70-5ca79cc59433" released by "delete_snapshot" :: held 2.043s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:53 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-847b17e4-ac68-4d09-8c63-5679cc1f0c3f tempest-VolumeDependencyTests-893333359 None] Created reservations ['bca2dfaa-515d-44a8-bbdc-cbcea66f1267', '89117c2f-5e63-4bc1-94d0-c15474966fff', 'a5a8872a-5d29-4853-bf80-9c9e4c6d356c', '0ba1a0aa-2cc4-4d1a-b8a9-a78656d753f4'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:03:53 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-847b17e4-ac68-4d09-8c63-5679cc1f0c3f tempest-VolumeDependencyTests-893333359 None] Delete snapshot completed successfully. Jul 30 17:03:53 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-847b17e4-ac68-4d09-8c63-5679cc1f0c3f tempest-VolumeDependencyTests-893333359 None] Lock "cinder-c6432d5e-a81f-45d4-8c3d-45b4e4fc2ae4-delete_snapshot" released by "delete_snapshot" :: held 2.202s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:54 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-0774b17e-66d5-4c56-9b27-22103a87eebb tempest-VolumeDependencyTests-893333359 None] Acquiring lock "cinder-e68687d0-ddf5-4910-bb70-5ca79cc59433-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:55 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-0774b17e-66d5-4c56-9b27-22103a87eebb tempest-VolumeDependencyTests-893333359 None] Lock "cinder-e68687d0-ddf5-4910-bb70-5ca79cc59433-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:55 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-68c5fd54-221d-45ec-a34a-f4dc4ecdbbd1 tempest-TestStampPattern-175323318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:03:55 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-68c5fd54-221d-45ec-a34a-f4dc4ecdbbd1 tempest-TestStampPattern-175323318 None] Flow 'volume_create_manager' (7a803580-1e7f-4062-9ebf-2d6ac2416bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:03:55 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-68c5fd54-221d-45ec-a34a-f4dc4ecdbbd1 tempest-TestStampPattern-175323318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b5b8037-a298-4c98-9042-8f73f0f0b920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:55 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-0774b17e-66d5-4c56-9b27-22103a87eebb tempest-VolumeDependencyTests-893333359 None] Acquiring lock "cinder-quobyte-e68687d0-ddf5-4910-bb70-5ca79cc59433" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:55 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-68c5fd54-221d-45ec-a34a-f4dc4ecdbbd1 tempest-TestStampPattern-175323318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b5b8037-a298-4c98-9042-8f73f0f0b920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1781590503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9990c0c7-e431-40eb-955e-4855b5808fbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c94e08bf91ca4423a295c1e871454261',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:03:55Z,use_quota=True,user_id='4e516471898e4322a0a745d8404b621c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:55 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-68c5fd54-221d-45ec-a34a-f4dc4ecdbbd1 tempest-TestStampPattern-175323318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a952ea0c-bae4-4450-b590-21ea948924c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:55 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-68c5fd54-221d-45ec-a34a-f4dc4ecdbbd1 tempest-TestStampPattern-175323318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a952ea0c-bae4-4450-b590-21ea948924c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:55 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-68c5fd54-221d-45ec-a34a-f4dc4ecdbbd1 tempest-TestStampPattern-175323318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ade6fa8-a761-4691-ae18-13a012a671e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:55 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-68c5fd54-221d-45ec-a34a-f4dc4ecdbbd1 tempest-TestStampPattern-175323318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ade6fa8-a761-4691-ae18-13a012a671e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9990c0c7-e431-40eb-955e-4855b5808fbe', 'volume_name': 'volume-9990c0c7-e431-40eb-955e-4855b5808fbe', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:55 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-68c5fd54-221d-45ec-a34a-f4dc4ecdbbd1 tempest-TestStampPattern-175323318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (018983d6-ecce-4981-b64a-34193730fe04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:55 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-68c5fd54-221d-45ec-a34a-f4dc4ecdbbd1 tempest-TestStampPattern-175323318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (018983d6-ecce-4981-b64a-34193730fe04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:55 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-68c5fd54-221d-45ec-a34a-f4dc4ecdbbd1 tempest-TestStampPattern-175323318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66063106-3241-464f-b570-ae82f1949c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:55 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-68c5fd54-221d-45ec-a34a-f4dc4ecdbbd1 tempest-TestStampPattern-175323318 None] Volume 9990c0c7-e431-40eb-955e-4855b5808fbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9990c0c7-e431-40eb-955e-4855b5808fbe', 'volume_size': 1} Jul 30 17:03:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-68c5fd54-221d-45ec-a34a-f4dc4ecdbbd1 tempest-TestStampPattern-175323318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-68c5fd54-221d-45ec-a34a-f4dc4ecdbbd1 tempest-TestStampPattern-175323318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:55 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-68c5fd54-221d-45ec-a34a-f4dc4ecdbbd1 tempest-TestStampPattern-175323318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1781590503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9990c0c7-e431-40eb-955e-4855b5808fbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c94e08bf91ca4423a295c1e871454261',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:03:55Z,use_quota=True,user_id='4e516471898e4322a0a745d8404b621c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:03:55 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-68c5fd54-221d-45ec-a34a-f4dc4ecdbbd1 tempest-TestStampPattern-175323318 None] Creating volume 9990c0c7-e431-40eb-955e-4855b5808fbe {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:03:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-68c5fd54-221d-45ec-a34a-f4dc4ecdbbd1 tempest-TestStampPattern-175323318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-68c5fd54-221d-45ec-a34a-f4dc4ecdbbd1 tempest-TestStampPattern-175323318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:55 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-68c5fd54-221d-45ec-a34a-f4dc4ecdbbd1 tempest-TestStampPattern-175323318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:03:55 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-68c5fd54-221d-45ec-a34a-f4dc4ecdbbd1 tempest-TestStampPattern-175323318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:03:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-68c5fd54-221d-45ec-a34a-f4dc4ecdbbd1 tempest-TestStampPattern-175323318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:55 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-68c5fd54-221d-45ec-a34a-f4dc4ecdbbd1 tempest-TestStampPattern-175323318 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:03:55 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-68c5fd54-221d-45ec-a34a-f4dc4ecdbbd1 tempest-TestStampPattern-175323318 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:03:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-68c5fd54-221d-45ec-a34a-f4dc4ecdbbd1 tempest-TestStampPattern-175323318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9990c0c7-e431-40eb-955e-4855b5808fbe 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:55 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-0774b17e-66d5-4c56-9b27-22103a87eebb tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-e68687d0-ddf5-4910-bb70-5ca79cc59433" acquired by "delete_volume" :: waited 0.099s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:55 devstack sudo[103450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9990c0c7-e431-40eb-955e-4855b5808fbe 1073741824 Jul 30 17:03:55 devstack sudo[103450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:55 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b26067-db2d-409a-8138-f7962a099df1]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:03:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0774b17e-66d5-4c56-9b27-22103a87eebb tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e68687d0-ddf5-4910-bb70-5ca79cc59433 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:55 devstack sudo[103452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e68687d0-ddf5-4910-bb70-5ca79cc59433 Jul 30 17:03:55 devstack sudo[103452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:55 devstack sudo[103452]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0774b17e-66d5-4c56-9b27-22103a87eebb tempest-VolumeDependencyTests-893333359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e68687d0-ddf5-4910-bb70-5ca79cc59433" returned: 0 in 0.450s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0774b17e-66d5-4c56-9b27-22103a87eebb tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e68687d0-ddf5-4910-bb70-5ca79cc59433 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:55 devstack sudo[103450]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-68c5fd54-221d-45ec-a34a-f4dc4ecdbbd1 tempest-TestStampPattern-175323318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9990c0c7-e431-40eb-955e-4855b5808fbe 1073741824" returned: 0 in 0.569s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:55 devstack sudo[103462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e68687d0-ddf5-4910-bb70-5ca79cc59433 Jul 30 17:03:55 devstack sudo[103462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-68c5fd54-221d-45ec-a34a-f4dc4ecdbbd1 tempest-TestStampPattern-175323318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9990c0c7-e431-40eb-955e-4855b5808fbe {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:55 devstack sudo[103464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9990c0c7-e431-40eb-955e-4855b5808fbe Jul 30 17:03:55 devstack sudo[103464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:56 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-eff0279c-8896-43c4-bc39-22aca257f432 tempest-VolumesNegativeTest-1863535018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:03:56 devstack sudo[103462]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:56 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-eff0279c-8896-43c4-bc39-22aca257f432 tempest-VolumesNegativeTest-1863535018 None] Flow 'volume_create_manager' (e76229b3-1a44-4c2c-b4bf-39ee9f95450c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:03:56 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-eff0279c-8896-43c4-bc39-22aca257f432 tempest-VolumesNegativeTest-1863535018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e244bb8b-c885-4cad-9086-3779d711bf47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0774b17e-66d5-4c56-9b27-22103a87eebb tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e68687d0-ddf5-4910-bb70-5ca79cc59433" returned: 0 in 0.410s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:56 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-eff0279c-8896-43c4-bc39-22aca257f432 tempest-VolumesNegativeTest-1863535018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e244bb8b-c885-4cad-9086-3779d711bf47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-673153929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc228364-d541-4737-ab13-64feb495c264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89e36c461dd2401d9079f55c816e37a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:03:56Z,use_quota=True,user_id='2527c59b078246bfaf07542dbd1bd3a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:56 devstack sudo[103464]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:56 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-eff0279c-8896-43c4-bc39-22aca257f432 tempest-VolumesNegativeTest-1863535018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2d50a9d-4ac7-4697-8d97-09f16bc9e536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:56 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-eff0279c-8896-43c4-bc39-22aca257f432 tempest-VolumesNegativeTest-1863535018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2d50a9d-4ac7-4697-8d97-09f16bc9e536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:56 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-eff0279c-8896-43c4-bc39-22aca257f432 tempest-VolumesNegativeTest-1863535018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a8a12b8-9c0a-4308-b1cb-dd7f6b9b9390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:56 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-eff0279c-8896-43c4-bc39-22aca257f432 tempest-VolumesNegativeTest-1863535018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a8a12b8-9c0a-4308-b1cb-dd7f6b9b9390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc228364-d541-4737-ab13-64feb495c264', 'volume_name': 'volume-cc228364-d541-4737-ab13-64feb495c264', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:56 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-eff0279c-8896-43c4-bc39-22aca257f432 tempest-VolumesNegativeTest-1863535018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a505011a-a1df-43e4-910a-938d35f16e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:56 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-eff0279c-8896-43c4-bc39-22aca257f432 tempest-VolumesNegativeTest-1863535018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a505011a-a1df-43e4-910a-938d35f16e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:56 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-eff0279c-8896-43c4-bc39-22aca257f432 tempest-VolumesNegativeTest-1863535018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d86aca6-4df1-4946-9a15-135871e1a8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:56 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-eff0279c-8896-43c4-bc39-22aca257f432 tempest-VolumesNegativeTest-1863535018 None] Volume cc228364-d541-4737-ab13-64feb495c264: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc228364-d541-4737-ab13-64feb495c264', 'volume_size': 1} Jul 30 17:03:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-eff0279c-8896-43c4-bc39-22aca257f432 tempest-VolumesNegativeTest-1863535018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:56 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-0774b17e-66d5-4c56-9b27-22103a87eebb tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-e68687d0-ddf5-4910-bb70-5ca79cc59433" released by "delete_volume" :: held 0.993s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-68c5fd54-221d-45ec-a34a-f4dc4ecdbbd1 tempest-TestStampPattern-175323318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9990c0c7-e431-40eb-955e-4855b5808fbe" returned: 0 in 0.405s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:56 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-68c5fd54-221d-45ec-a34a-f4dc4ecdbbd1 tempest-TestStampPattern-175323318 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:03:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-68c5fd54-221d-45ec-a34a-f4dc4ecdbbd1 tempest-TestStampPattern-175323318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-eff0279c-8896-43c4-bc39-22aca257f432 tempest-VolumesNegativeTest-1863535018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:56 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-eff0279c-8896-43c4-bc39-22aca257f432 tempest-VolumesNegativeTest-1863535018 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-673153929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc228364-d541-4737-ab13-64feb495c264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89e36c461dd2401d9079f55c816e37a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:03:56Z,use_quota=True,user_id='2527c59b078246bfaf07542dbd1bd3a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:03:56 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-eff0279c-8896-43c4-bc39-22aca257f432 tempest-VolumesNegativeTest-1863535018 None] Creating volume cc228364-d541-4737-ab13-64feb495c264 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:03:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-eff0279c-8896-43c4-bc39-22aca257f432 tempest-VolumesNegativeTest-1863535018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-eff0279c-8896-43c4-bc39-22aca257f432 tempest-VolumesNegativeTest-1863535018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:56 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-eff0279c-8896-43c4-bc39-22aca257f432 tempest-VolumesNegativeTest-1863535018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:03:56 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-eff0279c-8896-43c4-bc39-22aca257f432 tempest-VolumesNegativeTest-1863535018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:03:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-eff0279c-8896-43c4-bc39-22aca257f432 tempest-VolumesNegativeTest-1863535018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:56 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-eff0279c-8896-43c4-bc39-22aca257f432 tempest-VolumesNegativeTest-1863535018 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:03:56 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-eff0279c-8896-43c4-bc39-22aca257f432 tempest-VolumesNegativeTest-1863535018 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:03:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-eff0279c-8896-43c4-bc39-22aca257f432 tempest-VolumesNegativeTest-1863535018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-cc228364-d541-4737-ab13-64feb495c264 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:56 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-68c5fd54-221d-45ec-a34a-f4dc4ecdbbd1 tempest-TestStampPattern-175323318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66063106-3241-464f-b570-ae82f1949c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9990c0c7-e431-40eb-955e-4855b5808fbe', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:56 devstack sudo[103468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-cc228364-d541-4737-ab13-64feb495c264 1073741824 Jul 30 17:03:56 devstack sudo[103468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:56 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-68c5fd54-221d-45ec-a34a-f4dc4ecdbbd1 tempest-TestStampPattern-175323318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b98602ca-0945-488b-a7ce-00a640189cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:56 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-68c5fd54-221d-45ec-a34a-f4dc4ecdbbd1 tempest-TestStampPattern-175323318 None] Volume volume-9990c0c7-e431-40eb-955e-4855b5808fbe (9990c0c7-e431-40eb-955e-4855b5808fbe): created successfully Jul 30 17:03:56 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-68c5fd54-221d-45ec-a34a-f4dc4ecdbbd1 tempest-TestStampPattern-175323318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b98602ca-0945-488b-a7ce-00a640189cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:56 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-68c5fd54-221d-45ec-a34a-f4dc4ecdbbd1 tempest-TestStampPattern-175323318 None] Flow 'volume_create_manager' (7a803580-1e7f-4062-9ebf-2d6ac2416bca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:03:56 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-68c5fd54-221d-45ec-a34a-f4dc4ecdbbd1 tempest-TestStampPattern-175323318 None] Created volume successfully. Jul 30 17:03:56 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-0774b17e-66d5-4c56-9b27-22103a87eebb tempest-VolumeDependencyTests-893333359 None] Created reservations ['d1242b79-4698-4027-b4cf-4917c473f58c', '29d83acc-b67b-4191-b65e-211a293e26d1', 'c4208831-b8b0-4ed2-8537-f4bbddd7a4f8', '219a9136-9a92-42c4-8f15-9fb83f6959aa'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:03:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0774b17e-66d5-4c56-9b27-22103a87eebb tempest-VolumeDependencyTests-893333359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0774b17e-66d5-4c56-9b27-22103a87eebb tempest-VolumeDependencyTests-893333359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:56 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-0774b17e-66d5-4c56-9b27-22103a87eebb tempest-VolumeDependencyTests-893333359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:03:56 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-0774b17e-66d5-4c56-9b27-22103a87eebb tempest-VolumeDependencyTests-893333359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:03:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0774b17e-66d5-4c56-9b27-22103a87eebb tempest-VolumeDependencyTests-893333359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0774b17e-66d5-4c56-9b27-22103a87eebb tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:56 devstack sudo[103470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:03:56 devstack sudo[103470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:56 devstack sudo[103470]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:56 devstack sudo[103468]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-eff0279c-8896-43c4-bc39-22aca257f432 tempest-VolumesNegativeTest-1863535018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-cc228364-d541-4737-ab13-64feb495c264 1073741824" returned: 0 in 0.510s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0774b17e-66d5-4c56-9b27-22103a87eebb tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.321s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:56 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-0774b17e-66d5-4c56-9b27-22103a87eebb tempest-VolumeDependencyTests-893333359 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:03:56 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-0774b17e-66d5-4c56-9b27-22103a87eebb tempest-VolumeDependencyTests-893333359 None] Deleted volume successfully. Jul 30 17:03:56 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-0774b17e-66d5-4c56-9b27-22103a87eebb tempest-VolumeDependencyTests-893333359 None] Lock "cinder-e68687d0-ddf5-4910-bb70-5ca79cc59433-delete_volume" released by "delete_volume" :: held 1.834s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-eff0279c-8896-43c4-bc39-22aca257f432 tempest-VolumesNegativeTest-1863535018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-cc228364-d541-4737-ab13-64feb495c264 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:56 devstack sudo[103480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-cc228364-d541-4737-ab13-64feb495c264 Jul 30 17:03:56 devstack sudo[103480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:57 devstack sudo[103480]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-eff0279c-8896-43c4-bc39-22aca257f432 tempest-VolumesNegativeTest-1863535018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-cc228364-d541-4737-ab13-64feb495c264" returned: 0 in 0.289s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:57 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-eff0279c-8896-43c4-bc39-22aca257f432 tempest-VolumesNegativeTest-1863535018 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:03:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-eff0279c-8896-43c4-bc39-22aca257f432 tempest-VolumesNegativeTest-1863535018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:57 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-eff0279c-8896-43c4-bc39-22aca257f432 tempest-VolumesNegativeTest-1863535018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d86aca6-4df1-4946-9a15-135871e1a8d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc228364-d541-4737-ab13-64feb495c264', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:57 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-eff0279c-8896-43c4-bc39-22aca257f432 tempest-VolumesNegativeTest-1863535018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64dbe3fb-1db2-4d2b-bca3-8e369366e65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:03:57 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-eff0279c-8896-43c4-bc39-22aca257f432 tempest-VolumesNegativeTest-1863535018 None] Volume volume-cc228364-d541-4737-ab13-64feb495c264 (cc228364-d541-4737-ab13-64feb495c264): created successfully Jul 30 17:03:57 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-eff0279c-8896-43c4-bc39-22aca257f432 tempest-VolumesNegativeTest-1863535018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64dbe3fb-1db2-4d2b-bca3-8e369366e65b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:03:57 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-eff0279c-8896-43c4-bc39-22aca257f432 tempest-VolumesNegativeTest-1863535018 None] Flow 'volume_create_manager' (e76229b3-1a44-4c2c-b4bf-39ee9f95450c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:03:57 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-eff0279c-8896-43c4-bc39-22aca257f432 tempest-VolumesNegativeTest-1863535018 None] Created volume successfully. Jul 30 17:03:57 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-95d0a41f-d1ad-4849-a27b-90a8035ce025 tempest-VolumeDependencyTests-893333359 None] Acquiring lock "cinder-2ae21019-9255-4f96-b461-5bd8cd0bb32f-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:57 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-95d0a41f-d1ad-4849-a27b-90a8035ce025 tempest-VolumeDependencyTests-893333359 None] Lock "cinder-2ae21019-9255-4f96-b461-5bd8cd0bb32f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:57 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-95d0a41f-d1ad-4849-a27b-90a8035ce025 tempest-VolumeDependencyTests-893333359 None] Acquiring lock "cinder-quobyte-2ae21019-9255-4f96-b461-5bd8cd0bb32f" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:03:57 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-95d0a41f-d1ad-4849-a27b-90a8035ce025 tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-2ae21019-9255-4f96-b461-5bd8cd0bb32f" acquired by "delete_volume" :: waited 0.016s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:03:57 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac108ea-67ed-45c1-9992-223acf93c619]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:03:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-95d0a41f-d1ad-4849-a27b-90a8035ce025 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2ae21019-9255-4f96-b461-5bd8cd0bb32f {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:57 devstack sudo[103483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2ae21019-9255-4f96-b461-5bd8cd0bb32f Jul 30 17:03:57 devstack sudo[103483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:57 devstack sudo[103483]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-95d0a41f-d1ad-4849-a27b-90a8035ce025 tempest-VolumeDependencyTests-893333359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2ae21019-9255-4f96-b461-5bd8cd0bb32f" returned: 0 in 0.377s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-95d0a41f-d1ad-4849-a27b-90a8035ce025 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2ae21019-9255-4f96-b461-5bd8cd0bb32f {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:57 devstack sudo[103488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2ae21019-9255-4f96-b461-5bd8cd0bb32f Jul 30 17:03:57 devstack sudo[103488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:58 devstack sudo[103488]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-95d0a41f-d1ad-4849-a27b-90a8035ce025 tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2ae21019-9255-4f96-b461-5bd8cd0bb32f" returned: 0 in 0.320s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:58 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-95d0a41f-d1ad-4849-a27b-90a8035ce025 tempest-VolumeDependencyTests-893333359 None] Lock "cinder-quobyte-2ae21019-9255-4f96-b461-5bd8cd0bb32f" released by "delete_volume" :: held 0.751s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:03:58 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-95d0a41f-d1ad-4849-a27b-90a8035ce025 tempest-VolumeDependencyTests-893333359 None] Created reservations ['e3d79069-4133-4abb-94de-e382a02e1978', '32d17ef0-6f9c-4547-b298-dde632fe39fa', '0f0c5155-bd62-4baf-b983-fcd347815a42', '2c887eed-e3e9-4117-b25f-68515eb4e6f6'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:03:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-95d0a41f-d1ad-4849-a27b-90a8035ce025 tempest-VolumeDependencyTests-893333359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:03:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-95d0a41f-d1ad-4849-a27b-90a8035ce025 tempest-VolumeDependencyTests-893333359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:03:58 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-95d0a41f-d1ad-4849-a27b-90a8035ce025 tempest-VolumeDependencyTests-893333359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:03:58 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-95d0a41f-d1ad-4849-a27b-90a8035ce025 tempest-VolumeDependencyTests-893333359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:03:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-95d0a41f-d1ad-4849-a27b-90a8035ce025 tempest-VolumeDependencyTests-893333359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:03:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-95d0a41f-d1ad-4849-a27b-90a8035ce025 tempest-VolumeDependencyTests-893333359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:03:58 devstack sudo[103495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:03:58 devstack sudo[103495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:03:58 devstack sudo[103495]: pam_unix(sudo:session): session closed for user root Jul 30 17:03:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-95d0a41f-d1ad-4849-a27b-90a8035ce025 tempest-VolumeDependencyTests-893333359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.349s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:03:58 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-95d0a41f-d1ad-4849-a27b-90a8035ce025 tempest-VolumeDependencyTests-893333359 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:03:58 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-95d0a41f-d1ad-4849-a27b-90a8035ce025 tempest-VolumeDependencyTests-893333359 None] Deleted volume successfully. Jul 30 17:03:58 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-95d0a41f-d1ad-4849-a27b-90a8035ce025 tempest-VolumeDependencyTests-893333359 None] Lock "cinder-2ae21019-9255-4f96-b461-5bd8cd0bb32f-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:04:08 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:UPDATE=49,cinder:SELECT=45,cinder:INSERT=15,cinder:DELETE=4 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:04:08 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:DELETE=7,cinder:UPDATE=71,cinder:SELECT=43,cinder:INSERT=14 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:04:09 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:04:09 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] Flow 'volume_create_manager' (e4020a67-77a9-4a88-8603-1d4f4f811fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:04:09 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8c8f33b-db26-445d-82eb-8429e8dd02c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:04:09 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8c8f33b-db26-445d-82eb-8429e8dd02c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:04:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42f74f84-6cfd-4222-b750-283e3d34a254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0631e3acd97440709a7f85ad9486c675',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:04:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:04:09Z,use_quota=True,user_id='655b75d70817405fb0b3af71e9e06236',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:04:09 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e0eb8db-f426-4b3c-b452-fe36b3540611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:04:09 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e0eb8db-f426-4b3c-b452-fe36b3540611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:04:09 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3f1410f-d0df-413c-8ab4-be93da055074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:04:09 devstack cinder-volume[88591]: DEBUG cinder.image.glance [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] Creating Keystone auth plugin from conf {{(pid=88591) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 30 17:04:09 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3f1410f-d0df-413c-8ab4-be93da055074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '42f74f84-6cfd-4222-b750-283e3d34a254', 'volume_name': 'volume-42f74f84-6cfd-4222-b750-283e3d34a254', 'volume_size': 1, 'image_id': 'fe2e091e-166e-4a89-9235-f24ff28f2465', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fe2e091e-166e-4a89-9235-f24ff28f2465', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c4ff65a776afa02447988a5c99c89f36', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0631e3acd97440709a7f85ad9486c675', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4aaf5315613fb10968d405e15b9fc9fab91a710cd89a6f5e9cc6daa6ad5c881c39c0e66d5b4feba503c5598342e8bdbe0ae65be83758ef66427df46260dfea0c', 'id': 'fe2e091e-166e-4a89-9235-f24ff28f2465', 'created_at': datetime.datetime(2026, 7, 30, 15, 4, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 15, 4, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fe2e091e-166e-4a89-9235-f24ff28f2465/file', 'properties': {}}, 'image_service': }' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:04:09 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (140791ad-7b0e-4fc2-9946-d94c1ddb1ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:04:09 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (140791ad-7b0e-4fc2-9946-d94c1ddb1ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:04:09 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14159a27-77ad-4ac7-8ad5-90b397c5dd80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:04:09 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] Volume 42f74f84-6cfd-4222-b750-283e3d34a254: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-42f74f84-6cfd-4222-b750-283e3d34a254', 'volume_size': 1, 'image_id': 'fe2e091e-166e-4a89-9235-f24ff28f2465', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fe2e091e-166e-4a89-9235-f24ff28f2465', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c4ff65a776afa02447988a5c99c89f36', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0631e3acd97440709a7f85ad9486c675', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4aaf5315613fb10968d405e15b9fc9fab91a710cd89a6f5e9cc6daa6ad5c881c39c0e66d5b4feba503c5598342e8bdbe0ae65be83758ef66427df46260dfea0c', 'id': 'fe2e091e-166e-4a89-9235-f24ff28f2465', 'created_at': datetime.datetime(2026, 7, 30, 15, 4, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 15, 4, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fe2e091e-166e-4a89-9235-f24ff28f2465/file', 'properties': {}}, 'image_service': } Jul 30 17:04:09 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] Trying to clone 42f74f84-6cfd-4222-b750-283e3d34a254 from image fe2e091e-166e-4a89-9235-f24ff28f2465 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fe2e091e-166e-4a89-9235-f24ff28f2465', 'metadata': {}}]). {{(pid=88591) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 30 17:04:10 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fe2e091e-166e-4a89-9235-f24ff28f2465_gs4xitkmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88591) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 30 17:04:10 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] Image download 0.00 MB at 0.00 MB/s Jul 30 17:04:10 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9118eac-9c41-46cc-bcb0-98deb9aa95df]: (4, 'raw') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:04:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fe2e091e-166e-4a89-9235-f24ff28f2465_gs4xitkmdevstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:10 devstack sudo[103698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fe2e091e-166e-4a89-9235-f24ff28f2465_gs4xitkmdevstack@QuobyteHD Jul 30 17:04:10 devstack sudo[103698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:10 devstack sudo[103698]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fe2e091e-166e-4a89-9235-f24ff28f2465_gs4xitkmdevstack@QuobyteHD" returned: 0 in 0.541s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fe2e091e-166e-4a89-9235-f24ff28f2465_gs4xitkmdevstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:10 devstack sudo[103703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fe2e091e-166e-4a89-9235-f24ff28f2465_gs4xitkmdevstack@QuobyteHD Jul 30 17:04:10 devstack sudo[103703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:11 devstack sudo[103703]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fe2e091e-166e-4a89-9235-f24ff28f2465_gs4xitkmdevstack@QuobyteHD" returned: 1 in 0.408s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fe2e091e-166e-4a89-9235-f24ff28f2465_gs4xitkmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 17:04:11 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] Temporary image fe2e091e-166e-4a89-9235-f24ff28f2465 is fetched for user 655b75d70817405fb0b3af71e9e06236. {{(pid=88591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 30 17:04:11 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ac2ae3-7d0e-47c8-9b67-aeae81a7c595]: (4, 'raw') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:04:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fe2e091e-166e-4a89-9235-f24ff28f2465_gs4xitkmdevstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:11 devstack sudo[103709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fe2e091e-166e-4a89-9235-f24ff28f2465_gs4xitkmdevstack@QuobyteHD Jul 30 17:04:11 devstack sudo[103709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:11 devstack sudo[103709]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fe2e091e-166e-4a89-9235-f24ff28f2465_gs4xitkmdevstack@QuobyteHD" returned: 0 in 0.476s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fe2e091e-166e-4a89-9235-f24ff28f2465_gs4xitkmdevstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:11 devstack sudo[103713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fe2e091e-166e-4a89-9235-f24ff28f2465_gs4xitkmdevstack@QuobyteHD Jul 30 17:04:11 devstack sudo[103713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:12 devstack sudo[103713]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fe2e091e-166e-4a89-9235-f24ff28f2465_gs4xitkmdevstack@QuobyteHD" returned: 1 in 0.729s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fe2e091e-166e-4a89-9235-f24ff28f2465_gs4xitkmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 17:04:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:04:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:04:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:04:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42f74f84-6cfd-4222-b750-283e3d34a254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0631e3acd97440709a7f85ad9486c675',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:04:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:04:09Z,use_quota=True,user_id='655b75d70817405fb0b3af71e9e06236',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:04:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] Creating volume 42f74f84-6cfd-4222-b750-283e3d34a254 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:04:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:04:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:04:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:04:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:04:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:04:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:04:12 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:04:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-42f74f84-6cfd-4222-b750-283e3d34a254 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:12 devstack sudo[103721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-42f74f84-6cfd-4222-b750-283e3d34a254 1073741824 Jul 30 17:04:12 devstack sudo[103721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:12 devstack cinder-volume[88591]: DEBUG oslo_service.periodic_task [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 17:04:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:04:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:04:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:04:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:04:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:04:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:12 devstack sudo[103726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:04:12 devstack sudo[103726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:12 devstack sudo[103726]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.357s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:12 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:04:12 devstack cinder-volume[88591]: DEBUG oslo_service.periodic_task [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running periodic task VolumeManager._thread_info {{(pid=88591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 17:04:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] thread count: 28 {{(pid=88591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 17:04:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] thread info: [<_MainThread(MainThread, started 140677178003584)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 17:04:13 devstack sudo[103721]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-42f74f84-6cfd-4222-b750-283e3d34a254 1073741824" returned: 0 in 0.743s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-42f74f84-6cfd-4222-b750-283e3d34a254 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:13 devstack sudo[103753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-42f74f84-6cfd-4222-b750-283e3d34a254 Jul 30 17:04:13 devstack sudo[103753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:13 devstack sudo[103753]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-42f74f84-6cfd-4222-b750-283e3d34a254" returned: 0 in 0.396s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:13 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:04:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.213s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:04:13 devstack cinder-volume[88591]: DEBUG cinder.volume.volume_utils [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] Attempting download of fe2e091e-166e-4a89-9235-f24ff28f2465 ((None, [{'url': 'file:///opt/stack/data/glance/images/fe2e091e-166e-4a89-9235-f24ff28f2465', 'metadata': {}}])) to volume 42f74f84-6cfd-4222-b750-283e3d34a254. {{(pid=88591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 30 17:04:13 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[374ac9ed-f0fe-4144-a932-6d246caa23f2]: (4, 'raw') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:04:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fe2e091e-166e-4a89-9235-f24ff28f2465_3oupngqc {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:14 devstack sudo[103757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fe2e091e-166e-4a89-9235-f24ff28f2465_3oupngqc Jul 30 17:04:14 devstack sudo[103757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:14 devstack sudo[103757]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fe2e091e-166e-4a89-9235-f24ff28f2465_3oupngqc" returned: 0 in 0.526s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fe2e091e-166e-4a89-9235-f24ff28f2465_3oupngqc {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:14 devstack sudo[103762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fe2e091e-166e-4a89-9235-f24ff28f2465_3oupngqc Jul 30 17:04:14 devstack sudo[103762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:14 devstack sudo[103762]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fe2e091e-166e-4a89-9235-f24ff28f2465_3oupngqc" returned: 1 in 0.355s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fe2e091e-166e-4a89-9235-f24ff28f2465_3oupngqc' failed. Not Retrying. {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 17:04:14 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b02a7ee-2ef0-4da8-8ba5-96f856d031f9]: (4, 'raw') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:04:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fe2e091e-166e-4a89-9235-f24ff28f2465_gs4xitkmdevstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:14 devstack sudo[103766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fe2e091e-166e-4a89-9235-f24ff28f2465_gs4xitkmdevstack@QuobyteHD Jul 30 17:04:14 devstack sudo[103766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:15 devstack sudo[103766]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fe2e091e-166e-4a89-9235-f24ff28f2465_gs4xitkmdevstack@QuobyteHD" returned: 0 in 0.352s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fe2e091e-166e-4a89-9235-f24ff28f2465_gs4xitkmdevstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:15 devstack sudo[103770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fe2e091e-166e-4a89-9235-f24ff28f2465_gs4xitkmdevstack@QuobyteHD Jul 30 17:04:15 devstack sudo[103770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:15 devstack sudo[103770]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fe2e091e-166e-4a89-9235-f24ff28f2465_gs4xitkmdevstack@QuobyteHD" returned: 1 in 0.362s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fe2e091e-166e-4a89-9235-f24ff28f2465_gs4xitkmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 17:04:15 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] fe2e091e-166e-4a89-9235-f24ff28f2465 was raw, converting to qcow2 {{(pid=88591) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 30 17:04:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fe2e091e-166e-4a89-9235-f24ff28f2465_gs4xitkmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-42f74f84-6cfd-4222-b750-283e3d34a254 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:15 devstack sudo[103775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fe2e091e-166e-4a89-9235-f24ff28f2465_gs4xitkmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-42f74f84-6cfd-4222-b750-283e3d34a254 Jul 30 17:04:15 devstack sudo[103775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:16 devstack sudo[103775]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:16 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fe2e091e-166e-4a89-9235-f24ff28f2465_gs4xitkmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-42f74f84-6cfd-4222-b750-283e3d34a254" returned: 0 in 0.624s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:16 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fe2e091e-166e-4a89-9235-f24ff28f2465_gs4xitkmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-42f74f84-6cfd-4222-b750-283e3d34a254 {{(pid=88591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 17:04:16 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] Converted 0.00 MB image at 0.00 MB/s Jul 30 17:04:16 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-42f74f84-6cfd-4222-b750-283e3d34a254 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:16 devstack sudo[103781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-42f74f84-6cfd-4222-b750-283e3d34a254 1G Jul 30 17:04:16 devstack sudo[103781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:16 devstack sudo[103781]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:16 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-42f74f84-6cfd-4222-b750-283e3d34a254 1G" returned: 0 in 0.344s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:16 devstack cinder-volume[88591]: DEBUG cinder.volume.volume_utils [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] Downloaded image fe2e091e-166e-4a89-9235-f24ff28f2465 ((None, [{'url': 'file:///opt/stack/data/glance/images/fe2e091e-166e-4a89-9235-f24ff28f2465', 'metadata': {}}])) to volume 42f74f84-6cfd-4222-b750-283e3d34a254 successfully. {{(pid=88591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 30 17:04:16 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] Temporary image fe2e091e-166e-4a89-9235-f24ff28f2465 for user 655b75d70817405fb0b3af71e9e06236 is deleted. {{(pid=88591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 30 17:04:16 devstack cinder-volume[88591]: DEBUG cinder.volume.volume_utils [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] Marking volume 42f74f84-6cfd-4222-b750-283e3d34a254 as bootable. {{(pid=88591) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 30 17:04:16 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] Copying metadata from image fe2e091e-166e-4a89-9235-f24ff28f2465 to 42f74f84-6cfd-4222-b750-283e3d34a254. {{(pid=88591) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 30 17:04:16 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] Creating volume glance metadata for volume 42f74f84-6cfd-4222-b750-283e3d34a254 backed by image fe2e091e-166e-4a89-9235-f24ff28f2465 with: {'image_id': 'fe2e091e-166e-4a89-9235-f24ff28f2465', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'c4ff65a776afa02447988a5c99c89f36', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88591) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 30 17:04:16 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14159a27-77ad-4ac7-8ad5-90b397c5dd80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42f74f84-6cfd-4222-b750-283e3d34a254', 'volume_size': 1, 'image_id': 'fe2e091e-166e-4a89-9235-f24ff28f2465', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fe2e091e-166e-4a89-9235-f24ff28f2465', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c4ff65a776afa02447988a5c99c89f36', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0631e3acd97440709a7f85ad9486c675', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4aaf5315613fb10968d405e15b9fc9fab91a710cd89a6f5e9cc6daa6ad5c881c39c0e66d5b4feba503c5598342e8bdbe0ae65be83758ef66427df46260dfea0c', 'id': 'fe2e091e-166e-4a89-9235-f24ff28f2465', 'created_at': datetime.datetime(2026, 7, 30, 15, 4, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 15, 4, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fe2e091e-166e-4a89-9235-f24ff28f2465/file', 'properties': {}}, 'image_service': }' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:04:16 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee0d72cc-ec8a-4691-9d5c-b31a04d8b47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:04:16 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] Volume volume-42f74f84-6cfd-4222-b750-283e3d34a254 (42f74f84-6cfd-4222-b750-283e3d34a254): created successfully Jul 30 17:04:16 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee0d72cc-ec8a-4691-9d5c-b31a04d8b47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:04:16 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] Flow 'volume_create_manager' (e4020a67-77a9-4a88-8603-1d4f4f811fb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:04:16 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-b0eac9f7-624e-4594-b617-3ecab13e6a32 tempest-VolumeImageDependencyTests-2064013169 None] Created volume successfully. Jul 30 17:04:16 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d134dbcd-cb92-4186-9ff1-512f832e23c6 tempest-VolumeImageDependencyTests-2064013169 None] Acquiring lock "cinder-42f74f84-6cfd-4222-b750-283e3d34a254-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:04:16 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d134dbcd-cb92-4186-9ff1-512f832e23c6 tempest-VolumeImageDependencyTests-2064013169 None] Lock "cinder-42f74f84-6cfd-4222-b750-283e3d34a254-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:04:16 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d134dbcd-cb92-4186-9ff1-512f832e23c6 tempest-VolumeImageDependencyTests-2064013169 None] Acquiring lock "cinder-quobyte-42f74f84-6cfd-4222-b750-283e3d34a254" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:04:17 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d134dbcd-cb92-4186-9ff1-512f832e23c6 tempest-VolumeImageDependencyTests-2064013169 None] Lock "cinder-quobyte-42f74f84-6cfd-4222-b750-283e3d34a254" acquired by "delete_volume" :: waited 0.019s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:04:17 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[87605b77-78cd-4450-9cb8-0da7af5dc48d]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:04:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d134dbcd-cb92-4186-9ff1-512f832e23c6 tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-42f74f84-6cfd-4222-b750-283e3d34a254 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:17 devstack sudo[103787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-42f74f84-6cfd-4222-b750-283e3d34a254 Jul 30 17:04:17 devstack sudo[103787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:17 devstack sudo[103787]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d134dbcd-cb92-4186-9ff1-512f832e23c6 tempest-VolumeImageDependencyTests-2064013169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-42f74f84-6cfd-4222-b750-283e3d34a254" returned: 0 in 0.416s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d134dbcd-cb92-4186-9ff1-512f832e23c6 tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-42f74f84-6cfd-4222-b750-283e3d34a254 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:17 devstack sudo[103811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-42f74f84-6cfd-4222-b750-283e3d34a254 Jul 30 17:04:17 devstack sudo[103811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:17 devstack sudo[103811]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d134dbcd-cb92-4186-9ff1-512f832e23c6 tempest-VolumeImageDependencyTests-2064013169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-42f74f84-6cfd-4222-b750-283e3d34a254" returned: 0 in 0.287s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:17 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d134dbcd-cb92-4186-9ff1-512f832e23c6 tempest-VolumeImageDependencyTests-2064013169 None] Lock "cinder-quobyte-42f74f84-6cfd-4222-b750-283e3d34a254" released by "delete_volume" :: held 0.761s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:04:17 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-d134dbcd-cb92-4186-9ff1-512f832e23c6 tempest-VolumeImageDependencyTests-2064013169 None] Created reservations ['61297d93-6d81-43ac-959c-3e41f45c7def', 'b37664cb-2ccc-469e-94c7-3d25fffa1896', '28bae74a-3631-49ca-a7d3-1963165e7d01', '04bbcc62-4d40-4930-a7b7-8656456b2637'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:04:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d134dbcd-cb92-4186-9ff1-512f832e23c6 tempest-VolumeImageDependencyTests-2064013169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:04:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d134dbcd-cb92-4186-9ff1-512f832e23c6 tempest-VolumeImageDependencyTests-2064013169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:04:17 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d134dbcd-cb92-4186-9ff1-512f832e23c6 tempest-VolumeImageDependencyTests-2064013169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:04:17 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d134dbcd-cb92-4186-9ff1-512f832e23c6 tempest-VolumeImageDependencyTests-2064013169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:04:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d134dbcd-cb92-4186-9ff1-512f832e23c6 tempest-VolumeImageDependencyTests-2064013169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:04:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d134dbcd-cb92-4186-9ff1-512f832e23c6 tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:17 devstack sudo[103815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:04:17 devstack sudo[103815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:18 devstack sudo[103815]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d134dbcd-cb92-4186-9ff1-512f832e23c6 tempest-VolumeImageDependencyTests-2064013169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.289s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:18 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-d134dbcd-cb92-4186-9ff1-512f832e23c6 tempest-VolumeImageDependencyTests-2064013169 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:04:18 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-d134dbcd-cb92-4186-9ff1-512f832e23c6 tempest-VolumeImageDependencyTests-2064013169 None] Deleted volume successfully. Jul 30 17:04:18 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d134dbcd-cb92-4186-9ff1-512f832e23c6 tempest-VolumeImageDependencyTests-2064013169 None] Lock "cinder-42f74f84-6cfd-4222-b750-283e3d34a254-delete_volume" released by "delete_volume" :: held 1.270s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:04:20 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:04:20 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] Flow 'volume_create_manager' (825588e7-9347-4945-9962-4ef2d2b74e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:04:20 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7120826-5120-4819-bc6f-37363188d788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:04:20 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7120826-5120-4819-bc6f-37363188d788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test0e20bd6e-440f-41d8-9b5d-fc047ac00423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a1e04b9-f06c-43aa-a416-d28077fef636,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0631e3acd97440709a7f85ad9486c675',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:04:21Z,use_quota=True,user_id='655b75d70817405fb0b3af71e9e06236',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:04:20 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0ba7763-8911-43ec-8c81-ef59046bf2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:04:20 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0ba7763-8911-43ec-8c81-ef59046bf2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:04:20 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7678326b-457c-43ac-bc1c-af6109ae84a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:04:20 devstack cinder-volume[88591]: DEBUG cinder.image.glance [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] Creating Keystone auth plugin from conf {{(pid=88591) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 30 17:04:21 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-1ef29706-fb6b-4726-96d4-5780576c59fa tempest-VolumesNegativeTest-1863535018 None] Acquiring lock "cinder-cc228364-d541-4737-ab13-64feb495c264-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:04:21 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-1ef29706-fb6b-4726-96d4-5780576c59fa tempest-VolumesNegativeTest-1863535018 None] Lock "cinder-cc228364-d541-4737-ab13-64feb495c264-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:04:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7678326b-457c-43ac-bc1c-af6109ae84a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9a1e04b9-f06c-43aa-a416-d28077fef636', 'volume_name': 'volume-9a1e04b9-f06c-43aa-a416-d28077fef636', 'volume_size': 1, 'image_id': 'db35d89b-ceee-43ce-bdbc-bbd39079cf27', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/db35d89b-ceee-43ce-bdbc-bbd39079cf27', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-0e20bd6e-440f-41d8-9b5d-fc047ac00423', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '67ee09ff2ac60617b0dc6de1d8d76b08', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0631e3acd97440709a7f85ad9486c675', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '624b897d35e8049f64d4f33689bd5e15cb6a225a42676d33ee6109a1a3e52be3b6d79e9cbc0d3560d083a33c537fb35bde99eb18dacdc5848a3d9372b9911775', 'id': 'db35d89b-ceee-43ce-bdbc-bbd39079cf27', 'created_at': datetime.datetime(2026, 7, 30, 15, 4, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 15, 4, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/db35d89b-ceee-43ce-bdbc-bbd39079cf27/file', 'properties': {}}, 'image_service': }' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:04:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e7fa35c-c527-4c92-8834-1d7994f5f234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:04:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e7fa35c-c527-4c92-8834-1d7994f5f234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:04:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bfab6af-2164-4772-b78e-2a399e4111ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:04:21 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] Volume 9a1e04b9-f06c-43aa-a416-d28077fef636: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9a1e04b9-f06c-43aa-a416-d28077fef636', 'volume_size': 1, 'image_id': 'db35d89b-ceee-43ce-bdbc-bbd39079cf27', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/db35d89b-ceee-43ce-bdbc-bbd39079cf27', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-0e20bd6e-440f-41d8-9b5d-fc047ac00423', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '67ee09ff2ac60617b0dc6de1d8d76b08', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0631e3acd97440709a7f85ad9486c675', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '624b897d35e8049f64d4f33689bd5e15cb6a225a42676d33ee6109a1a3e52be3b6d79e9cbc0d3560d083a33c537fb35bde99eb18dacdc5848a3d9372b9911775', 'id': 'db35d89b-ceee-43ce-bdbc-bbd39079cf27', 'created_at': datetime.datetime(2026, 7, 30, 15, 4, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 15, 4, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/db35d89b-ceee-43ce-bdbc-bbd39079cf27/file', 'properties': {}}, 'image_service': } Jul 30 17:04:21 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] Trying to clone 9a1e04b9-f06c-43aa-a416-d28077fef636 from image db35d89b-ceee-43ce-bdbc-bbd39079cf27 at location (None, [{'url': 'file:///opt/stack/data/glance/images/db35d89b-ceee-43ce-bdbc-bbd39079cf27', 'metadata': {}}]). {{(pid=88591) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 30 17:04:21 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-1ef29706-fb6b-4726-96d4-5780576c59fa tempest-VolumesNegativeTest-1863535018 None] Acquiring lock "cinder-quobyte-cc228364-d541-4737-ab13-64feb495c264" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:04:21 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-1ef29706-fb6b-4726-96d4-5780576c59fa tempest-VolumesNegativeTest-1863535018 None] Lock "cinder-quobyte-cc228364-d541-4737-ab13-64feb495c264" acquired by "delete_volume" :: waited 0.019s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:04:21 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc67e698-5df3-46ea-8297-4bb300f79d13]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:04:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1ef29706-fb6b-4726-96d4-5780576c59fa tempest-VolumesNegativeTest-1863535018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-cc228364-d541-4737-ab13-64feb495c264 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:21 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_db35d89b-ceee-43ce-bdbc-bbd39079cf27_q7aexr7jdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88591) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 30 17:04:21 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] Image download 0.00 MB at 0.00 MB/s Jul 30 17:04:21 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a228415f-13be-4f28-b20f-0e87af934a03]: (4, 'raw') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:04:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_db35d89b-ceee-43ce-bdbc-bbd39079cf27_q7aexr7jdevstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:21 devstack sudo[103818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-cc228364-d541-4737-ab13-64feb495c264 Jul 30 17:04:21 devstack sudo[103818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:21 devstack sudo[103819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_db35d89b-ceee-43ce-bdbc-bbd39079cf27_q7aexr7jdevstack@QuobyteHD Jul 30 17:04:21 devstack sudo[103819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:21 devstack sudo[103818]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1ef29706-fb6b-4726-96d4-5780576c59fa tempest-VolumesNegativeTest-1863535018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-cc228364-d541-4737-ab13-64feb495c264" returned: 0 in 0.371s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1ef29706-fb6b-4726-96d4-5780576c59fa tempest-VolumesNegativeTest-1863535018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-cc228364-d541-4737-ab13-64feb495c264 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:21 devstack sudo[103827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-cc228364-d541-4737-ab13-64feb495c264 Jul 30 17:04:21 devstack sudo[103827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:21 devstack sudo[103819]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_db35d89b-ceee-43ce-bdbc-bbd39079cf27_q7aexr7jdevstack@QuobyteHD" returned: 0 in 0.329s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db35d89b-ceee-43ce-bdbc-bbd39079cf27_q7aexr7jdevstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:21 devstack sudo[103829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db35d89b-ceee-43ce-bdbc-bbd39079cf27_q7aexr7jdevstack@QuobyteHD Jul 30 17:04:21 devstack sudo[103829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:21 devstack sudo[103827]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1ef29706-fb6b-4726-96d4-5780576c59fa tempest-VolumesNegativeTest-1863535018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-cc228364-d541-4737-ab13-64feb495c264" returned: 0 in 0.251s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:21 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-1ef29706-fb6b-4726-96d4-5780576c59fa tempest-VolumesNegativeTest-1863535018 None] Lock "cinder-quobyte-cc228364-d541-4737-ab13-64feb495c264" released by "delete_volume" :: held 0.663s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:04:22 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-1ef29706-fb6b-4726-96d4-5780576c59fa tempest-VolumesNegativeTest-1863535018 None] Created reservations ['9fde835b-73f1-43ef-8b70-9652b811beeb', '2d17a61c-a16c-4c91-8ac0-8a7b59f90ec9', 'a0c4b46a-c64b-4670-b0c1-ba7dcac5f337', '5d314d00-5e0e-4f8b-af70-55e0c9c64ac8'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:04:22 devstack sudo[103829]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db35d89b-ceee-43ce-bdbc-bbd39079cf27_q7aexr7jdevstack@QuobyteHD" returned: 1 in 0.349s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db35d89b-ceee-43ce-bdbc-bbd39079cf27_q7aexr7jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 17:04:22 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] Temporary image db35d89b-ceee-43ce-bdbc-bbd39079cf27 is fetched for user 655b75d70817405fb0b3af71e9e06236. {{(pid=88591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 30 17:04:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1ef29706-fb6b-4726-96d4-5780576c59fa tempest-VolumesNegativeTest-1863535018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:04:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1ef29706-fb6b-4726-96d4-5780576c59fa tempest-VolumesNegativeTest-1863535018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:04:22 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-1ef29706-fb6b-4726-96d4-5780576c59fa tempest-VolumesNegativeTest-1863535018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:04:22 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-1ef29706-fb6b-4726-96d4-5780576c59fa tempest-VolumesNegativeTest-1863535018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:04:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1ef29706-fb6b-4726-96d4-5780576c59fa tempest-VolumesNegativeTest-1863535018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:04:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1ef29706-fb6b-4726-96d4-5780576c59fa tempest-VolumesNegativeTest-1863535018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:22 devstack sudo[103836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:04:22 devstack sudo[103836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:22 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72ea223-fd6c-4de8-bbd3-634bb12e1970]: (4, 'raw') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:04:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_db35d89b-ceee-43ce-bdbc-bbd39079cf27_q7aexr7jdevstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:22 devstack sudo[103839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_db35d89b-ceee-43ce-bdbc-bbd39079cf27_q7aexr7jdevstack@QuobyteHD Jul 30 17:04:22 devstack sudo[103839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:22 devstack sudo[103836]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1ef29706-fb6b-4726-96d4-5780576c59fa tempest-VolumesNegativeTest-1863535018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.264s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:22 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-1ef29706-fb6b-4726-96d4-5780576c59fa tempest-VolumesNegativeTest-1863535018 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:04:22 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-1ef29706-fb6b-4726-96d4-5780576c59fa tempest-VolumesNegativeTest-1863535018 None] Deleted volume successfully. Jul 30 17:04:22 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-1ef29706-fb6b-4726-96d4-5780576c59fa tempest-VolumesNegativeTest-1863535018 None] Lock "cinder-cc228364-d541-4737-ab13-64feb495c264-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:04:22 devstack sudo[103839]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_db35d89b-ceee-43ce-bdbc-bbd39079cf27_q7aexr7jdevstack@QuobyteHD" returned: 0 in 0.367s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db35d89b-ceee-43ce-bdbc-bbd39079cf27_q7aexr7jdevstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:22 devstack sudo[103844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db35d89b-ceee-43ce-bdbc-bbd39079cf27_q7aexr7jdevstack@QuobyteHD Jul 30 17:04:22 devstack sudo[103844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:22 devstack sudo[103844]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db35d89b-ceee-43ce-bdbc-bbd39079cf27_q7aexr7jdevstack@QuobyteHD" returned: 1 in 0.360s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db35d89b-ceee-43ce-bdbc-bbd39079cf27_q7aexr7jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 17:04:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:04:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:04:22 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test0e20bd6e-440f-41d8-9b5d-fc047ac00423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a1e04b9-f06c-43aa-a416-d28077fef636,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0631e3acd97440709a7f85ad9486c675',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:04:21Z,use_quota=True,user_id='655b75d70817405fb0b3af71e9e06236',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:04:22 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] Creating volume 9a1e04b9-f06c-43aa-a416-d28077fef636 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:04:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:04:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:04:22 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:04:22 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:04:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:04:22 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:04:22 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:04:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:22 devstack sudo[103849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636 1073741824 Jul 30 17:04:22 devstack sudo[103849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:23 devstack sudo[103849]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636 1073741824" returned: 0 in 0.496s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:23 devstack sudo[103855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636 Jul 30 17:04:23 devstack sudo[103855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:23 devstack sudo[103855]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636" returned: 0 in 0.262s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:23 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:04:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:04:23 devstack cinder-volume[88591]: DEBUG cinder.volume.volume_utils [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] Attempting download of db35d89b-ceee-43ce-bdbc-bbd39079cf27 ((None, [{'url': 'file:///opt/stack/data/glance/images/db35d89b-ceee-43ce-bdbc-bbd39079cf27', 'metadata': {}}])) to volume 9a1e04b9-f06c-43aa-a416-d28077fef636. {{(pid=88591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 30 17:04:23 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24bd923-aae9-4163-8ea4-5592c61544b3]: (4, 'raw') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:04:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_db35d89b-ceee-43ce-bdbc-bbd39079cf27_213fz3ij {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:23 devstack sudo[103858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_db35d89b-ceee-43ce-bdbc-bbd39079cf27_213fz3ij Jul 30 17:04:23 devstack sudo[103858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:24 devstack sudo[103858]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_db35d89b-ceee-43ce-bdbc-bbd39079cf27_213fz3ij" returned: 0 in 0.350s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db35d89b-ceee-43ce-bdbc-bbd39079cf27_213fz3ij {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:24 devstack sudo[103862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db35d89b-ceee-43ce-bdbc-bbd39079cf27_213fz3ij Jul 30 17:04:24 devstack sudo[103862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:24 devstack sudo[103862]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db35d89b-ceee-43ce-bdbc-bbd39079cf27_213fz3ij" returned: 1 in 0.374s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db35d89b-ceee-43ce-bdbc-bbd39079cf27_213fz3ij' failed. Not Retrying. {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 17:04:24 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f55531f-36d4-4306-966c-c8a3e7391a69]: (4, 'raw') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:04:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_db35d89b-ceee-43ce-bdbc-bbd39079cf27_q7aexr7jdevstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:24 devstack sudo[103868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_db35d89b-ceee-43ce-bdbc-bbd39079cf27_q7aexr7jdevstack@QuobyteHD Jul 30 17:04:24 devstack sudo[103868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:24 devstack sudo[103868]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_db35d89b-ceee-43ce-bdbc-bbd39079cf27_q7aexr7jdevstack@QuobyteHD" returned: 0 in 0.366s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db35d89b-ceee-43ce-bdbc-bbd39079cf27_q7aexr7jdevstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:25 devstack sudo[103872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db35d89b-ceee-43ce-bdbc-bbd39079cf27_q7aexr7jdevstack@QuobyteHD Jul 30 17:04:25 devstack sudo[103872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:25 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-3971f348-4aed-4914-825b-5c036af33cd2 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:04:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3971f348-4aed-4914-825b-5c036af33cd2 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Flow 'volume_create_manager' (81e1f86e-d1cf-42c3-a8f4-0424377988cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:04:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3971f348-4aed-4914-825b-5c036af33cd2 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4da540b6-d2e6-4739-8660-f29afb34c0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:04:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3971f348-4aed-4914-825b-5c036af33cd2 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4da540b6-d2e6-4739-8660-f29afb34c0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1612116011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d62640e7-473a-4308-91a5-23c93fe32663,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='027dbfca1b294ad8ab323f127d195dd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:04:25Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:04:25Z,use_quota=True,user_id='d2f498a611184902805d02352799442d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:04:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3971f348-4aed-4914-825b-5c036af33cd2 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7085051c-4b83-42db-a91f-06fd66a38172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:04:25 devstack sudo[103872]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3971f348-4aed-4914-825b-5c036af33cd2 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7085051c-4b83-42db-a91f-06fd66a38172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:04:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3971f348-4aed-4914-825b-5c036af33cd2 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddcb8c10-7a56-489a-8b52-3ac599a0f006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:04:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3971f348-4aed-4914-825b-5c036af33cd2 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddcb8c10-7a56-489a-8b52-3ac599a0f006) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd62640e7-473a-4308-91a5-23c93fe32663', 'volume_name': 'volume-d62640e7-473a-4308-91a5-23c93fe32663', 'volume_size': 2}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:04:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3971f348-4aed-4914-825b-5c036af33cd2 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a4522de-d578-49b3-b260-fe345fd2f28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:04:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3971f348-4aed-4914-825b-5c036af33cd2 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a4522de-d578-49b3-b260-fe345fd2f28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:04:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3971f348-4aed-4914-825b-5c036af33cd2 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39d3be4f-d568-4a39-b6e0-96cb503f7efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:04:25 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-3971f348-4aed-4914-825b-5c036af33cd2 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Volume d62640e7-473a-4308-91a5-23c93fe32663: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d62640e7-473a-4308-91a5-23c93fe32663', 'volume_size': 2} Jul 30 17:04:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3971f348-4aed-4914-825b-5c036af33cd2 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:04:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3971f348-4aed-4914-825b-5c036af33cd2 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:04:25 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-3971f348-4aed-4914-825b-5c036af33cd2 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1612116011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d62640e7-473a-4308-91a5-23c93fe32663,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='027dbfca1b294ad8ab323f127d195dd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:04:25Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:04:25Z,use_quota=True,user_id='d2f498a611184902805d02352799442d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:04:25 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-3971f348-4aed-4914-825b-5c036af33cd2 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Creating volume d62640e7-473a-4308-91a5-23c93fe32663 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:04:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3971f348-4aed-4914-825b-5c036af33cd2 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:04:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3971f348-4aed-4914-825b-5c036af33cd2 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:04:25 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-3971f348-4aed-4914-825b-5c036af33cd2 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:04:25 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-3971f348-4aed-4914-825b-5c036af33cd2 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:04:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3971f348-4aed-4914-825b-5c036af33cd2 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:04:25 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-3971f348-4aed-4914-825b-5c036af33cd2 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:04:25 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-3971f348-4aed-4914-825b-5c036af33cd2 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:04:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3971f348-4aed-4914-825b-5c036af33cd2 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d62640e7-473a-4308-91a5-23c93fe32663 2147483648 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db35d89b-ceee-43ce-bdbc-bbd39079cf27_q7aexr7jdevstack@QuobyteHD" returned: 1 in 0.516s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db35d89b-ceee-43ce-bdbc-bbd39079cf27_q7aexr7jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 17:04:25 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] db35d89b-ceee-43ce-bdbc-bbd39079cf27 was raw, converting to qcow2 {{(pid=88591) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 30 17:04:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_db35d89b-ceee-43ce-bdbc-bbd39079cf27_q7aexr7jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:25 devstack sudo[103877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d62640e7-473a-4308-91a5-23c93fe32663 2147483648 Jul 30 17:04:25 devstack sudo[103877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:25 devstack sudo[103878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_db35d89b-ceee-43ce-bdbc-bbd39079cf27_q7aexr7jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636 Jul 30 17:04:25 devstack sudo[103878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:25 devstack sudo[103878]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_db35d89b-ceee-43ce-bdbc-bbd39079cf27_q7aexr7jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636" returned: 0 in 0.505s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:25 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_db35d89b-ceee-43ce-bdbc-bbd39079cf27_q7aexr7jdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636 {{(pid=88591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 17:04:25 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] Converted 0.00 MB image at 0.00 MB/s Jul 30 17:04:25 devstack sudo[103877]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3971f348-4aed-4914-825b-5c036af33cd2 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d62640e7-473a-4308-91a5-23c93fe32663 2147483648" returned: 0 in 0.547s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:25 devstack sudo[103889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636 1G Jul 30 17:04:25 devstack sudo[103889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3971f348-4aed-4914-825b-5c036af33cd2 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d62640e7-473a-4308-91a5-23c93fe32663 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:26 devstack sudo[103891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d62640e7-473a-4308-91a5-23c93fe32663 Jul 30 17:04:26 devstack sudo[103891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:26 devstack sudo[103891]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3971f348-4aed-4914-825b-5c036af33cd2 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d62640e7-473a-4308-91a5-23c93fe32663" returned: 0 in 0.260s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:26 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-3971f348-4aed-4914-825b-5c036af33cd2 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:04:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3971f348-4aed-4914-825b-5c036af33cd2 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:04:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3971f348-4aed-4914-825b-5c036af33cd2 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39d3be4f-d568-4a39-b6e0-96cb503f7efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d62640e7-473a-4308-91a5-23c93fe32663', 'volume_size': 2}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:04:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3971f348-4aed-4914-825b-5c036af33cd2 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bd0ef5a-a29f-48bf-89bd-715e81a0f1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:04:26 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-3971f348-4aed-4914-825b-5c036af33cd2 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Volume volume-d62640e7-473a-4308-91a5-23c93fe32663 (d62640e7-473a-4308-91a5-23c93fe32663): created successfully Jul 30 17:04:26 devstack sudo[103889]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3971f348-4aed-4914-825b-5c036af33cd2 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bd0ef5a-a29f-48bf-89bd-715e81a0f1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:04:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3971f348-4aed-4914-825b-5c036af33cd2 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Flow 'volume_create_manager' (81e1f86e-d1cf-42c3-a8f4-0424377988cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:04:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636 1G" returned: 0 in 0.367s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:26 devstack cinder-volume[88591]: DEBUG cinder.volume.volume_utils [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] Downloaded image db35d89b-ceee-43ce-bdbc-bbd39079cf27 ((None, [{'url': 'file:///opt/stack/data/glance/images/db35d89b-ceee-43ce-bdbc-bbd39079cf27', 'metadata': {}}])) to volume 9a1e04b9-f06c-43aa-a416-d28077fef636 successfully. {{(pid=88591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 30 17:04:26 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] Temporary image db35d89b-ceee-43ce-bdbc-bbd39079cf27 for user 655b75d70817405fb0b3af71e9e06236 is deleted. {{(pid=88591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 30 17:04:26 devstack cinder-volume[88591]: DEBUG cinder.volume.volume_utils [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] Marking volume 9a1e04b9-f06c-43aa-a416-d28077fef636 as bootable. {{(pid=88591) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 30 17:04:26 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-3971f348-4aed-4914-825b-5c036af33cd2 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Created volume successfully. Jul 30 17:04:26 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] Copying metadata from image db35d89b-ceee-43ce-bdbc-bbd39079cf27 to 9a1e04b9-f06c-43aa-a416-d28077fef636. {{(pid=88591) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 30 17:04:26 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] Creating volume glance metadata for volume 9a1e04b9-f06c-43aa-a416-d28077fef636 backed by image db35d89b-ceee-43ce-bdbc-bbd39079cf27 with: {'image_id': 'db35d89b-ceee-43ce-bdbc-bbd39079cf27', 'image_name': 'image-for-test-0e20bd6e-440f-41d8-9b5d-fc047ac00423', 'checksum': '67ee09ff2ac60617b0dc6de1d8d76b08', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88591) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 30 17:04:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bfab6af-2164-4772-b78e-2a399e4111ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a1e04b9-f06c-43aa-a416-d28077fef636', 'volume_size': 1, 'image_id': 'db35d89b-ceee-43ce-bdbc-bbd39079cf27', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/db35d89b-ceee-43ce-bdbc-bbd39079cf27', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-0e20bd6e-440f-41d8-9b5d-fc047ac00423', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '67ee09ff2ac60617b0dc6de1d8d76b08', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0631e3acd97440709a7f85ad9486c675', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '624b897d35e8049f64d4f33689bd5e15cb6a225a42676d33ee6109a1a3e52be3b6d79e9cbc0d3560d083a33c537fb35bde99eb18dacdc5848a3d9372b9911775', 'id': 'db35d89b-ceee-43ce-bdbc-bbd39079cf27', 'created_at': datetime.datetime(2026, 7, 30, 15, 4, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 15, 4, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/db35d89b-ceee-43ce-bdbc-bbd39079cf27/file', 'properties': {}}, 'image_service': }' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:04:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adcb458c-8502-43c5-a30a-f4e7b6b15860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:04:26 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] Volume volume-9a1e04b9-f06c-43aa-a416-d28077fef636 (9a1e04b9-f06c-43aa-a416-d28077fef636): created successfully Jul 30 17:04:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adcb458c-8502-43c5-a30a-f4e7b6b15860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:04:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] Flow 'volume_create_manager' (825588e7-9347-4945-9962-4ef2d2b74e9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:04:26 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-c03f85c5-f353-4ef5-8c45-8c9df0fccd17 tempest-VolumeImageDependencyTests-2064013169 None] Created volume successfully. Jul 30 17:04:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-946842e2-05c5-46f3-9760-fc16c1479de9 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:04:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-946842e2-05c5-46f3-9760-fc16c1479de9 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:04:27 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-946842e2-05c5-46f3-9760-fc16c1479de9 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Creating offline snapshot 2e403a17-4163-47b2-8cdb-ab10207a98e5 of volume d62640e7-473a-4308-91a5-23c93fe32663 {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:04:27 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a398a112-967d-4c49-aa85-491a309b5c24]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:04:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-946842e2-05c5-46f3-9760-fc16c1479de9 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d62640e7-473a-4308-91a5-23c93fe32663 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:27 devstack sudo[103898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d62640e7-473a-4308-91a5-23c93fe32663 Jul 30 17:04:27 devstack sudo[103898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:27 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:04:27 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] Flow 'volume_create_manager' (356d871a-940f-46a5-a943-02c29ea1006e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:04:27 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3212142c-fea6-46a7-9f32-8aac337af3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:04:27 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3212142c-fea6-46a7-9f32-8aac337af3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:04:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume2-for-test-0e20bd6e-440f-41d8-9b5d-fc047ac00423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72895282-ea09-4cf2-bdc5-9b50d06473bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0631e3acd97440709a7f85ad9486c675',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=9a1e04b9-f06c-43aa-a416-d28077fef636,status='creating',terminated_at=None,updated_at=2026-07-30T15:04:28Z,use_quota=True,user_id='655b75d70817405fb0b3af71e9e06236',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:04:27 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (528a9cea-da17-4fb9-b9fa-3c1dac2ad8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:04:27 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (528a9cea-da17-4fb9-b9fa-3c1dac2ad8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:04:27 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (708b1f1f-ca32-446d-91df-f03347ab439e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:04:27 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (708b1f1f-ca32-446d-91df-f03347ab439e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '72895282-ea09-4cf2-bdc5-9b50d06473bb', 'volume_name': 'volume-72895282-ea09-4cf2-bdc5-9b50d06473bb', 'volume_size': 1, 'source_volid': '9a1e04b9-f06c-43aa-a416-d28077fef636', 'source_volstatus': 'available'}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:04:27 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6333d392-6c80-4100-b249-4f67e4bf8ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:04:27 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6333d392-6c80-4100-b249-4f67e4bf8ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:04:27 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf4ec9c1-5d9a-4a46-8a9e-f0e2e1fff96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:04:27 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] Volume 72895282-ea09-4cf2-bdc5-9b50d06473bb: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-72895282-ea09-4cf2-bdc5-9b50d06473bb', 'volume_size': 1, 'source_volid': '9a1e04b9-f06c-43aa-a416-d28077fef636', 'source_volstatus': 'available'} Jul 30 17:04:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:04:28 devstack sudo[103898]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-946842e2-05c5-46f3-9760-fc16c1479de9 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d62640e7-473a-4308-91a5-23c93fe32663" returned: 0 in 0.380s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-946842e2-05c5-46f3-9760-fc16c1479de9 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d62640e7-473a-4308-91a5-23c93fe32663,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d62640e7-473a-4308-91a5-23c93fe32663.2e403a17-4163-47b2-8cdb-ab10207a98e5 2G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:28 devstack sudo[103904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d62640e7-473a-4308-91a5-23c93fe32663,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d62640e7-473a-4308-91a5-23c93fe32663.2e403a17-4163-47b2-8cdb-ab10207a98e5 2G Jul 30 17:04:28 devstack sudo[103904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:28 devstack sudo[103904]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-946842e2-05c5-46f3-9760-fc16c1479de9 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d62640e7-473a-4308-91a5-23c93fe32663,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d62640e7-473a-4308-91a5-23c93fe32663.2e403a17-4163-47b2-8cdb-ab10207a98e5 2G" returned: 0 in 0.387s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-946842e2-05c5-46f3-9760-fc16c1479de9 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d62640e7-473a-4308-91a5-23c93fe32663 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d62640e7-473a-4308-91a5-23c93fe32663.2e403a17-4163-47b2-8cdb-ab10207a98e5 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:28 devstack sudo[103910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d62640e7-473a-4308-91a5-23c93fe32663 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d62640e7-473a-4308-91a5-23c93fe32663.2e403a17-4163-47b2-8cdb-ab10207a98e5 Jul 30 17:04:28 devstack sudo[103910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:28 devstack sudo[103910]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-946842e2-05c5-46f3-9760-fc16c1479de9 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d62640e7-473a-4308-91a5-23c93fe32663 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d62640e7-473a-4308-91a5-23c93fe32663.2e403a17-4163-47b2-8cdb-ab10207a98e5" returned: 0 in 0.286s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:28 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-946842e2-05c5-46f3-9760-fc16c1479de9 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d62640e7-473a-4308-91a5-23c93fe32663.2e403a17-4163-47b2-8cdb-ab10207a98e5 is being set with open permissions: ugo+rw Jul 30 17:04:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-946842e2-05c5-46f3-9760-fc16c1479de9 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d62640e7-473a-4308-91a5-23c93fe32663.2e403a17-4163-47b2-8cdb-ab10207a98e5 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:28 devstack sudo[103915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d62640e7-473a-4308-91a5-23c93fe32663.2e403a17-4163-47b2-8cdb-ab10207a98e5 Jul 30 17:04:28 devstack sudo[103915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:28 devstack sudo[103915]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-946842e2-05c5-46f3-9760-fc16c1479de9 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d62640e7-473a-4308-91a5-23c93fe32663.2e403a17-4163-47b2-8cdb-ab10207a98e5" returned: 0 in 0.238s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-946842e2-05c5-46f3-9760-fc16c1479de9 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d62640e7-473a-4308-91a5-23c93fe32663.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:28 devstack sudo[103918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d62640e7-473a-4308-91a5-23c93fe32663.info Jul 30 17:04:28 devstack sudo[103918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:29 devstack sudo[103918]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-946842e2-05c5-46f3-9760-fc16c1479de9 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d62640e7-473a-4308-91a5-23c93fe32663.info" returned: 0 in 0.256s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:29 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-946842e2-05c5-46f3-9760-fc16c1479de9 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d62640e7-473a-4308-91a5-23c93fe32663.info is being set with open permissions: ugo+rw Jul 30 17:04:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-946842e2-05c5-46f3-9760-fc16c1479de9 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d62640e7-473a-4308-91a5-23c93fe32663.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:29 devstack sudo[103921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d62640e7-473a-4308-91a5-23c93fe32663.info Jul 30 17:04:29 devstack sudo[103921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:29 devstack sudo[103921]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-946842e2-05c5-46f3-9760-fc16c1479de9 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d62640e7-473a-4308-91a5-23c93fe32663.info" returned: 0 in 0.264s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-946842e2-05c5-46f3-9760-fc16c1479de9 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.908s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:04:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.575s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:04:29 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] Cloning volume 9a1e04b9-f06c-43aa-a416-d28077fef636 to volume 72895282-ea09-4cf2-bdc5-9b50d06473bb Jul 30 17:04:29 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-946842e2-05c5-46f3-9760-fc16c1479de9 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Create snapshot completed successfully Jul 30 17:04:29 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] Creating offline snapshot d38e005a-5566-4a8f-9ed4-8b8661a1554a of volume 9a1e04b9-f06c-43aa-a416-d28077fef636 {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:04:29 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d5af9e-54c1-44b3-820b-605319752bf7]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:04:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:29 devstack sudo[103924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636 Jul 30 17:04:29 devstack sudo[103924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:29 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9f65c8f9-e733-4e5a-8bd4-c502ad75d38f tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Acquiring lock "cinder-2e403a17-4163-47b2-8cdb-ab10207a98e5-delete_snapshot" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:04:29 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9f65c8f9-e733-4e5a-8bd4-c502ad75d38f tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Lock "cinder-2e403a17-4163-47b2-8cdb-ab10207a98e5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:04:29 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9f65c8f9-e733-4e5a-8bd4-c502ad75d38f tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Acquiring lock "cinder-quobyte-d62640e7-473a-4308-91a5-23c93fe32663" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:04:29 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9f65c8f9-e733-4e5a-8bd4-c502ad75d38f tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Lock "cinder-quobyte-d62640e7-473a-4308-91a5-23c93fe32663" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:04:29 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9f65c8f9-e733-4e5a-8bd4-c502ad75d38f tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Acquiring lock "cinder-quobyte-2e403a17-4163-47b2-8cdb-ab10207a98e5" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:04:29 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9f65c8f9-e733-4e5a-8bd4-c502ad75d38f tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Lock "cinder-quobyte-2e403a17-4163-47b2-8cdb-ab10207a98e5" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:04:29 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-9f65c8f9-e733-4e5a-8bd4-c502ad75d38f tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Deleting offline snapshot 2e403a17-4163-47b2-8cdb-ab10207a98e5 of volume d62640e7-473a-4308-91a5-23c93fe32663 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:04:29 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-9f65c8f9-e733-4e5a-8bd4-c502ad75d38f tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] snapshot_file for this snap is: volume-d62640e7-473a-4308-91a5-23c93fe32663.2e403a17-4163-47b2-8cdb-ab10207a98e5 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:04:29 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[959195b6-20ea-41b1-abbb-3bb669a54f5b]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:04:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9f65c8f9-e733-4e5a-8bd4-c502ad75d38f tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d62640e7-473a-4308-91a5-23c93fe32663.2e403a17-4163-47b2-8cdb-ab10207a98e5 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:29 devstack sudo[103926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d62640e7-473a-4308-91a5-23c93fe32663.2e403a17-4163-47b2-8cdb-ab10207a98e5 Jul 30 17:04:29 devstack sudo[103926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:29 devstack sudo[103924]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636" returned: 0 in 0.393s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636.d38e005a-5566-4a8f-9ed4-8b8661a1554a 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:30 devstack sudo[103931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636.d38e005a-5566-4a8f-9ed4-8b8661a1554a 1G Jul 30 17:04:30 devstack sudo[103931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:30 devstack sudo[103926]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9f65c8f9-e733-4e5a-8bd4-c502ad75d38f tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d62640e7-473a-4308-91a5-23c93fe32663.2e403a17-4163-47b2-8cdb-ab10207a98e5" returned: 0 in 0.371s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:30 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-9f65c8f9-e733-4e5a-8bd4-c502ad75d38f tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d62640e7-473a-4308-91a5-23c93fe32663(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:04:30 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01b8fcd-8fb0-46d7-8c3a-f4bc9570c6f3]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:04:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9f65c8f9-e733-4e5a-8bd4-c502ad75d38f tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d62640e7-473a-4308-91a5-23c93fe32663 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:30 devstack sudo[103939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d62640e7-473a-4308-91a5-23c93fe32663 Jul 30 17:04:30 devstack sudo[103939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:30 devstack sudo[103931]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636.d38e005a-5566-4a8f-9ed4-8b8661a1554a 1G" returned: 0 in 0.431s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a1e04b9-f06c-43aa-a416-d28077fef636 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636.d38e005a-5566-4a8f-9ed4-8b8661a1554a {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:30 devstack sudo[103943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a1e04b9-f06c-43aa-a416-d28077fef636 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636.d38e005a-5566-4a8f-9ed4-8b8661a1554a Jul 30 17:04:30 devstack sudo[103943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:30 devstack sudo[103939]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9f65c8f9-e733-4e5a-8bd4-c502ad75d38f tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d62640e7-473a-4308-91a5-23c93fe32663" returned: 0 in 0.429s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9f65c8f9-e733-4e5a-8bd4-c502ad75d38f tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d62640e7-473a-4308-91a5-23c93fe32663.2e403a17-4163-47b2-8cdb-ab10207a98e5 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:30 devstack sudo[103953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d62640e7-473a-4308-91a5-23c93fe32663.2e403a17-4163-47b2-8cdb-ab10207a98e5 Jul 30 17:04:30 devstack sudo[103953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:30 devstack sudo[103943]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a1e04b9-f06c-43aa-a416-d28077fef636 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636.d38e005a-5566-4a8f-9ed4-8b8661a1554a" returned: 0 in 0.326s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:30 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636.d38e005a-5566-4a8f-9ed4-8b8661a1554a is being set with open permissions: ugo+rw Jul 30 17:04:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636.d38e005a-5566-4a8f-9ed4-8b8661a1554a {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:30 devstack sudo[103957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636.d38e005a-5566-4a8f-9ed4-8b8661a1554a Jul 30 17:04:30 devstack sudo[103957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:31 devstack sudo[103957]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636.d38e005a-5566-4a8f-9ed4-8b8661a1554a" returned: 0 in 0.286s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:31 devstack sudo[103965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636.info Jul 30 17:04:31 devstack sudo[103965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:31 devstack sudo[103953]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9f65c8f9-e733-4e5a-8bd4-c502ad75d38f tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d62640e7-473a-4308-91a5-23c93fe32663.2e403a17-4163-47b2-8cdb-ab10207a98e5" returned: 0 in 0.484s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9f65c8f9-e733-4e5a-8bd4-c502ad75d38f tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d62640e7-473a-4308-91a5-23c93fe32663.2e403a17-4163-47b2-8cdb-ab10207a98e5 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:31 devstack sudo[103967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d62640e7-473a-4308-91a5-23c93fe32663.2e403a17-4163-47b2-8cdb-ab10207a98e5 Jul 30 17:04:31 devstack sudo[103967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:31 devstack sudo[103965]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636.info" returned: 0 in 0.294s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:31 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636.info is being set with open permissions: ugo+rw Jul 30 17:04:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:31 devstack sudo[103978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636.info Jul 30 17:04:31 devstack sudo[103978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:31 devstack sudo[103967]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9f65c8f9-e733-4e5a-8bd4-c502ad75d38f tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d62640e7-473a-4308-91a5-23c93fe32663.2e403a17-4163-47b2-8cdb-ab10207a98e5" returned: 0 in 0.299s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-fd0122f8-5960-42a8-a659-94d36fa8ce64 req-e199a8c0-8bb3-4e07-a0c4-f866ea282b9a tempest-TestStampPattern-175323318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:04:31 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9f65c8f9-e733-4e5a-8bd4-c502ad75d38f tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Lock "cinder-quobyte-2e403a17-4163-47b2-8cdb-ab10207a98e5" released by "_delete_snapshot" :: held 1.707s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:04:31 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9f65c8f9-e733-4e5a-8bd4-c502ad75d38f tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Lock "cinder-quobyte-d62640e7-473a-4308-91a5-23c93fe32663" released by "delete_snapshot" :: held 1.731s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:04:31 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-9f65c8f9-e733-4e5a-8bd4-c502ad75d38f tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Created reservations ['b6666bb7-0e00-4668-9f5a-2381dfe03327', '8196db56-1eb2-4cb2-bb4b-d19fd648e971', '6de8e84c-9748-4a79-b029-888929613403', '43319467-46c4-4cc5-be5b-9b8a0023f599'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:04:31 devstack sudo[103978]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636.info" returned: 0 in 0.268s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:31 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] Acquiring lock "cinder-quobyte-72895282-ea09-4cf2-bdc5-9b50d06473bb" by "_copy_volume_from_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:04:31 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-9f65c8f9-e733-4e5a-8bd4-c502ad75d38f tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Delete snapshot completed successfully. Jul 30 17:04:31 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] Lock "cinder-quobyte-72895282-ea09-4cf2-bdc5-9b50d06473bb" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:04:31 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] snapshot: d38e005a-5566-4a8f-9ed4-8b8661a1554a, volume: 72895282-ea09-4cf2-bdc5-9b50d06473bb, {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 17:04:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:04:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:04:31 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:04:31 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:04:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:04:31 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9f65c8f9-e733-4e5a-8bd4-c502ad75d38f tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Lock "cinder-2e403a17-4163-47b2-8cdb-ab10207a98e5-delete_snapshot" released by "delete_snapshot" :: held 1.912s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:04:31 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[97556e28-2896-4be8-859e-39109d96aac0]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:04:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636.d38e005a-5566-4a8f-9ed4-8b8661a1554a {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:31 devstack sudo[103982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636.d38e005a-5566-4a8f-9ed4-8b8661a1554a Jul 30 17:04:31 devstack sudo[103982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:32 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d28afb7e-6550-4813-90b0-73327792e592 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Acquiring lock "cinder-d62640e7-473a-4308-91a5-23c93fe32663-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:04:32 devstack sudo[103982]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636.d38e005a-5566-4a8f-9ed4-8b8661a1554a" returned: 0 in 0.379s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:32 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a1e04b9-f06c-43aa-a416-d28077fef636(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:04:32 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d28afb7e-6550-4813-90b0-73327792e592 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Lock "cinder-d62640e7-473a-4308-91a5-23c93fe32663-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:04:32 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d24e373-7f7f-4c5f-86cc-30be32855a1b]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:04:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:32 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d28afb7e-6550-4813-90b0-73327792e592 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Acquiring lock "cinder-quobyte-d62640e7-473a-4308-91a5-23c93fe32663" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:04:32 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d28afb7e-6550-4813-90b0-73327792e592 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Lock "cinder-quobyte-d62640e7-473a-4308-91a5-23c93fe32663" acquired by "delete_volume" :: waited 0.022s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:04:32 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb9159b-ef11-41d5-a564-a326b63afb4e]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:04:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d28afb7e-6550-4813-90b0-73327792e592 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d62640e7-473a-4308-91a5-23c93fe32663 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:32 devstack sudo[103988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636 Jul 30 17:04:32 devstack sudo[103988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:32 devstack sudo[103990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d62640e7-473a-4308-91a5-23c93fe32663 Jul 30 17:04:32 devstack sudo[103990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:32 devstack sudo[103988]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636" returned: 0 in 0.386s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:32 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] will copy from snapshot at /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636 {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 17:04:32 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] Creating direct copy from snapshot {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 17:04:32 devstack cinder-volume[88591]: DEBUG cinder.utils [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] Path /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-72895282-ea09-4cf2-bdc5-9b50d06473bb not found in is_blk_device check {{(pid=88591) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 17:04:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-72895282-ea09-4cf2-bdc5-9b50d06473bb {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:32 devstack sudo[103996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-72895282-ea09-4cf2-bdc5-9b50d06473bb Jul 30 17:04:32 devstack sudo[103996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:32 devstack sudo[103990]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d28afb7e-6550-4813-90b0-73327792e592 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d62640e7-473a-4308-91a5-23c93fe32663" returned: 0 in 0.386s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d28afb7e-6550-4813-90b0-73327792e592 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d62640e7-473a-4308-91a5-23c93fe32663 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:32 devstack sudo[104001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d62640e7-473a-4308-91a5-23c93fe32663 Jul 30 17:04:32 devstack sudo[104001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:32 devstack sudo[104001]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d28afb7e-6550-4813-90b0-73327792e592 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d62640e7-473a-4308-91a5-23c93fe32663" returned: 0 in 0.251s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:32 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d28afb7e-6550-4813-90b0-73327792e592 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Lock "cinder-quobyte-d62640e7-473a-4308-91a5-23c93fe32663" released by "delete_volume" :: held 0.699s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:04:32 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-d28afb7e-6550-4813-90b0-73327792e592 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Created reservations ['62c9280f-543c-430d-9cd4-d83ec0b449e7', '1062ce16-8247-4df1-b3c0-607c10caf2fe', '223ebd4f-5d41-41b6-8322-0325f8979479', '7c846d1f-2a56-4859-a357-201394ab59ff'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:04:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d28afb7e-6550-4813-90b0-73327792e592 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:04:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d28afb7e-6550-4813-90b0-73327792e592 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:04:32 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d28afb7e-6550-4813-90b0-73327792e592 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:04:33 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d28afb7e-6550-4813-90b0-73327792e592 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:04:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d28afb7e-6550-4813-90b0-73327792e592 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:04:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d28afb7e-6550-4813-90b0-73327792e592 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:33 devstack sudo[104008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:04:33 devstack sudo[103996]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:33 devstack sudo[104008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-72895282-ea09-4cf2-bdc5-9b50d06473bb" returned: 0 in 0.535s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:33 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] Image conversion details: src /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-72895282-ea09-4cf2-bdc5-9b50d06473bb {{(pid=88591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 17:04:33 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 30 17:04:33 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-72895282-ea09-4cf2-bdc5-9b50d06473bb is being set with open permissions: ugo+rw Jul 30 17:04:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-72895282-ea09-4cf2-bdc5-9b50d06473bb {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:33 devstack sudo[104010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-72895282-ea09-4cf2-bdc5-9b50d06473bb Jul 30 17:04:33 devstack sudo[104010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:33 devstack sudo[104008]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d28afb7e-6550-4813-90b0-73327792e592 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.267s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:33 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-d28afb7e-6550-4813-90b0-73327792e592 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:04:33 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-d28afb7e-6550-4813-90b0-73327792e592 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Deleted volume successfully. Jul 30 17:04:33 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d28afb7e-6550-4813-90b0-73327792e592 tempest-VolumesSnapshotNegativeTestJSON-1958040267 None] Lock "cinder-d62640e7-473a-4308-91a5-23c93fe32663-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:04:33 devstack sudo[104010]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-72895282-ea09-4cf2-bdc5-9b50d06473bb" returned: 0 in 0.273s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:33 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] Lock "cinder-quobyte-72895282-ea09-4cf2-bdc5-9b50d06473bb" released by "_copy_volume_from_snapshot" :: held 1.648s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:04:33 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] Acquiring lock "cinder-quobyte-d38e005a-5566-4a8f-9ed4-8b8661a1554a" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:04:33 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] Lock "cinder-quobyte-d38e005a-5566-4a8f-9ed4-8b8661a1554a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:04:33 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] Deleting offline snapshot d38e005a-5566-4a8f-9ed4-8b8661a1554a of volume 9a1e04b9-f06c-43aa-a416-d28077fef636 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:04:33 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] snapshot_file for this snap is: volume-9a1e04b9-f06c-43aa-a416-d28077fef636.d38e005a-5566-4a8f-9ed4-8b8661a1554a {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:04:33 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d09081-bf30-43c2-abe5-d91d30b78f45]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:04:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636.d38e005a-5566-4a8f-9ed4-8b8661a1554a {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:33 devstack sudo[104014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636.d38e005a-5566-4a8f-9ed4-8b8661a1554a Jul 30 17:04:33 devstack sudo[104014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:33 devstack sudo[104014]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636.d38e005a-5566-4a8f-9ed4-8b8661a1554a" returned: 0 in 0.375s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:33 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a1e04b9-f06c-43aa-a416-d28077fef636(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:04:33 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bfe4dca-97a9-44e1-97af-7056b003a009]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:04:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:33 devstack sudo[104019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636 Jul 30 17:04:33 devstack sudo[104019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:34 devstack sudo[104019]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636" returned: 0 in 0.419s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636.d38e005a-5566-4a8f-9ed4-8b8661a1554a {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:34 devstack sudo[104025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636.d38e005a-5566-4a8f-9ed4-8b8661a1554a Jul 30 17:04:34 devstack sudo[104025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:34 devstack sudo[104025]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636.d38e005a-5566-4a8f-9ed4-8b8661a1554a" returned: 0 in 0.369s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636.d38e005a-5566-4a8f-9ed4-8b8661a1554a {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:34 devstack sudo[104030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636.d38e005a-5566-4a8f-9ed4-8b8661a1554a Jul 30 17:04:34 devstack sudo[104030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:34 devstack sudo[104030]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636.d38e005a-5566-4a8f-9ed4-8b8661a1554a" returned: 0 in 0.253s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:34 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] Lock "cinder-quobyte-d38e005a-5566-4a8f-9ed4-8b8661a1554a" released by "_delete_snapshot" :: held 1.511s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:04:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 5.407s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:04:34 devstack cinder-volume[88591]: DEBUG cinder.volume.volume_utils [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] Marking volume 72895282-ea09-4cf2-bdc5-9b50d06473bb as bootable. {{(pid=88591) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 30 17:04:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-fd0122f8-5960-42a8-a659-94d36fa8ce64 req-e199a8c0-8bb3-4e07-a0c4-f866ea282b9a tempest-TestStampPattern-175323318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.371s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:04:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-fd0122f8-5960-42a8-a659-94d36fa8ce64 req-e199a8c0-8bb3-4e07-a0c4-f866ea282b9a tempest-TestStampPattern-175323318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:04:34 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] Copying metadata from source volume 9a1e04b9-f06c-43aa-a416-d28077fef636 to 72895282-ea09-4cf2-bdc5-9b50d06473bb. {{(pid=88591) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:438}} Jul 30 17:04:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-fd0122f8-5960-42a8-a659-94d36fa8ce64 req-e199a8c0-8bb3-4e07-a0c4-f866ea282b9a tempest-TestStampPattern-175323318 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202', 'name': 'volume-9990c0c7-e431-40eb-955e-4855b5808fbe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'adee877f-49db-485b-b38a-f6a32d32dfd0', 'enforce_multipath': True} {{(pid=88591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 17:04:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf4ec9c1-5d9a-4a46-8a9e-f0e2e1fff96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72895282-ea09-4cf2-bdc5-9b50d06473bb', 'volume_size': 1, 'source_volid': '9a1e04b9-f06c-43aa-a416-d28077fef636', 'source_volstatus': 'available'}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:04:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (199047c8-2b89-408b-b320-c3c232767ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:04:35 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] Volume volume-72895282-ea09-4cf2-bdc5-9b50d06473bb (72895282-ea09-4cf2-bdc5-9b50d06473bb): created successfully Jul 30 17:04:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (199047c8-2b89-408b-b320-c3c232767ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:04:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] Flow 'volume_create_manager' (356d871a-940f-46a5-a943-02c29ea1006e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:04:35 devstack cinder-volume[88591]: INFO cinder.volume.manager [req-fd0122f8-5960-42a8-a659-94d36fa8ce64 req-e199a8c0-8bb3-4e07-a0c4-f866ea282b9a tempest-TestStampPattern-175323318 None] attachment_update completed successfully. Jul 30 17:04:35 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-02edd59c-5145-4ac8-b1ef-9d1261b050ae tempest-VolumeImageDependencyTests-2064013169 None] Created volume successfully. Jul 30 17:04:35 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b748eb90-0ab5-47f8-a3e7-ca68a3a13bee tempest-VolumeImageDependencyTests-2064013169 None] Acquiring lock "cinder-9a1e04b9-f06c-43aa-a416-d28077fef636-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:04:35 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b748eb90-0ab5-47f8-a3e7-ca68a3a13bee tempest-VolumeImageDependencyTests-2064013169 None] Lock "cinder-9a1e04b9-f06c-43aa-a416-d28077fef636-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:04:35 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b748eb90-0ab5-47f8-a3e7-ca68a3a13bee tempest-VolumeImageDependencyTests-2064013169 None] Acquiring lock "cinder-quobyte-9a1e04b9-f06c-43aa-a416-d28077fef636" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:04:35 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b748eb90-0ab5-47f8-a3e7-ca68a3a13bee tempest-VolumeImageDependencyTests-2064013169 None] Lock "cinder-quobyte-9a1e04b9-f06c-43aa-a416-d28077fef636" acquired by "delete_volume" :: waited 0.019s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:04:35 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e122003e-a078-4b68-9817-45a57f201aa4]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:04:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b748eb90-0ab5-47f8-a3e7-ca68a3a13bee tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:35 devstack sudo[104415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636 Jul 30 17:04:35 devstack sudo[104415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:35 devstack sudo[104415]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b748eb90-0ab5-47f8-a3e7-ca68a3a13bee tempest-VolumeImageDependencyTests-2064013169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636" returned: 0 in 0.451s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b748eb90-0ab5-47f8-a3e7-ca68a3a13bee tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:35 devstack sudo[104423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636 Jul 30 17:04:35 devstack sudo[104423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:36 devstack sudo[104423]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b748eb90-0ab5-47f8-a3e7-ca68a3a13bee tempest-VolumeImageDependencyTests-2064013169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9a1e04b9-f06c-43aa-a416-d28077fef636" returned: 0 in 0.297s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:36 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b748eb90-0ab5-47f8-a3e7-ca68a3a13bee tempest-VolumeImageDependencyTests-2064013169 None] Lock "cinder-quobyte-9a1e04b9-f06c-43aa-a416-d28077fef636" released by "delete_volume" :: held 0.819s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:04:36 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-b748eb90-0ab5-47f8-a3e7-ca68a3a13bee tempest-VolumeImageDependencyTests-2064013169 None] Created reservations ['50027268-46f6-444e-b064-6aaaa4558f22', 'ec7be6b9-2ec2-40a1-ad67-de26cd16c9c3', 'd203b1e4-25be-4d72-bc8b-1374b0f1c2f4', '71000ba8-5230-43b6-99f2-f7977b0e1582'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:04:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b748eb90-0ab5-47f8-a3e7-ca68a3a13bee tempest-VolumeImageDependencyTests-2064013169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:04:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b748eb90-0ab5-47f8-a3e7-ca68a3a13bee tempest-VolumeImageDependencyTests-2064013169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:04:36 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b748eb90-0ab5-47f8-a3e7-ca68a3a13bee tempest-VolumeImageDependencyTests-2064013169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:04:36 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b748eb90-0ab5-47f8-a3e7-ca68a3a13bee tempest-VolumeImageDependencyTests-2064013169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:04:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b748eb90-0ab5-47f8-a3e7-ca68a3a13bee tempest-VolumeImageDependencyTests-2064013169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:04:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b748eb90-0ab5-47f8-a3e7-ca68a3a13bee tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:36 devstack sudo[104426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:04:36 devstack sudo[104426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:36 devstack sudo[104426]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b748eb90-0ab5-47f8-a3e7-ca68a3a13bee tempest-VolumeImageDependencyTests-2064013169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.298s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:36 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-b748eb90-0ab5-47f8-a3e7-ca68a3a13bee tempest-VolumeImageDependencyTests-2064013169 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:04:36 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-b748eb90-0ab5-47f8-a3e7-ca68a3a13bee tempest-VolumeImageDependencyTests-2064013169 None] Deleted volume successfully. Jul 30 17:04:36 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b748eb90-0ab5-47f8-a3e7-ca68a3a13bee tempest-VolumeImageDependencyTests-2064013169 None] Lock "cinder-9a1e04b9-f06c-43aa-a416-d28077fef636-delete_volume" released by "delete_volume" :: held 1.329s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:04:39 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:04:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] Flow 'volume_create_manager' (35154f23-bd71-4237-be75-264f066ddea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:04:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffaeb9cf-57a4-46c0-a253-9cdca6b6c200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:04:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffaeb9cf-57a4-46c0-a253-9cdca6b6c200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-teste6050452-06bd-4c7f-9912-45178c83e379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf6bbc62-ff9c-46f8-861a-d69c7790d121,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0631e3acd97440709a7f85ad9486c675',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:04:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:04:40Z,use_quota=True,user_id='655b75d70817405fb0b3af71e9e06236',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:04:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56446869-0f18-4443-ad8a-8a440b222ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:04:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56446869-0f18-4443-ad8a-8a440b222ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:04:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d0c413d-be9f-449d-9e92-4b673d113e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:04:39 devstack cinder-volume[88591]: DEBUG cinder.image.glance [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] Creating Keystone auth plugin from conf {{(pid=88591) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 30 17:04:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d0c413d-be9f-449d-9e92-4b673d113e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bf6bbc62-ff9c-46f8-861a-d69c7790d121', 'volume_name': 'volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121', 'volume_size': 1, 'image_id': '5cfc80eb-ece6-4080-bb22-fb3a841de0c2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5cfc80eb-ece6-4080-bb22-fb3a841de0c2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-e6050452-06bd-4c7f-9912-45178c83e379', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cd547301cdaa8a4bf15ca753e681f30e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0631e3acd97440709a7f85ad9486c675', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2fc8b46098c90da2d065aade23ed1d0b65987d191e49b1fb269d49ecdeedf57d22675b7a1693951c5506aed9dac95fc52b9e4237966013c7705a117c66e9ff4b', 'id': '5cfc80eb-ece6-4080-bb22-fb3a841de0c2', 'created_at': datetime.datetime(2026, 7, 30, 15, 4, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 15, 4, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5cfc80eb-ece6-4080-bb22-fb3a841de0c2/file', 'properties': {}}, 'image_service': }' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:04:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76de9aa9-0804-4ca8-8c3d-111cdb2c0932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:04:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76de9aa9-0804-4ca8-8c3d-111cdb2c0932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:04:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed13bc6d-4f6b-4bfa-91bf-d9ec3d45ddd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:04:40 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] Volume bf6bbc62-ff9c-46f8-861a-d69c7790d121: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121', 'volume_size': 1, 'image_id': '5cfc80eb-ece6-4080-bb22-fb3a841de0c2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5cfc80eb-ece6-4080-bb22-fb3a841de0c2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-e6050452-06bd-4c7f-9912-45178c83e379', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cd547301cdaa8a4bf15ca753e681f30e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0631e3acd97440709a7f85ad9486c675', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2fc8b46098c90da2d065aade23ed1d0b65987d191e49b1fb269d49ecdeedf57d22675b7a1693951c5506aed9dac95fc52b9e4237966013c7705a117c66e9ff4b', 'id': '5cfc80eb-ece6-4080-bb22-fb3a841de0c2', 'created_at': datetime.datetime(2026, 7, 30, 15, 4, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 15, 4, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5cfc80eb-ece6-4080-bb22-fb3a841de0c2/file', 'properties': {}}, 'image_service': } Jul 30 17:04:40 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] Trying to clone bf6bbc62-ff9c-46f8-861a-d69c7790d121 from image 5cfc80eb-ece6-4080-bb22-fb3a841de0c2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5cfc80eb-ece6-4080-bb22-fb3a841de0c2', 'metadata': {}}]). {{(pid=88591) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 30 17:04:40 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5cfc80eb-ece6-4080-bb22-fb3a841de0c2_2yj91ki5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88591) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 30 17:04:40 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] Image download 0.00 MB at 0.00 MB/s Jul 30 17:04:40 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc1f5a9-b3b9-4efd-b118-f12be8bccb3c]: (4, 'raw') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:04:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5cfc80eb-ece6-4080-bb22-fb3a841de0c2_2yj91ki5devstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:40 devstack sudo[104452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5cfc80eb-ece6-4080-bb22-fb3a841de0c2_2yj91ki5devstack@QuobyteHD Jul 30 17:04:40 devstack sudo[104452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:40 devstack cinder-volume[88591]: INFO cinder.volume.manager [req-c8bcb87a-1140-4a55-b9c6-6c8752ddb2ed req-6a0db72c-b229-4d12-a869-00bc52477153 tempest-TestStampPattern-175323318 None] Terminate volume connection completed successfully. Jul 30 17:04:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-c8bcb87a-1140-4a55-b9c6-6c8752ddb2ed req-6a0db72c-b229-4d12-a869-00bc52477153 tempest-TestStampPattern-175323318 None] Deleting attachment adee877f-49db-485b-b38a-f6a32d32dfd0. {{(pid=88591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 17:04:40 devstack sudo[104452]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5cfc80eb-ece6-4080-bb22-fb3a841de0c2_2yj91ki5devstack@QuobyteHD" returned: 0 in 0.522s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5cfc80eb-ece6-4080-bb22-fb3a841de0c2_2yj91ki5devstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:41 devstack sudo[104486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5cfc80eb-ece6-4080-bb22-fb3a841de0c2_2yj91ki5devstack@QuobyteHD Jul 30 17:04:41 devstack sudo[104486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:41 devstack sudo[104486]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5cfc80eb-ece6-4080-bb22-fb3a841de0c2_2yj91ki5devstack@QuobyteHD" returned: 1 in 0.375s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5cfc80eb-ece6-4080-bb22-fb3a841de0c2_2yj91ki5devstack@QuobyteHD' failed. Not Retrying. {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 17:04:41 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] Temporary image 5cfc80eb-ece6-4080-bb22-fb3a841de0c2 is fetched for user 655b75d70817405fb0b3af71e9e06236. {{(pid=88591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 30 17:04:41 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ef604b-c154-4aa4-aa3f-9532b584f1f7]: (4, 'raw') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:04:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5cfc80eb-ece6-4080-bb22-fb3a841de0c2_2yj91ki5devstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:41 devstack sudo[104491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5cfc80eb-ece6-4080-bb22-fb3a841de0c2_2yj91ki5devstack@QuobyteHD Jul 30 17:04:41 devstack sudo[104491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0e17423c-cc87-423c-ad77-7f1189813c66 tempest-TestStampPattern-175323318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:04:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0e17423c-cc87-423c-ad77-7f1189813c66 tempest-TestStampPattern-175323318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:04:41 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-0e17423c-cc87-423c-ad77-7f1189813c66 tempest-TestStampPattern-175323318 None] Creating offline snapshot a4263675-7926-418f-bdef-be8a8ad9aa91 of volume 9990c0c7-e431-40eb-955e-4855b5808fbe {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:04:41 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[22071bad-fe45-4cb2-a226-748890b9cac9]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:04:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0e17423c-cc87-423c-ad77-7f1189813c66 tempest-TestStampPattern-175323318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9990c0c7-e431-40eb-955e-4855b5808fbe {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:41 devstack sudo[104491]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5cfc80eb-ece6-4080-bb22-fb3a841de0c2_2yj91ki5devstack@QuobyteHD" returned: 0 in 0.375s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5cfc80eb-ece6-4080-bb22-fb3a841de0c2_2yj91ki5devstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:41 devstack sudo[104493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9990c0c7-e431-40eb-955e-4855b5808fbe Jul 30 17:04:41 devstack sudo[104493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:41 devstack sudo[104496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5cfc80eb-ece6-4080-bb22-fb3a841de0c2_2yj91ki5devstack@QuobyteHD Jul 30 17:04:41 devstack sudo[104496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:42 devstack sudo[104493]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0e17423c-cc87-423c-ad77-7f1189813c66 tempest-TestStampPattern-175323318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9990c0c7-e431-40eb-955e-4855b5808fbe" returned: 0 in 0.385s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0e17423c-cc87-423c-ad77-7f1189813c66 tempest-TestStampPattern-175323318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9990c0c7-e431-40eb-955e-4855b5808fbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9990c0c7-e431-40eb-955e-4855b5808fbe.a4263675-7926-418f-bdef-be8a8ad9aa91 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:42 devstack sudo[104505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9990c0c7-e431-40eb-955e-4855b5808fbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9990c0c7-e431-40eb-955e-4855b5808fbe.a4263675-7926-418f-bdef-be8a8ad9aa91 1G Jul 30 17:04:42 devstack sudo[104505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:42 devstack sudo[104496]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5cfc80eb-ece6-4080-bb22-fb3a841de0c2_2yj91ki5devstack@QuobyteHD" returned: 1 in 0.345s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5cfc80eb-ece6-4080-bb22-fb3a841de0c2_2yj91ki5devstack@QuobyteHD' failed. Not Retrying. {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 17:04:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:04:42 devstack sudo[104505]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0e17423c-cc87-423c-ad77-7f1189813c66 tempest-TestStampPattern-175323318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9990c0c7-e431-40eb-955e-4855b5808fbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9990c0c7-e431-40eb-955e-4855b5808fbe.a4263675-7926-418f-bdef-be8a8ad9aa91 1G" returned: 0 in 0.438s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0e17423c-cc87-423c-ad77-7f1189813c66 tempest-TestStampPattern-175323318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9990c0c7-e431-40eb-955e-4855b5808fbe -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9990c0c7-e431-40eb-955e-4855b5808fbe.a4263675-7926-418f-bdef-be8a8ad9aa91 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:42 devstack sudo[104511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9990c0c7-e431-40eb-955e-4855b5808fbe -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9990c0c7-e431-40eb-955e-4855b5808fbe.a4263675-7926-418f-bdef-be8a8ad9aa91 Jul 30 17:04:42 devstack sudo[104511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:42 devstack sudo[104511]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0e17423c-cc87-423c-ad77-7f1189813c66 tempest-TestStampPattern-175323318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9990c0c7-e431-40eb-955e-4855b5808fbe -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9990c0c7-e431-40eb-955e-4855b5808fbe.a4263675-7926-418f-bdef-be8a8ad9aa91" returned: 0 in 0.338s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:42 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-0e17423c-cc87-423c-ad77-7f1189813c66 tempest-TestStampPattern-175323318 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9990c0c7-e431-40eb-955e-4855b5808fbe.a4263675-7926-418f-bdef-be8a8ad9aa91 is being set with open permissions: ugo+rw Jul 30 17:04:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0e17423c-cc87-423c-ad77-7f1189813c66 tempest-TestStampPattern-175323318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9990c0c7-e431-40eb-955e-4855b5808fbe.a4263675-7926-418f-bdef-be8a8ad9aa91 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:42 devstack sudo[104517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9990c0c7-e431-40eb-955e-4855b5808fbe.a4263675-7926-418f-bdef-be8a8ad9aa91 Jul 30 17:04:42 devstack sudo[104517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:43 devstack sudo[104517]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0e17423c-cc87-423c-ad77-7f1189813c66 tempest-TestStampPattern-175323318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9990c0c7-e431-40eb-955e-4855b5808fbe.a4263675-7926-418f-bdef-be8a8ad9aa91" returned: 0 in 0.298s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0e17423c-cc87-423c-ad77-7f1189813c66 tempest-TestStampPattern-175323318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9990c0c7-e431-40eb-955e-4855b5808fbe.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:43 devstack sudo[104520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9990c0c7-e431-40eb-955e-4855b5808fbe.info Jul 30 17:04:43 devstack sudo[104520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:43 devstack sudo[104520]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0e17423c-cc87-423c-ad77-7f1189813c66 tempest-TestStampPattern-175323318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9990c0c7-e431-40eb-955e-4855b5808fbe.info" returned: 0 in 0.313s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:43 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-0e17423c-cc87-423c-ad77-7f1189813c66 tempest-TestStampPattern-175323318 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9990c0c7-e431-40eb-955e-4855b5808fbe.info is being set with open permissions: ugo+rw Jul 30 17:04:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0e17423c-cc87-423c-ad77-7f1189813c66 tempest-TestStampPattern-175323318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9990c0c7-e431-40eb-955e-4855b5808fbe.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:43 devstack sudo[104523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9990c0c7-e431-40eb-955e-4855b5808fbe.info Jul 30 17:04:43 devstack sudo[104523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:43 devstack sudo[104523]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0e17423c-cc87-423c-ad77-7f1189813c66 tempest-TestStampPattern-175323318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9990c0c7-e431-40eb-955e-4855b5808fbe.info" returned: 0 in 0.271s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0e17423c-cc87-423c-ad77-7f1189813c66 tempest-TestStampPattern-175323318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.169s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:04:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.709s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:04:43 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-teste6050452-06bd-4c7f-9912-45178c83e379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf6bbc62-ff9c-46f8-861a-d69c7790d121,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0631e3acd97440709a7f85ad9486c675',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:04:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:04:40Z,use_quota=True,user_id='655b75d70817405fb0b3af71e9e06236',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:04:43 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] Creating volume bf6bbc62-ff9c-46f8-861a-d69c7790d121 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:04:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:04:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:04:43 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:04:43 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:04:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:04:43 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:04:43 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:04:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:43 devstack sudo[104526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121 1073741824 Jul 30 17:04:43 devstack sudo[104526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:43 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-0e17423c-cc87-423c-ad77-7f1189813c66 tempest-TestStampPattern-175323318 None] Create snapshot completed successfully Jul 30 17:04:44 devstack sudo[104526]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121 1073741824" returned: 0 in 0.486s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:44 devstack sudo[104532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121 Jul 30 17:04:44 devstack sudo[104532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:44 devstack sudo[104532]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121" returned: 0 in 0.261s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:44 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:04:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:04:44 devstack cinder-volume[88591]: DEBUG cinder.volume.volume_utils [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] Attempting download of 5cfc80eb-ece6-4080-bb22-fb3a841de0c2 ((None, [{'url': 'file:///opt/stack/data/glance/images/5cfc80eb-ece6-4080-bb22-fb3a841de0c2', 'metadata': {}}])) to volume bf6bbc62-ff9c-46f8-861a-d69c7790d121. {{(pid=88591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 30 17:04:44 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[3faa3ff3-3ee7-4d1e-a168-411864664743]: (4, 'raw') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:04:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5cfc80eb-ece6-4080-bb22-fb3a841de0c2_2pdzvc5e {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:44 devstack sudo[104535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5cfc80eb-ece6-4080-bb22-fb3a841de0c2_2pdzvc5e Jul 30 17:04:44 devstack sudo[104535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:45 devstack sudo[104535]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5cfc80eb-ece6-4080-bb22-fb3a841de0c2_2pdzvc5e" returned: 0 in 0.376s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5cfc80eb-ece6-4080-bb22-fb3a841de0c2_2pdzvc5e {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:45 devstack sudo[104539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5cfc80eb-ece6-4080-bb22-fb3a841de0c2_2pdzvc5e Jul 30 17:04:45 devstack sudo[104539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:45 devstack sudo[104539]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5cfc80eb-ece6-4080-bb22-fb3a841de0c2_2pdzvc5e" returned: 1 in 0.384s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5cfc80eb-ece6-4080-bb22-fb3a841de0c2_2pdzvc5e' failed. Not Retrying. {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 17:04:45 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d0a2ea-2758-4de8-a36e-29161c9ada7b]: (4, 'raw') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:04:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5cfc80eb-ece6-4080-bb22-fb3a841de0c2_2yj91ki5devstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:45 devstack sudo[104543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5cfc80eb-ece6-4080-bb22-fb3a841de0c2_2yj91ki5devstack@QuobyteHD Jul 30 17:04:45 devstack sudo[104543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:45 devstack sudo[104543]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5cfc80eb-ece6-4080-bb22-fb3a841de0c2_2yj91ki5devstack@QuobyteHD" returned: 0 in 0.404s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5cfc80eb-ece6-4080-bb22-fb3a841de0c2_2yj91ki5devstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:46 devstack sudo[104547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5cfc80eb-ece6-4080-bb22-fb3a841de0c2_2yj91ki5devstack@QuobyteHD Jul 30 17:04:46 devstack sudo[104547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:46 devstack sudo[104547]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5cfc80eb-ece6-4080-bb22-fb3a841de0c2_2yj91ki5devstack@QuobyteHD" returned: 1 in 0.447s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5cfc80eb-ece6-4080-bb22-fb3a841de0c2_2yj91ki5devstack@QuobyteHD' failed. Not Retrying. {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 17:04:46 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] 5cfc80eb-ece6-4080-bb22-fb3a841de0c2 was raw, converting to qcow2 {{(pid=88591) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 30 17:04:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5cfc80eb-ece6-4080-bb22-fb3a841de0c2_2yj91ki5devstack@QuobyteHD /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:46 devstack sudo[104552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5cfc80eb-ece6-4080-bb22-fb3a841de0c2_2yj91ki5devstack@QuobyteHD /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121 Jul 30 17:04:46 devstack sudo[104552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:46 devstack sudo[104552]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5cfc80eb-ece6-4080-bb22-fb3a841de0c2_2yj91ki5devstack@QuobyteHD /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121" returned: 0 in 0.596s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:46 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5cfc80eb-ece6-4080-bb22-fb3a841de0c2_2yj91ki5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121 {{(pid=88591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 17:04:46 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] Converted 0.00 MB image at 0.00 MB/s Jul 30 17:04:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:47 devstack sudo[104566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121 1G Jul 30 17:04:47 devstack sudo[104566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:47 devstack sudo[104566]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121 1G" returned: 0 in 0.429s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:47 devstack cinder-volume[88591]: DEBUG cinder.volume.volume_utils [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] Downloaded image 5cfc80eb-ece6-4080-bb22-fb3a841de0c2 ((None, [{'url': 'file:///opt/stack/data/glance/images/5cfc80eb-ece6-4080-bb22-fb3a841de0c2', 'metadata': {}}])) to volume bf6bbc62-ff9c-46f8-861a-d69c7790d121 successfully. {{(pid=88591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 30 17:04:47 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] Temporary image 5cfc80eb-ece6-4080-bb22-fb3a841de0c2 for user 655b75d70817405fb0b3af71e9e06236 is deleted. {{(pid=88591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 30 17:04:47 devstack cinder-volume[88591]: DEBUG cinder.volume.volume_utils [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] Marking volume bf6bbc62-ff9c-46f8-861a-d69c7790d121 as bootable. {{(pid=88591) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 30 17:04:47 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] Copying metadata from image 5cfc80eb-ece6-4080-bb22-fb3a841de0c2 to bf6bbc62-ff9c-46f8-861a-d69c7790d121. {{(pid=88591) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 30 17:04:47 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] Creating volume glance metadata for volume bf6bbc62-ff9c-46f8-861a-d69c7790d121 backed by image 5cfc80eb-ece6-4080-bb22-fb3a841de0c2 with: {'image_id': '5cfc80eb-ece6-4080-bb22-fb3a841de0c2', 'image_name': 'image-for-test-e6050452-06bd-4c7f-9912-45178c83e379', 'checksum': 'cd547301cdaa8a4bf15ca753e681f30e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88591) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 30 17:04:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed13bc6d-4f6b-4bfa-91bf-d9ec3d45ddd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121', 'volume_size': 1, 'image_id': '5cfc80eb-ece6-4080-bb22-fb3a841de0c2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5cfc80eb-ece6-4080-bb22-fb3a841de0c2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-e6050452-06bd-4c7f-9912-45178c83e379', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cd547301cdaa8a4bf15ca753e681f30e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0631e3acd97440709a7f85ad9486c675', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2fc8b46098c90da2d065aade23ed1d0b65987d191e49b1fb269d49ecdeedf57d22675b7a1693951c5506aed9dac95fc52b9e4237966013c7705a117c66e9ff4b', 'id': '5cfc80eb-ece6-4080-bb22-fb3a841de0c2', 'created_at': datetime.datetime(2026, 7, 30, 15, 4, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 15, 4, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5cfc80eb-ece6-4080-bb22-fb3a841de0c2/file', 'properties': {}}, 'image_service': }' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:04:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b725d39b-6b51-4195-9468-f5185099f8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:04:47 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] Volume volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121 (bf6bbc62-ff9c-46f8-861a-d69c7790d121): created successfully Jul 30 17:04:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b725d39b-6b51-4195-9468-f5185099f8ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:04:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] Flow 'volume_create_manager' (35154f23-bd71-4237-be75-264f066ddea9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:04:47 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-94a6df73-9b23-4c8d-b058-ac07f687a6af tempest-VolumeImageDependencyTests-2064013169 None] Created volume successfully. Jul 30 17:04:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-4416f266-baa8-4b97-8b3e-c4603bf36433 tempest-VolumeImageDependencyTests-2064013169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:04:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-4416f266-baa8-4b97-8b3e-c4603bf36433 tempest-VolumeImageDependencyTests-2064013169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:04:48 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-4416f266-baa8-4b97-8b3e-c4603bf36433 tempest-VolumeImageDependencyTests-2064013169 None] Creating offline snapshot 3ee1fe22-5f46-4ce8-944a-003044862e72 of volume bf6bbc62-ff9c-46f8-861a-d69c7790d121 {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:04:48 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea4a5fb-e122-460f-81f7-30d9584032c4]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:04:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4416f266-baa8-4b97-8b3e-c4603bf36433 tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:48 devstack sudo[104598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121 Jul 30 17:04:48 devstack sudo[104598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:49 devstack sudo[104598]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4416f266-baa8-4b97-8b3e-c4603bf36433 tempest-VolumeImageDependencyTests-2064013169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121" returned: 0 in 0.440s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4416f266-baa8-4b97-8b3e-c4603bf36433 tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121.3ee1fe22-5f46-4ce8-944a-003044862e72 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:49 devstack sudo[104603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121.3ee1fe22-5f46-4ce8-944a-003044862e72 1G Jul 30 17:04:49 devstack sudo[104603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:49 devstack sudo[104603]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4416f266-baa8-4b97-8b3e-c4603bf36433 tempest-VolumeImageDependencyTests-2064013169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121.3ee1fe22-5f46-4ce8-944a-003044862e72 1G" returned: 0 in 0.512s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4416f266-baa8-4b97-8b3e-c4603bf36433 tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121.3ee1fe22-5f46-4ce8-944a-003044862e72 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:49 devstack sudo[104609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121.3ee1fe22-5f46-4ce8-944a-003044862e72 Jul 30 17:04:49 devstack sudo[104609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:50 devstack sudo[104609]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4416f266-baa8-4b97-8b3e-c4603bf36433 tempest-VolumeImageDependencyTests-2064013169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121.3ee1fe22-5f46-4ce8-944a-003044862e72" returned: 0 in 0.373s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:50 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-4416f266-baa8-4b97-8b3e-c4603bf36433 tempest-VolumeImageDependencyTests-2064013169 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121.3ee1fe22-5f46-4ce8-944a-003044862e72 is being set with open permissions: ugo+rw Jul 30 17:04:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4416f266-baa8-4b97-8b3e-c4603bf36433 tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121.3ee1fe22-5f46-4ce8-944a-003044862e72 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:50 devstack sudo[104614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121.3ee1fe22-5f46-4ce8-944a-003044862e72 Jul 30 17:04:50 devstack sudo[104614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:50 devstack sudo[104614]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4416f266-baa8-4b97-8b3e-c4603bf36433 tempest-VolumeImageDependencyTests-2064013169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121.3ee1fe22-5f46-4ce8-944a-003044862e72" returned: 0 in 0.302s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4416f266-baa8-4b97-8b3e-c4603bf36433 tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:50 devstack sudo[104619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121.info Jul 30 17:04:50 devstack sudo[104619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:50 devstack sudo[104619]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4416f266-baa8-4b97-8b3e-c4603bf36433 tempest-VolumeImageDependencyTests-2064013169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121.info" returned: 0 in 0.371s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:50 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-4416f266-baa8-4b97-8b3e-c4603bf36433 tempest-VolumeImageDependencyTests-2064013169 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121.info is being set with open permissions: ugo+rw Jul 30 17:04:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4416f266-baa8-4b97-8b3e-c4603bf36433 tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:50 devstack sudo[104660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121.info Jul 30 17:04:50 devstack sudo[104660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:51 devstack sudo[104660]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4416f266-baa8-4b97-8b3e-c4603bf36433 tempest-VolumeImageDependencyTests-2064013169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121.info" returned: 0 in 0.363s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-4416f266-baa8-4b97-8b3e-c4603bf36433 tempest-VolumeImageDependencyTests-2064013169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.467s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:04:51 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-4416f266-baa8-4b97-8b3e-c4603bf36433 tempest-VolumeImageDependencyTests-2064013169 None] Create snapshot completed successfully Jul 30 17:04:52 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c701770-24cc-4e4e-ab6c-02e3513ff860 tempest-VolumeImageDependencyTests-2064013169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:04:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-9c701770-24cc-4e4e-ab6c-02e3513ff860 tempest-VolumeImageDependencyTests-2064013169 None] Flow 'volume_create_manager' (d134d4f5-0643-4d5e-8b5d-af7f5eb7367a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:04:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-9c701770-24cc-4e4e-ab6c-02e3513ff860 tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34137cdc-9ffc-4142-bf0f-dc66e5f0cb75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:04:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-9c701770-24cc-4e4e-ab6c-02e3513ff860 tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34137cdc-9ffc-4142-bf0f-dc66e5f0cb75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:04:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume2-for-test-e6050452-06bd-4c7f-9912-45178c83e379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8729502-6de1-413c-b502-c074e83ac3f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0631e3acd97440709a7f85ad9486c675',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:04:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3ee1fe22-5f46-4ce8-944a-003044862e72,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:04:53Z,use_quota=True,user_id='655b75d70817405fb0b3af71e9e06236',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:04:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-9c701770-24cc-4e4e-ab6c-02e3513ff860 tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (592e5ef4-4e86-4194-b0ac-e8c4aec89ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:04:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-9c701770-24cc-4e4e-ab6c-02e3513ff860 tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (592e5ef4-4e86-4194-b0ac-e8c4aec89ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:04:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-9c701770-24cc-4e4e-ab6c-02e3513ff860 tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ecde123-31ed-4b1a-8bab-27a7b1e46725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:04:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-9c701770-24cc-4e4e-ab6c-02e3513ff860 tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ecde123-31ed-4b1a-8bab-27a7b1e46725) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b8729502-6de1-413c-b502-c074e83ac3f9', 'volume_name': 'volume-b8729502-6de1-413c-b502-c074e83ac3f9', 'volume_size': 1, 'snapshot_id': '3ee1fe22-5f46-4ce8-944a-003044862e72'}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:04:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-9c701770-24cc-4e4e-ab6c-02e3513ff860 tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (340dd09c-6ed1-4d44-b89d-2efd7071e6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:04:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-9c701770-24cc-4e4e-ab6c-02e3513ff860 tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (340dd09c-6ed1-4d44-b89d-2efd7071e6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:04:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-9c701770-24cc-4e4e-ab6c-02e3513ff860 tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae26796e-3f74-4d1f-92d5-53753ca2d8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:04:52 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-9c701770-24cc-4e4e-ab6c-02e3513ff860 tempest-VolumeImageDependencyTests-2064013169 None] Volume b8729502-6de1-413c-b502-c074e83ac3f9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b8729502-6de1-413c-b502-c074e83ac3f9', 'volume_size': 1, 'snapshot_id': '3ee1fe22-5f46-4ce8-944a-003044862e72'} Jul 30 17:04:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-9c701770-24cc-4e4e-ab6c-02e3513ff860 tempest-VolumeImageDependencyTests-2064013169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:04:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-9c701770-24cc-4e4e-ab6c-02e3513ff860 tempest-VolumeImageDependencyTests-2064013169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.004s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:04:52 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9c701770-24cc-4e4e-ab6c-02e3513ff860 tempest-VolumeImageDependencyTests-2064013169 None] Acquiring lock "cinder-quobyte-3ee1fe22-5f46-4ce8-944a-003044862e72-b8729502-6de1-413c-b502-c074e83ac3f9" by "_create_volume_from_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:04:52 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9c701770-24cc-4e4e-ab6c-02e3513ff860 tempest-VolumeImageDependencyTests-2064013169 None] Lock "cinder-quobyte-3ee1fe22-5f46-4ce8-944a-003044862e72-b8729502-6de1-413c-b502-c074e83ac3f9" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:04:52 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-9c701770-24cc-4e4e-ab6c-02e3513ff860 tempest-VolumeImageDependencyTests-2064013169 None] Creating volume b8729502-6de1-413c-b502-c074e83ac3f9 from snapshot 3ee1fe22-5f46-4ce8-944a-003044862e72 {{(pid=88591) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 30 17:04:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-9c701770-24cc-4e4e-ab6c-02e3513ff860 tempest-VolumeImageDependencyTests-2064013169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:04:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-9c701770-24cc-4e4e-ab6c-02e3513ff860 tempest-VolumeImageDependencyTests-2064013169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:04:52 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-9c701770-24cc-4e4e-ab6c-02e3513ff860 tempest-VolumeImageDependencyTests-2064013169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:04:52 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-9c701770-24cc-4e4e-ab6c-02e3513ff860 tempest-VolumeImageDependencyTests-2064013169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:04:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-9c701770-24cc-4e4e-ab6c-02e3513ff860 tempest-VolumeImageDependencyTests-2064013169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:04:52 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-9c701770-24cc-4e4e-ab6c-02e3513ff860 tempest-VolumeImageDependencyTests-2064013169 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:04:52 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9c701770-24cc-4e4e-ab6c-02e3513ff860 tempest-VolumeImageDependencyTests-2064013169 None] Acquiring lock "cinder-quobyte-b8729502-6de1-413c-b502-c074e83ac3f9" by "_copy_volume_from_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:04:52 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9c701770-24cc-4e4e-ab6c-02e3513ff860 tempest-VolumeImageDependencyTests-2064013169 None] Lock "cinder-quobyte-b8729502-6de1-413c-b502-c074e83ac3f9" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:04:52 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-9c701770-24cc-4e4e-ab6c-02e3513ff860 tempest-VolumeImageDependencyTests-2064013169 None] snapshot: 3ee1fe22-5f46-4ce8-944a-003044862e72, volume: b8729502-6de1-413c-b502-c074e83ac3f9, {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 17:04:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-9c701770-24cc-4e4e-ab6c-02e3513ff860 tempest-VolumeImageDependencyTests-2064013169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:04:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-9c701770-24cc-4e4e-ab6c-02e3513ff860 tempest-VolumeImageDependencyTests-2064013169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:04:52 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-9c701770-24cc-4e4e-ab6c-02e3513ff860 tempest-VolumeImageDependencyTests-2064013169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:04:52 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-9c701770-24cc-4e4e-ab6c-02e3513ff860 tempest-VolumeImageDependencyTests-2064013169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:04:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-9c701770-24cc-4e4e-ab6c-02e3513ff860 tempest-VolumeImageDependencyTests-2064013169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:04:52 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b482cb9-4aca-481f-bc30-61e15d3f869d]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:04:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9c701770-24cc-4e4e-ab6c-02e3513ff860 tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121.3ee1fe22-5f46-4ce8-944a-003044862e72 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:53 devstack sudo[104666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121.3ee1fe22-5f46-4ce8-944a-003044862e72 Jul 30 17:04:53 devstack sudo[104666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:53 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7db73dc-628a-4edc-9987-dec8be8217a1 tempest-TestStampPattern-175323318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:04:53 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d7db73dc-628a-4edc-9987-dec8be8217a1 tempest-TestStampPattern-175323318 None] Flow 'volume_create_manager' (8e23942e-50ad-4ea5-90b5-ef7399c726fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:04:53 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d7db73dc-628a-4edc-9987-dec8be8217a1 tempest-TestStampPattern-175323318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61d813d5-7e5a-4c90-8c1a-e985ad24c6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:04:53 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d7db73dc-628a-4edc-9987-dec8be8217a1 tempest-TestStampPattern-175323318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61d813d5-7e5a-4c90-8c1a-e985ad24c6fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:04:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-267035463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5154fcd-fff4-4ad4-a37e-ebe77bc53d76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c94e08bf91ca4423a295c1e871454261',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:04:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a4263675-7926-418f-bdef-be8a8ad9aa91,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:04:53Z,use_quota=True,user_id='4e516471898e4322a0a745d8404b621c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:04:53 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d7db73dc-628a-4edc-9987-dec8be8217a1 tempest-TestStampPattern-175323318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e388ae6d-9c7c-4cc6-8d67-bec16e051446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:04:53 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d7db73dc-628a-4edc-9987-dec8be8217a1 tempest-TestStampPattern-175323318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e388ae6d-9c7c-4cc6-8d67-bec16e051446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:04:53 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d7db73dc-628a-4edc-9987-dec8be8217a1 tempest-TestStampPattern-175323318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3f2f0c8-ccf2-4e91-89d0-e1d4e83adeb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:04:53 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d7db73dc-628a-4edc-9987-dec8be8217a1 tempest-TestStampPattern-175323318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3f2f0c8-ccf2-4e91-89d0-e1d4e83adeb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd5154fcd-fff4-4ad4-a37e-ebe77bc53d76', 'volume_name': 'volume-d5154fcd-fff4-4ad4-a37e-ebe77bc53d76', 'volume_size': 1, 'snapshot_id': 'a4263675-7926-418f-bdef-be8a8ad9aa91'}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:04:53 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d7db73dc-628a-4edc-9987-dec8be8217a1 tempest-TestStampPattern-175323318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70b3bcc5-3f2d-4cb4-9ade-08f77c395b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:04:53 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d7db73dc-628a-4edc-9987-dec8be8217a1 tempest-TestStampPattern-175323318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70b3bcc5-3f2d-4cb4-9ade-08f77c395b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:04:53 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d7db73dc-628a-4edc-9987-dec8be8217a1 tempest-TestStampPattern-175323318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83c73175-ef9c-401e-976d-f3a02f5e69b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:04:53 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-d7db73dc-628a-4edc-9987-dec8be8217a1 tempest-TestStampPattern-175323318 None] Volume d5154fcd-fff4-4ad4-a37e-ebe77bc53d76: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d5154fcd-fff4-4ad4-a37e-ebe77bc53d76', 'volume_size': 1, 'snapshot_id': 'a4263675-7926-418f-bdef-be8a8ad9aa91'} Jul 30 17:04:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d7db73dc-628a-4edc-9987-dec8be8217a1 tempest-TestStampPattern-175323318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:04:53 devstack sudo[104666]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9c701770-24cc-4e4e-ab6c-02e3513ff860 tempest-VolumeImageDependencyTests-2064013169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121.3ee1fe22-5f46-4ce8-944a-003044862e72" returned: 0 in 0.481s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:53 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-9c701770-24cc-4e4e-ab6c-02e3513ff860 tempest-VolumeImageDependencyTests-2064013169 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:04:53 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c8d7f9-d250-498f-b3cd-38367d9e8037]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:04:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9c701770-24cc-4e4e-ab6c-02e3513ff860 tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:53 devstack sudo[104672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121 Jul 30 17:04:53 devstack sudo[104672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:53 devstack sudo[104672]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9c701770-24cc-4e4e-ab6c-02e3513ff860 tempest-VolumeImageDependencyTests-2064013169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121" returned: 0 in 0.431s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:53 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-9c701770-24cc-4e4e-ab6c-02e3513ff860 tempest-VolumeImageDependencyTests-2064013169 None] will copy from snapshot at /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121 {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 17:04:53 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-9c701770-24cc-4e4e-ab6c-02e3513ff860 tempest-VolumeImageDependencyTests-2064013169 None] Creating direct copy from snapshot {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 17:04:53 devstack cinder-volume[88591]: DEBUG cinder.utils [None req-9c701770-24cc-4e4e-ab6c-02e3513ff860 tempest-VolumeImageDependencyTests-2064013169 None] Path /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b8729502-6de1-413c-b502-c074e83ac3f9 not found in is_blk_device check {{(pid=88591) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 17:04:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9c701770-24cc-4e4e-ab6c-02e3513ff860 tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b8729502-6de1-413c-b502-c074e83ac3f9 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:53 devstack sudo[104678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b8729502-6de1-413c-b502-c074e83ac3f9 Jul 30 17:04:53 devstack sudo[104678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:54 devstack sudo[104678]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9c701770-24cc-4e4e-ab6c-02e3513ff860 tempest-VolumeImageDependencyTests-2064013169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b8729502-6de1-413c-b502-c074e83ac3f9" returned: 0 in 0.674s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:54 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-9c701770-24cc-4e4e-ab6c-02e3513ff860 tempest-VolumeImageDependencyTests-2064013169 None] Image conversion details: src /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b8729502-6de1-413c-b502-c074e83ac3f9 {{(pid=88591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 17:04:54 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-9c701770-24cc-4e4e-ab6c-02e3513ff860 tempest-VolumeImageDependencyTests-2064013169 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 30 17:04:54 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-9c701770-24cc-4e4e-ab6c-02e3513ff860 tempest-VolumeImageDependencyTests-2064013169 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b8729502-6de1-413c-b502-c074e83ac3f9 is being set with open permissions: ugo+rw Jul 30 17:04:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9c701770-24cc-4e4e-ab6c-02e3513ff860 tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b8729502-6de1-413c-b502-c074e83ac3f9 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:54 devstack sudo[104688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b8729502-6de1-413c-b502-c074e83ac3f9 Jul 30 17:04:54 devstack sudo[104688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:54 devstack sudo[104688]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9c701770-24cc-4e4e-ab6c-02e3513ff860 tempest-VolumeImageDependencyTests-2064013169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b8729502-6de1-413c-b502-c074e83ac3f9" returned: 0 in 0.317s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:54 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9c701770-24cc-4e4e-ab6c-02e3513ff860 tempest-VolumeImageDependencyTests-2064013169 None] Lock "cinder-quobyte-b8729502-6de1-413c-b502-c074e83ac3f9" released by "_copy_volume_from_snapshot" :: held 2.017s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:04:55 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9c701770-24cc-4e4e-ab6c-02e3513ff860 tempest-VolumeImageDependencyTests-2064013169 None] Lock "cinder-quobyte-3ee1fe22-5f46-4ce8-944a-003044862e72-b8729502-6de1-413c-b502-c074e83ac3f9" released by "_create_volume_from_snapshot" :: held 2.127s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:04:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-9c701770-24cc-4e4e-ab6c-02e3513ff860 tempest-VolumeImageDependencyTests-2064013169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 2.166s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:04:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d7db73dc-628a-4edc-9987-dec8be8217a1 tempest-TestStampPattern-175323318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.683s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:04:55 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d7db73dc-628a-4edc-9987-dec8be8217a1 tempest-TestStampPattern-175323318 None] Acquiring lock "cinder-quobyte-a4263675-7926-418f-bdef-be8a8ad9aa91-d5154fcd-fff4-4ad4-a37e-ebe77bc53d76" by "_create_volume_from_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:04:55 devstack cinder-volume[88591]: DEBUG cinder.volume.volume_utils [None req-9c701770-24cc-4e4e-ab6c-02e3513ff860 tempest-VolumeImageDependencyTests-2064013169 None] Marking volume b8729502-6de1-413c-b502-c074e83ac3f9 as bootable. {{(pid=88591) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 30 17:04:55 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d7db73dc-628a-4edc-9987-dec8be8217a1 tempest-TestStampPattern-175323318 None] Lock "cinder-quobyte-a4263675-7926-418f-bdef-be8a8ad9aa91-d5154fcd-fff4-4ad4-a37e-ebe77bc53d76" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:04:55 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d7db73dc-628a-4edc-9987-dec8be8217a1 tempest-TestStampPattern-175323318 None] Creating volume d5154fcd-fff4-4ad4-a37e-ebe77bc53d76 from snapshot a4263675-7926-418f-bdef-be8a8ad9aa91 {{(pid=88591) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 30 17:04:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d7db73dc-628a-4edc-9987-dec8be8217a1 tempest-TestStampPattern-175323318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:04:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d7db73dc-628a-4edc-9987-dec8be8217a1 tempest-TestStampPattern-175323318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:04:55 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d7db73dc-628a-4edc-9987-dec8be8217a1 tempest-TestStampPattern-175323318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:04:55 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d7db73dc-628a-4edc-9987-dec8be8217a1 tempest-TestStampPattern-175323318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:04:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d7db73dc-628a-4edc-9987-dec8be8217a1 tempest-TestStampPattern-175323318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:04:55 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d7db73dc-628a-4edc-9987-dec8be8217a1 tempest-TestStampPattern-175323318 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:04:55 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d7db73dc-628a-4edc-9987-dec8be8217a1 tempest-TestStampPattern-175323318 None] Acquiring lock "cinder-quobyte-d5154fcd-fff4-4ad4-a37e-ebe77bc53d76" by "_copy_volume_from_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:04:55 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c701770-24cc-4e4e-ab6c-02e3513ff860 tempest-VolumeImageDependencyTests-2064013169 None] Copying metadata from snapshot 3ee1fe22-5f46-4ce8-944a-003044862e72 to b8729502-6de1-413c-b502-c074e83ac3f9. {{(pid=88591) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:429}} Jul 30 17:04:55 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d7db73dc-628a-4edc-9987-dec8be8217a1 tempest-TestStampPattern-175323318 None] Lock "cinder-quobyte-d5154fcd-fff4-4ad4-a37e-ebe77bc53d76" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:04:55 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d7db73dc-628a-4edc-9987-dec8be8217a1 tempest-TestStampPattern-175323318 None] snapshot: a4263675-7926-418f-bdef-be8a8ad9aa91, volume: d5154fcd-fff4-4ad4-a37e-ebe77bc53d76, {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 17:04:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d7db73dc-628a-4edc-9987-dec8be8217a1 tempest-TestStampPattern-175323318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:04:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d7db73dc-628a-4edc-9987-dec8be8217a1 tempest-TestStampPattern-175323318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:04:55 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d7db73dc-628a-4edc-9987-dec8be8217a1 tempest-TestStampPattern-175323318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:04:55 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d7db73dc-628a-4edc-9987-dec8be8217a1 tempest-TestStampPattern-175323318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:04:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d7db73dc-628a-4edc-9987-dec8be8217a1 tempest-TestStampPattern-175323318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:04:55 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[99fe077c-0e5d-4666-a969-4979ae179b6a]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:04:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d7db73dc-628a-4edc-9987-dec8be8217a1 tempest-TestStampPattern-175323318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9990c0c7-e431-40eb-955e-4855b5808fbe.a4263675-7926-418f-bdef-be8a8ad9aa91 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:55 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-9c701770-24cc-4e4e-ab6c-02e3513ff860 tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae26796e-3f74-4d1f-92d5-53753ca2d8aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8729502-6de1-413c-b502-c074e83ac3f9', 'volume_size': 1, 'snapshot_id': '3ee1fe22-5f46-4ce8-944a-003044862e72'}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:04:55 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-9c701770-24cc-4e4e-ab6c-02e3513ff860 tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (620d13aa-51f3-4ae9-8254-42a483335ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:04:55 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-9c701770-24cc-4e4e-ab6c-02e3513ff860 tempest-VolumeImageDependencyTests-2064013169 None] Volume volume-b8729502-6de1-413c-b502-c074e83ac3f9 (b8729502-6de1-413c-b502-c074e83ac3f9): created successfully Jul 30 17:04:55 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-9c701770-24cc-4e4e-ab6c-02e3513ff860 tempest-VolumeImageDependencyTests-2064013169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (620d13aa-51f3-4ae9-8254-42a483335ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:04:55 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-9c701770-24cc-4e4e-ab6c-02e3513ff860 tempest-VolumeImageDependencyTests-2064013169 None] Flow 'volume_create_manager' (d134d4f5-0643-4d5e-8b5d-af7f5eb7367a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:04:55 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-9c701770-24cc-4e4e-ab6c-02e3513ff860 tempest-VolumeImageDependencyTests-2064013169 None] Created volume successfully. Jul 30 17:04:55 devstack sudo[104691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9990c0c7-e431-40eb-955e-4855b5808fbe.a4263675-7926-418f-bdef-be8a8ad9aa91 Jul 30 17:04:55 devstack sudo[104691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:55 devstack sudo[104691]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d7db73dc-628a-4edc-9987-dec8be8217a1 tempest-TestStampPattern-175323318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9990c0c7-e431-40eb-955e-4855b5808fbe.a4263675-7926-418f-bdef-be8a8ad9aa91" returned: 0 in 0.544s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:55 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-d7db73dc-628a-4edc-9987-dec8be8217a1 tempest-TestStampPattern-175323318 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9990c0c7-e431-40eb-955e-4855b5808fbe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:04:55 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[494f6b4b-4ed7-4803-be3e-ff93a4ea1ed4]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:04:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d7db73dc-628a-4edc-9987-dec8be8217a1 tempest-TestStampPattern-175323318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9990c0c7-e431-40eb-955e-4855b5808fbe {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:55 devstack sudo[104697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9990c0c7-e431-40eb-955e-4855b5808fbe Jul 30 17:04:55 devstack sudo[104697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:56 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-daac556b-a95d-4bc6-82c7-becebaf46b48 tempest-VolumeImageDependencyTests-2064013169 None] Acquiring lock "cinder-3ee1fe22-5f46-4ce8-944a-003044862e72-delete_snapshot" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:04:56 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-daac556b-a95d-4bc6-82c7-becebaf46b48 tempest-VolumeImageDependencyTests-2064013169 None] Lock "cinder-3ee1fe22-5f46-4ce8-944a-003044862e72-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:04:56 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-daac556b-a95d-4bc6-82c7-becebaf46b48 tempest-VolumeImageDependencyTests-2064013169 None] Acquiring lock "cinder-quobyte-bf6bbc62-ff9c-46f8-861a-d69c7790d121" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:04:56 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-daac556b-a95d-4bc6-82c7-becebaf46b48 tempest-VolumeImageDependencyTests-2064013169 None] Lock "cinder-quobyte-bf6bbc62-ff9c-46f8-861a-d69c7790d121" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:04:56 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-daac556b-a95d-4bc6-82c7-becebaf46b48 tempest-VolumeImageDependencyTests-2064013169 None] Acquiring lock "cinder-quobyte-3ee1fe22-5f46-4ce8-944a-003044862e72" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:04:56 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-daac556b-a95d-4bc6-82c7-becebaf46b48 tempest-VolumeImageDependencyTests-2064013169 None] Lock "cinder-quobyte-3ee1fe22-5f46-4ce8-944a-003044862e72" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:04:56 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-daac556b-a95d-4bc6-82c7-becebaf46b48 tempest-VolumeImageDependencyTests-2064013169 None] Deleting offline snapshot 3ee1fe22-5f46-4ce8-944a-003044862e72 of volume bf6bbc62-ff9c-46f8-861a-d69c7790d121 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:04:56 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-daac556b-a95d-4bc6-82c7-becebaf46b48 tempest-VolumeImageDependencyTests-2064013169 None] snapshot_file for this snap is: volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121.3ee1fe22-5f46-4ce8-944a-003044862e72 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:04:56 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c511e027-537c-453e-a223-0f7ae5b77bbb]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:04:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-daac556b-a95d-4bc6-82c7-becebaf46b48 tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121.3ee1fe22-5f46-4ce8-944a-003044862e72 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:56 devstack sudo[104697]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d7db73dc-628a-4edc-9987-dec8be8217a1 tempest-TestStampPattern-175323318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9990c0c7-e431-40eb-955e-4855b5808fbe" returned: 0 in 0.599s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:56 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d7db73dc-628a-4edc-9987-dec8be8217a1 tempest-TestStampPattern-175323318 None] will copy from snapshot at /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9990c0c7-e431-40eb-955e-4855b5808fbe {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 17:04:56 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d7db73dc-628a-4edc-9987-dec8be8217a1 tempest-TestStampPattern-175323318 None] Creating direct copy from snapshot {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 17:04:56 devstack sudo[104700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121.3ee1fe22-5f46-4ce8-944a-003044862e72 Jul 30 17:04:56 devstack sudo[104700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:56 devstack cinder-volume[88591]: DEBUG cinder.utils [None req-d7db73dc-628a-4edc-9987-dec8be8217a1 tempest-TestStampPattern-175323318 None] Path /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d5154fcd-fff4-4ad4-a37e-ebe77bc53d76 not found in is_blk_device check {{(pid=88591) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 17:04:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d7db73dc-628a-4edc-9987-dec8be8217a1 tempest-TestStampPattern-175323318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9990c0c7-e431-40eb-955e-4855b5808fbe /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d5154fcd-fff4-4ad4-a37e-ebe77bc53d76 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:56 devstack sudo[104705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9990c0c7-e431-40eb-955e-4855b5808fbe /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d5154fcd-fff4-4ad4-a37e-ebe77bc53d76 Jul 30 17:04:56 devstack sudo[104705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:56 devstack sudo[104700]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-daac556b-a95d-4bc6-82c7-becebaf46b48 tempest-VolumeImageDependencyTests-2064013169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121.3ee1fe22-5f46-4ce8-944a-003044862e72" returned: 0 in 0.597s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:56 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-daac556b-a95d-4bc6-82c7-becebaf46b48 tempest-VolumeImageDependencyTests-2064013169 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:04:56 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8121ed51-5b55-45b8-a0fb-a81e1d4ca870]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:04:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-daac556b-a95d-4bc6-82c7-becebaf46b48 tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:57 devstack sudo[104719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121 Jul 30 17:04:57 devstack sudo[104719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:57 devstack sudo[104719]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-daac556b-a95d-4bc6-82c7-becebaf46b48 tempest-VolumeImageDependencyTests-2064013169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121" returned: 0 in 0.984s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-daac556b-a95d-4bc6-82c7-becebaf46b48 tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121.3ee1fe22-5f46-4ce8-944a-003044862e72 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:57 devstack sudo[104732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121.3ee1fe22-5f46-4ce8-944a-003044862e72 Jul 30 17:04:57 devstack sudo[104732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:58 devstack sudo[104732]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-daac556b-a95d-4bc6-82c7-becebaf46b48 tempest-VolumeImageDependencyTests-2064013169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121.3ee1fe22-5f46-4ce8-944a-003044862e72" returned: 0 in 1.051s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-daac556b-a95d-4bc6-82c7-becebaf46b48 tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121.3ee1fe22-5f46-4ce8-944a-003044862e72 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:04:59 devstack sudo[104737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121.3ee1fe22-5f46-4ce8-944a-003044862e72 Jul 30 17:04:59 devstack sudo[104737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:04:59 devstack sudo[104737]: pam_unix(sudo:session): session closed for user root Jul 30 17:04:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-daac556b-a95d-4bc6-82c7-becebaf46b48 tempest-VolumeImageDependencyTests-2064013169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121.3ee1fe22-5f46-4ce8-944a-003044862e72" returned: 0 in 0.856s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:04:59 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-daac556b-a95d-4bc6-82c7-becebaf46b48 tempest-VolumeImageDependencyTests-2064013169 None] Lock "cinder-quobyte-3ee1fe22-5f46-4ce8-944a-003044862e72" released by "_delete_snapshot" :: held 3.774s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:04:59 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-daac556b-a95d-4bc6-82c7-becebaf46b48 tempest-VolumeImageDependencyTests-2064013169 None] Lock "cinder-quobyte-bf6bbc62-ff9c-46f8-861a-d69c7790d121" released by "delete_snapshot" :: held 3.828s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:05:00 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-daac556b-a95d-4bc6-82c7-becebaf46b48 tempest-VolumeImageDependencyTests-2064013169 None] Created reservations ['5c19d375-9c4b-4364-8ea3-2c3c4e3bb0af', '4ff701f8-0621-460e-8ea1-f4181faba062', '28387bbf-8ad7-4d6f-ae90-52206cc0f973', '03d05791-645e-481f-bf01-60e33c87f67e'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:05:00 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-daac556b-a95d-4bc6-82c7-becebaf46b48 tempest-VolumeImageDependencyTests-2064013169 None] Delete snapshot completed successfully. Jul 30 17:05:00 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-daac556b-a95d-4bc6-82c7-becebaf46b48 tempest-VolumeImageDependencyTests-2064013169 None] Lock "cinder-3ee1fe22-5f46-4ce8-944a-003044862e72-delete_snapshot" released by "delete_snapshot" :: held 4.264s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:05:00 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ceb58695-b664-401e-b1df-dcd0ea5f3812 tempest-VolumeImageDependencyTests-2064013169 None] Acquiring lock "cinder-b8729502-6de1-413c-b502-c074e83ac3f9-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:05:00 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ceb58695-b664-401e-b1df-dcd0ea5f3812 tempest-VolumeImageDependencyTests-2064013169 None] Lock "cinder-b8729502-6de1-413c-b502-c074e83ac3f9-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:05:01 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ceb58695-b664-401e-b1df-dcd0ea5f3812 tempest-VolumeImageDependencyTests-2064013169 None] Acquiring lock "cinder-quobyte-b8729502-6de1-413c-b502-c074e83ac3f9" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:05:01 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ceb58695-b664-401e-b1df-dcd0ea5f3812 tempest-VolumeImageDependencyTests-2064013169 None] Lock "cinder-quobyte-b8729502-6de1-413c-b502-c074e83ac3f9" acquired by "delete_volume" :: waited 0.046s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:05:01 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b643fb-a822-42e0-b5e3-20e8a5a79286]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:05:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ceb58695-b664-401e-b1df-dcd0ea5f3812 tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b8729502-6de1-413c-b502-c074e83ac3f9 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:05:01 devstack sudo[104740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b8729502-6de1-413c-b502-c074e83ac3f9 Jul 30 17:05:01 devstack sudo[104740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:05:02 devstack sudo[104740]: pam_unix(sudo:session): session closed for user root Jul 30 17:05:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ceb58695-b664-401e-b1df-dcd0ea5f3812 tempest-VolumeImageDependencyTests-2064013169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b8729502-6de1-413c-b502-c074e83ac3f9" returned: 0 in 1.103s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:05:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ceb58695-b664-401e-b1df-dcd0ea5f3812 tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b8729502-6de1-413c-b502-c074e83ac3f9 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:05:02 devstack sudo[104760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b8729502-6de1-413c-b502-c074e83ac3f9 Jul 30 17:05:02 devstack sudo[104760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:05:03 devstack sudo[104760]: pam_unix(sudo:session): session closed for user root Jul 30 17:05:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ceb58695-b664-401e-b1df-dcd0ea5f3812 tempest-VolumeImageDependencyTests-2064013169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b8729502-6de1-413c-b502-c074e83ac3f9" returned: 0 in 0.763s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:05:03 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ceb58695-b664-401e-b1df-dcd0ea5f3812 tempest-VolumeImageDependencyTests-2064013169 None] Lock "cinder-quobyte-b8729502-6de1-413c-b502-c074e83ac3f9" released by "delete_volume" :: held 2.001s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:05:03 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-ceb58695-b664-401e-b1df-dcd0ea5f3812 tempest-VolumeImageDependencyTests-2064013169 None] Created reservations ['3f34baca-9e8c-4128-92e8-41688a2215f1', 'bc25c5ad-acd0-488d-96af-641c5e43e662', 'f5060dac-dc9f-4e3a-976a-63665df21748', '4b0580d1-053e-4e55-a61a-9a9b3e7a80bd'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:05:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ceb58695-b664-401e-b1df-dcd0ea5f3812 tempest-VolumeImageDependencyTests-2064013169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:05:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ceb58695-b664-401e-b1df-dcd0ea5f3812 tempest-VolumeImageDependencyTests-2064013169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:05:03 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ceb58695-b664-401e-b1df-dcd0ea5f3812 tempest-VolumeImageDependencyTests-2064013169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:05:03 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ceb58695-b664-401e-b1df-dcd0ea5f3812 tempest-VolumeImageDependencyTests-2064013169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:05:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ceb58695-b664-401e-b1df-dcd0ea5f3812 tempest-VolumeImageDependencyTests-2064013169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:05:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ceb58695-b664-401e-b1df-dcd0ea5f3812 tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:05:03 devstack sudo[104777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:05:03 devstack sudo[104777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:05:03 devstack sudo[104705]: pam_unix(sudo:session): session closed for user root Jul 30 17:05:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d7db73dc-628a-4edc-9987-dec8be8217a1 tempest-TestStampPattern-175323318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9990c0c7-e431-40eb-955e-4855b5808fbe /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d5154fcd-fff4-4ad4-a37e-ebe77bc53d76" returned: 0 in 7.529s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:05:03 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-d7db73dc-628a-4edc-9987-dec8be8217a1 tempest-TestStampPattern-175323318 None] Image conversion details: src /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9990c0c7-e431-40eb-955e-4855b5808fbe, size 1024.00 MB, duration 7.53 sec, destination /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d5154fcd-fff4-4ad4-a37e-ebe77bc53d76 {{(pid=88591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 17:05:03 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-d7db73dc-628a-4edc-9987-dec8be8217a1 tempest-TestStampPattern-175323318 None] Converted 1024.00 MB image at 135.97 MB/s Jul 30 17:05:03 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-d7db73dc-628a-4edc-9987-dec8be8217a1 tempest-TestStampPattern-175323318 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d5154fcd-fff4-4ad4-a37e-ebe77bc53d76 is being set with open permissions: ugo+rw Jul 30 17:05:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d7db73dc-628a-4edc-9987-dec8be8217a1 tempest-TestStampPattern-175323318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d5154fcd-fff4-4ad4-a37e-ebe77bc53d76 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:05:03 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-069d0035-8e0e-4eec-87d3-8a26b5a894c8 tempest-VolumeImageDependencyTests-2064013169 None] Acquiring lock "cinder-bf6bbc62-ff9c-46f8-861a-d69c7790d121-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:05:03 devstack sudo[104781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d5154fcd-fff4-4ad4-a37e-ebe77bc53d76 Jul 30 17:05:03 devstack sudo[104781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:05:04 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-069d0035-8e0e-4eec-87d3-8a26b5a894c8 tempest-VolumeImageDependencyTests-2064013169 None] Lock "cinder-bf6bbc62-ff9c-46f8-861a-d69c7790d121-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:05:04 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-069d0035-8e0e-4eec-87d3-8a26b5a894c8 tempest-VolumeImageDependencyTests-2064013169 None] Acquiring lock "cinder-quobyte-bf6bbc62-ff9c-46f8-861a-d69c7790d121" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:05:04 devstack sudo[104777]: pam_unix(sudo:session): session closed for user root Jul 30 17:05:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ceb58695-b664-401e-b1df-dcd0ea5f3812 tempest-VolumeImageDependencyTests-2064013169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.473s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:05:04 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-ceb58695-b664-401e-b1df-dcd0ea5f3812 tempest-VolumeImageDependencyTests-2064013169 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:05:04 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-069d0035-8e0e-4eec-87d3-8a26b5a894c8 tempest-VolumeImageDependencyTests-2064013169 None] Lock "cinder-quobyte-bf6bbc62-ff9c-46f8-861a-d69c7790d121" acquired by "delete_volume" :: waited 0.021s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:05:04 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-ceb58695-b664-401e-b1df-dcd0ea5f3812 tempest-VolumeImageDependencyTests-2064013169 None] Deleted volume successfully. Jul 30 17:05:04 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6529d7-506f-4ab5-9939-57f85082cc12]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:05:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-069d0035-8e0e-4eec-87d3-8a26b5a894c8 tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:05:04 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ceb58695-b664-401e-b1df-dcd0ea5f3812 tempest-VolumeImageDependencyTests-2064013169 None] Lock "cinder-b8729502-6de1-413c-b502-c074e83ac3f9-delete_volume" released by "delete_volume" :: held 3.342s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:05:04 devstack sudo[104784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121 Jul 30 17:05:04 devstack sudo[104784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:05:04 devstack sudo[104781]: pam_unix(sudo:session): session closed for user root Jul 30 17:05:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d7db73dc-628a-4edc-9987-dec8be8217a1 tempest-TestStampPattern-175323318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d5154fcd-fff4-4ad4-a37e-ebe77bc53d76" returned: 0 in 0.629s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:05:04 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d7db73dc-628a-4edc-9987-dec8be8217a1 tempest-TestStampPattern-175323318 None] Lock "cinder-quobyte-d5154fcd-fff4-4ad4-a37e-ebe77bc53d76" released by "_copy_volume_from_snapshot" :: held 9.451s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:05:04 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d7db73dc-628a-4edc-9987-dec8be8217a1 tempest-TestStampPattern-175323318 None] Lock "cinder-quobyte-a4263675-7926-418f-bdef-be8a8ad9aa91-d5154fcd-fff4-4ad4-a37e-ebe77bc53d76" released by "_create_volume_from_snapshot" :: held 9.593s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:05:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d7db73dc-628a-4edc-9987-dec8be8217a1 tempest-TestStampPattern-175323318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.634s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:05:04 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d7db73dc-628a-4edc-9987-dec8be8217a1 tempest-TestStampPattern-175323318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83c73175-ef9c-401e-976d-f3a02f5e69b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5154fcd-fff4-4ad4-a37e-ebe77bc53d76', 'volume_size': 1, 'snapshot_id': 'a4263675-7926-418f-bdef-be8a8ad9aa91'}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:05:04 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d7db73dc-628a-4edc-9987-dec8be8217a1 tempest-TestStampPattern-175323318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bde3058-34e5-4d3a-b4a4-555951aea5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:05:04 devstack sudo[104784]: pam_unix(sudo:session): session closed for user root Jul 30 17:05:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-069d0035-8e0e-4eec-87d3-8a26b5a894c8 tempest-VolumeImageDependencyTests-2064013169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121" returned: 0 in 0.619s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:05:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-069d0035-8e0e-4eec-87d3-8a26b5a894c8 tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:05:04 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-d7db73dc-628a-4edc-9987-dec8be8217a1 tempest-TestStampPattern-175323318 None] Volume volume-d5154fcd-fff4-4ad4-a37e-ebe77bc53d76 (d5154fcd-fff4-4ad4-a37e-ebe77bc53d76): created successfully Jul 30 17:05:04 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d7db73dc-628a-4edc-9987-dec8be8217a1 tempest-TestStampPattern-175323318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bde3058-34e5-4d3a-b4a4-555951aea5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:05:04 devstack sudo[104809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121 Jul 30 17:05:04 devstack sudo[104809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:05:04 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d7db73dc-628a-4edc-9987-dec8be8217a1 tempest-TestStampPattern-175323318 None] Flow 'volume_create_manager' (8e23942e-50ad-4ea5-90b5-ef7399c726fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:05:04 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-d7db73dc-628a-4edc-9987-dec8be8217a1 tempest-TestStampPattern-175323318 None] Created volume successfully. Jul 30 17:05:05 devstack sudo[104809]: pam_unix(sudo:session): session closed for user root Jul 30 17:05:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-069d0035-8e0e-4eec-87d3-8a26b5a894c8 tempest-VolumeImageDependencyTests-2064013169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-bf6bbc62-ff9c-46f8-861a-d69c7790d121" returned: 0 in 0.535s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:05:05 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-069d0035-8e0e-4eec-87d3-8a26b5a894c8 tempest-VolumeImageDependencyTests-2064013169 None] Lock "cinder-quobyte-bf6bbc62-ff9c-46f8-861a-d69c7790d121" released by "delete_volume" :: held 1.269s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:05:05 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-069d0035-8e0e-4eec-87d3-8a26b5a894c8 tempest-VolumeImageDependencyTests-2064013169 None] Created reservations ['0bd41524-d420-4cf7-9114-7835ec8a0c6d', '96d2634d-a33e-4708-ae5c-f1a286db1a91', '6691c661-0e2d-4233-810d-8d288e56ee0a', 'a766774f-df13-42f4-b732-ebcb81ec6adb'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:05:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-069d0035-8e0e-4eec-87d3-8a26b5a894c8 tempest-VolumeImageDependencyTests-2064013169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:05:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-069d0035-8e0e-4eec-87d3-8a26b5a894c8 tempest-VolumeImageDependencyTests-2064013169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:05:05 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-069d0035-8e0e-4eec-87d3-8a26b5a894c8 tempest-VolumeImageDependencyTests-2064013169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:05:05 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-069d0035-8e0e-4eec-87d3-8a26b5a894c8 tempest-VolumeImageDependencyTests-2064013169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:05:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-069d0035-8e0e-4eec-87d3-8a26b5a894c8 tempest-VolumeImageDependencyTests-2064013169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:05:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-069d0035-8e0e-4eec-87d3-8a26b5a894c8 tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:05:05 devstack sudo[104827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:05:05 devstack sudo[104827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:05:05 devstack sudo[104827]: pam_unix(sudo:session): session closed for user root Jul 30 17:05:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-069d0035-8e0e-4eec-87d3-8a26b5a894c8 tempest-VolumeImageDependencyTests-2064013169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.351s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:05:05 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-069d0035-8e0e-4eec-87d3-8a26b5a894c8 tempest-VolumeImageDependencyTests-2064013169 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:05:05 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-069d0035-8e0e-4eec-87d3-8a26b5a894c8 tempest-VolumeImageDependencyTests-2064013169 None] Deleted volume successfully. Jul 30 17:05:05 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-069d0035-8e0e-4eec-87d3-8a26b5a894c8 tempest-VolumeImageDependencyTests-2064013169 None] Lock "cinder-bf6bbc62-ff9c-46f8-861a-d69c7790d121-delete_volume" released by "delete_volume" :: held 1.960s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:05:06 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-dd213c28-8578-4b2e-923e-2efaa1f0a0b8 tempest-VolumeImageDependencyTests-2064013169 None] Acquiring lock "cinder-72895282-ea09-4cf2-bdc5-9b50d06473bb-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:05:06 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-dd213c28-8578-4b2e-923e-2efaa1f0a0b8 tempest-VolumeImageDependencyTests-2064013169 None] Lock "cinder-72895282-ea09-4cf2-bdc5-9b50d06473bb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:05:06 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-dd213c28-8578-4b2e-923e-2efaa1f0a0b8 tempest-VolumeImageDependencyTests-2064013169 None] Acquiring lock "cinder-quobyte-72895282-ea09-4cf2-bdc5-9b50d06473bb" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:05:06 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-dd213c28-8578-4b2e-923e-2efaa1f0a0b8 tempest-VolumeImageDependencyTests-2064013169 None] Lock "cinder-quobyte-72895282-ea09-4cf2-bdc5-9b50d06473bb" acquired by "delete_volume" :: waited 0.025s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:05:06 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[003364ee-6bda-4435-aada-36cbae21bc14]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:05:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dd213c28-8578-4b2e-923e-2efaa1f0a0b8 tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-72895282-ea09-4cf2-bdc5-9b50d06473bb {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:05:06 devstack sudo[104852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-72895282-ea09-4cf2-bdc5-9b50d06473bb Jul 30 17:05:06 devstack sudo[104852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:05:07 devstack sudo[104852]: pam_unix(sudo:session): session closed for user root Jul 30 17:05:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dd213c28-8578-4b2e-923e-2efaa1f0a0b8 tempest-VolumeImageDependencyTests-2064013169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-72895282-ea09-4cf2-bdc5-9b50d06473bb" returned: 0 in 0.488s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:05:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dd213c28-8578-4b2e-923e-2efaa1f0a0b8 tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-72895282-ea09-4cf2-bdc5-9b50d06473bb {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:05:07 devstack sudo[104859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-72895282-ea09-4cf2-bdc5-9b50d06473bb Jul 30 17:05:07 devstack sudo[104859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:05:07 devstack sudo[104859]: pam_unix(sudo:session): session closed for user root Jul 30 17:05:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dd213c28-8578-4b2e-923e-2efaa1f0a0b8 tempest-VolumeImageDependencyTests-2064013169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-72895282-ea09-4cf2-bdc5-9b50d06473bb" returned: 0 in 0.436s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:05:07 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-dd213c28-8578-4b2e-923e-2efaa1f0a0b8 tempest-VolumeImageDependencyTests-2064013169 None] Lock "cinder-quobyte-72895282-ea09-4cf2-bdc5-9b50d06473bb" released by "delete_volume" :: held 0.985s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:05:07 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-dd213c28-8578-4b2e-923e-2efaa1f0a0b8 tempest-VolumeImageDependencyTests-2064013169 None] Created reservations ['c3b24af7-e17d-4123-a356-e7f472a6a411', 'd1e99289-50f2-493b-878b-1ae64806f185', '993eee95-50ef-441d-bf47-208573b28a88', '633a41e5-08ab-449f-870c-0e28e88ce0ab'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:05:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-dd213c28-8578-4b2e-923e-2efaa1f0a0b8 tempest-VolumeImageDependencyTests-2064013169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:05:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-dd213c28-8578-4b2e-923e-2efaa1f0a0b8 tempest-VolumeImageDependencyTests-2064013169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:05:07 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-dd213c28-8578-4b2e-923e-2efaa1f0a0b8 tempest-VolumeImageDependencyTests-2064013169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:05:07 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-dd213c28-8578-4b2e-923e-2efaa1f0a0b8 tempest-VolumeImageDependencyTests-2064013169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:05:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-dd213c28-8578-4b2e-923e-2efaa1f0a0b8 tempest-VolumeImageDependencyTests-2064013169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:05:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dd213c28-8578-4b2e-923e-2efaa1f0a0b8 tempest-VolumeImageDependencyTests-2064013169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:05:07 devstack sudo[104862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:05:07 devstack sudo[104862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:05:08 devstack sudo[104862]: pam_unix(sudo:session): session closed for user root Jul 30 17:05:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dd213c28-8578-4b2e-923e-2efaa1f0a0b8 tempest-VolumeImageDependencyTests-2064013169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.345s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:05:08 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-dd213c28-8578-4b2e-923e-2efaa1f0a0b8 tempest-VolumeImageDependencyTests-2064013169 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:05:08 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-dd213c28-8578-4b2e-923e-2efaa1f0a0b8 tempest-VolumeImageDependencyTests-2064013169 None] Deleted volume successfully. Jul 30 17:05:08 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-dd213c28-8578-4b2e-923e-2efaa1f0a0b8 tempest-VolumeImageDependencyTests-2064013169 None] Lock "cinder-72895282-ea09-4cf2-bdc5-9b50d06473bb-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:05:12 devstack cinder-volume[88591]: DEBUG oslo_service.periodic_task [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 17:05:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:05:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:05:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:05:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:05:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:05:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:05:12 devstack sudo[104887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:05:12 devstack sudo[104887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:05:13 devstack sudo[104887]: pam_unix(sudo:session): session closed for user root Jul 30 17:05:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.474s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:05:13 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:05:13 devstack cinder-volume[88591]: DEBUG oslo_service.periodic_task [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running periodic task VolumeManager._thread_info {{(pid=88591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 17:05:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] thread count: 28 {{(pid=88591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 17:05:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] thread info: [<_MainThread(MainThread, started 140677178003584)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 17:05:14 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:SELECT=109,cinder:UPDATE=105,cinder:INSERT=48,cinder:DELETE=8 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:05:14 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:SELECT=101,cinder:UPDATE=98,cinder:INSERT=54,cinder:DELETE=9 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:05:14 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-997d7bf0-7011-41a9-b703-7a0e4fc13131 tempest-ProjectReaderTests-118705706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:05:14 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-997d7bf0-7011-41a9-b703-7a0e4fc13131 tempest-ProjectReaderTests-118705706 None] Flow 'volume_create_manager' (9ab955b8-fc17-4f00-8c1a-9796c10e4e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:05:14 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-997d7bf0-7011-41a9-b703-7a0e4fc13131 tempest-ProjectReaderTests-118705706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29c2c3ad-47e7-49fe-b155-3476f097b38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:05:14 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-997d7bf0-7011-41a9-b703-7a0e4fc13131 tempest-ProjectReaderTests-118705706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29c2c3ad-47e7-49fe-b155-3476f097b38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2049919790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=976c8c01-19c1-4cf4-9f78-e8b762e7db0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='326717ffcbac490095f372d21ec1ef11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:05:15Z,use_quota=True,user_id='82341ae78b444a1ba825f7533b905d2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:05:14 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-997d7bf0-7011-41a9-b703-7a0e4fc13131 tempest-ProjectReaderTests-118705706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45dd3229-8ef4-4fa3-bf98-64ade9a0a904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:05:14 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-997d7bf0-7011-41a9-b703-7a0e4fc13131 tempest-ProjectReaderTests-118705706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45dd3229-8ef4-4fa3-bf98-64ade9a0a904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:05:14 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-997d7bf0-7011-41a9-b703-7a0e4fc13131 tempest-ProjectReaderTests-118705706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a91cbba-fce4-4653-8178-2a9125a8c697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:05:14 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-997d7bf0-7011-41a9-b703-7a0e4fc13131 tempest-ProjectReaderTests-118705706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a91cbba-fce4-4653-8178-2a9125a8c697) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '976c8c01-19c1-4cf4-9f78-e8b762e7db0e', 'volume_name': 'volume-976c8c01-19c1-4cf4-9f78-e8b762e7db0e', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:05:14 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-997d7bf0-7011-41a9-b703-7a0e4fc13131 tempest-ProjectReaderTests-118705706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d46072e-3e1e-433c-a8c9-45f52beb6398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:05:14 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-997d7bf0-7011-41a9-b703-7a0e4fc13131 tempest-ProjectReaderTests-118705706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d46072e-3e1e-433c-a8c9-45f52beb6398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:05:14 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-997d7bf0-7011-41a9-b703-7a0e4fc13131 tempest-ProjectReaderTests-118705706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6a333ab-e32d-49dd-98b4-b2af5563c787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:05:14 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-997d7bf0-7011-41a9-b703-7a0e4fc13131 tempest-ProjectReaderTests-118705706 None] Volume 976c8c01-19c1-4cf4-9f78-e8b762e7db0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-976c8c01-19c1-4cf4-9f78-e8b762e7db0e', 'volume_size': 1} Jul 30 17:05:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-997d7bf0-7011-41a9-b703-7a0e4fc13131 tempest-ProjectReaderTests-118705706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:05:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-997d7bf0-7011-41a9-b703-7a0e4fc13131 tempest-ProjectReaderTests-118705706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:05:14 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-997d7bf0-7011-41a9-b703-7a0e4fc13131 tempest-ProjectReaderTests-118705706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2049919790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=976c8c01-19c1-4cf4-9f78-e8b762e7db0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='326717ffcbac490095f372d21ec1ef11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:05:15Z,use_quota=True,user_id='82341ae78b444a1ba825f7533b905d2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:05:14 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-997d7bf0-7011-41a9-b703-7a0e4fc13131 tempest-ProjectReaderTests-118705706 None] Creating volume 976c8c01-19c1-4cf4-9f78-e8b762e7db0e {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:05:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-997d7bf0-7011-41a9-b703-7a0e4fc13131 tempest-ProjectReaderTests-118705706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:05:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-997d7bf0-7011-41a9-b703-7a0e4fc13131 tempest-ProjectReaderTests-118705706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:05:14 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-997d7bf0-7011-41a9-b703-7a0e4fc13131 tempest-ProjectReaderTests-118705706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:05:14 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-997d7bf0-7011-41a9-b703-7a0e4fc13131 tempest-ProjectReaderTests-118705706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:05:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-997d7bf0-7011-41a9-b703-7a0e4fc13131 tempest-ProjectReaderTests-118705706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:05:14 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-997d7bf0-7011-41a9-b703-7a0e4fc13131 tempest-ProjectReaderTests-118705706 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:05:14 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-997d7bf0-7011-41a9-b703-7a0e4fc13131 tempest-ProjectReaderTests-118705706 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:05:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-997d7bf0-7011-41a9-b703-7a0e4fc13131 tempest-ProjectReaderTests-118705706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-976c8c01-19c1-4cf4-9f78-e8b762e7db0e 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:05:14 devstack sudo[104901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-976c8c01-19c1-4cf4-9f78-e8b762e7db0e 1073741824 Jul 30 17:05:15 devstack sudo[104901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:05:15 devstack sudo[104901]: pam_unix(sudo:session): session closed for user root Jul 30 17:05:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-997d7bf0-7011-41a9-b703-7a0e4fc13131 tempest-ProjectReaderTests-118705706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-976c8c01-19c1-4cf4-9f78-e8b762e7db0e 1073741824" returned: 0 in 0.957s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:05:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-997d7bf0-7011-41a9-b703-7a0e4fc13131 tempest-ProjectReaderTests-118705706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-976c8c01-19c1-4cf4-9f78-e8b762e7db0e {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:05:16 devstack sudo[104949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-976c8c01-19c1-4cf4-9f78-e8b762e7db0e Jul 30 17:05:16 devstack sudo[104949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:05:16 devstack sudo[104949]: pam_unix(sudo:session): session closed for user root Jul 30 17:05:16 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-997d7bf0-7011-41a9-b703-7a0e4fc13131 tempest-ProjectReaderTests-118705706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-976c8c01-19c1-4cf4-9f78-e8b762e7db0e" returned: 0 in 0.707s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:05:16 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-997d7bf0-7011-41a9-b703-7a0e4fc13131 tempest-ProjectReaderTests-118705706 None] <== create_volume: return (1764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:05:16 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-997d7bf0-7011-41a9-b703-7a0e4fc13131 tempest-ProjectReaderTests-118705706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.769s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:05:16 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-997d7bf0-7011-41a9-b703-7a0e4fc13131 tempest-ProjectReaderTests-118705706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6a333ab-e32d-49dd-98b4-b2af5563c787) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-976c8c01-19c1-4cf4-9f78-e8b762e7db0e', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:05:16 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-997d7bf0-7011-41a9-b703-7a0e4fc13131 tempest-ProjectReaderTests-118705706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7689b28-732b-4905-9426-e9b4fd797b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:05:16 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-997d7bf0-7011-41a9-b703-7a0e4fc13131 tempest-ProjectReaderTests-118705706 None] Volume volume-976c8c01-19c1-4cf4-9f78-e8b762e7db0e (976c8c01-19c1-4cf4-9f78-e8b762e7db0e): created successfully Jul 30 17:05:16 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-997d7bf0-7011-41a9-b703-7a0e4fc13131 tempest-ProjectReaderTests-118705706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7689b28-732b-4905-9426-e9b4fd797b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:05:16 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-997d7bf0-7011-41a9-b703-7a0e4fc13131 tempest-ProjectReaderTests-118705706 None] Flow 'volume_create_manager' (9ab955b8-fc17-4f00-8c1a-9796c10e4e6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:05:16 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-997d7bf0-7011-41a9-b703-7a0e4fc13131 tempest-ProjectReaderTests-118705706 None] Created volume successfully. Jul 30 17:05:17 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-8cba1727-6209-4ca1-8870-30f774d38249 tempest-ProjectReaderTests-118705706 None] Acquiring lock "cinder-976c8c01-19c1-4cf4-9f78-e8b762e7db0e-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:05:17 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-8cba1727-6209-4ca1-8870-30f774d38249 tempest-ProjectReaderTests-118705706 None] Lock "cinder-976c8c01-19c1-4cf4-9f78-e8b762e7db0e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:05:17 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-8cba1727-6209-4ca1-8870-30f774d38249 tempest-ProjectReaderTests-118705706 None] Acquiring lock "cinder-quobyte-976c8c01-19c1-4cf4-9f78-e8b762e7db0e" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:05:17 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-8cba1727-6209-4ca1-8870-30f774d38249 tempest-ProjectReaderTests-118705706 None] Lock "cinder-quobyte-976c8c01-19c1-4cf4-9f78-e8b762e7db0e" acquired by "delete_volume" :: waited 0.025s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:05:17 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e667afb-5370-478e-a4fb-32c9e0b9d740]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:05:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8cba1727-6209-4ca1-8870-30f774d38249 tempest-ProjectReaderTests-118705706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-976c8c01-19c1-4cf4-9f78-e8b762e7db0e {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:05:17 devstack sudo[104984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-976c8c01-19c1-4cf4-9f78-e8b762e7db0e Jul 30 17:05:17 devstack sudo[104984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:05:17 devstack sudo[104984]: pam_unix(sudo:session): session closed for user root Jul 30 17:05:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8cba1727-6209-4ca1-8870-30f774d38249 tempest-ProjectReaderTests-118705706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-976c8c01-19c1-4cf4-9f78-e8b762e7db0e" returned: 0 in 0.365s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:05:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8cba1727-6209-4ca1-8870-30f774d38249 tempest-ProjectReaderTests-118705706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-976c8c01-19c1-4cf4-9f78-e8b762e7db0e {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:05:17 devstack sudo[104989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-976c8c01-19c1-4cf4-9f78-e8b762e7db0e Jul 30 17:05:17 devstack sudo[104989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:05:17 devstack sudo[104989]: pam_unix(sudo:session): session closed for user root Jul 30 17:05:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8cba1727-6209-4ca1-8870-30f774d38249 tempest-ProjectReaderTests-118705706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-976c8c01-19c1-4cf4-9f78-e8b762e7db0e" returned: 0 in 0.292s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:05:17 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-8cba1727-6209-4ca1-8870-30f774d38249 tempest-ProjectReaderTests-118705706 None] Lock "cinder-quobyte-976c8c01-19c1-4cf4-9f78-e8b762e7db0e" released by "delete_volume" :: held 0.723s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:05:17 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-8cba1727-6209-4ca1-8870-30f774d38249 tempest-ProjectReaderTests-118705706 None] Created reservations ['b3ef2955-4703-4756-83b3-d033f6ccdf6d', '3aaa664b-62ef-4c47-a8c4-bc7d8ded2f46', '83637214-b890-411c-bf52-cd85861c282f', '5dc23933-a502-48e9-b0c7-03960b907a1d'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:05:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8cba1727-6209-4ca1-8870-30f774d38249 tempest-ProjectReaderTests-118705706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:05:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8cba1727-6209-4ca1-8870-30f774d38249 tempest-ProjectReaderTests-118705706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:05:18 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-8cba1727-6209-4ca1-8870-30f774d38249 tempest-ProjectReaderTests-118705706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:05:18 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-8cba1727-6209-4ca1-8870-30f774d38249 tempest-ProjectReaderTests-118705706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:05:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8cba1727-6209-4ca1-8870-30f774d38249 tempest-ProjectReaderTests-118705706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:05:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8cba1727-6209-4ca1-8870-30f774d38249 tempest-ProjectReaderTests-118705706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:05:18 devstack sudo[104994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:05:18 devstack sudo[104994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:05:18 devstack sudo[104994]: pam_unix(sudo:session): session closed for user root Jul 30 17:05:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8cba1727-6209-4ca1-8870-30f774d38249 tempest-ProjectReaderTests-118705706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.643s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:05:18 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-8cba1727-6209-4ca1-8870-30f774d38249 tempest-ProjectReaderTests-118705706 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:05:18 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-8cba1727-6209-4ca1-8870-30f774d38249 tempest-ProjectReaderTests-118705706 None] Deleted volume successfully. Jul 30 17:05:18 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-8cba1727-6209-4ca1-8870-30f774d38249 tempest-ProjectReaderTests-118705706 None] Lock "cinder-976c8c01-19c1-4cf4-9f78-e8b762e7db0e-delete_volume" released by "delete_volume" :: held 1.776s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:05:18 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-33c0237d-14a9-4e4b-974e-0fd437c4f350 tempest-ProjectReaderTests-118705706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:05:18 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-33c0237d-14a9-4e4b-974e-0fd437c4f350 tempest-ProjectReaderTests-118705706 None] Flow 'volume_create_manager' (04a33747-eccf-4ec5-847a-e8ce78858117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:05:18 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-33c0237d-14a9-4e4b-974e-0fd437c4f350 tempest-ProjectReaderTests-118705706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48807ebb-867b-476b-8170-6c11392e28c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:05:18 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-33c0237d-14a9-4e4b-974e-0fd437c4f350 tempest-ProjectReaderTests-118705706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48807ebb-867b-476b-8170-6c11392e28c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:05:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-259918237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89428959-618e-42d2-b834-1aec21b79b9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='326717ffcbac490095f372d21ec1ef11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:05:19Z,use_quota=True,user_id='82341ae78b444a1ba825f7533b905d2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:05:19 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-33c0237d-14a9-4e4b-974e-0fd437c4f350 tempest-ProjectReaderTests-118705706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06187ac2-6055-427a-9a4e-7768fa78c53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:05:19 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-33c0237d-14a9-4e4b-974e-0fd437c4f350 tempest-ProjectReaderTests-118705706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06187ac2-6055-427a-9a4e-7768fa78c53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:05:19 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-33c0237d-14a9-4e4b-974e-0fd437c4f350 tempest-ProjectReaderTests-118705706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7495165a-b430-4e01-89a2-7bcf07d8d331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:05:19 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-33c0237d-14a9-4e4b-974e-0fd437c4f350 tempest-ProjectReaderTests-118705706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7495165a-b430-4e01-89a2-7bcf07d8d331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89428959-618e-42d2-b834-1aec21b79b9e', 'volume_name': 'volume-89428959-618e-42d2-b834-1aec21b79b9e', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:05:19 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-33c0237d-14a9-4e4b-974e-0fd437c4f350 tempest-ProjectReaderTests-118705706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a8a9330-76ea-4927-a237-972c0f08ef2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:05:19 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-33c0237d-14a9-4e4b-974e-0fd437c4f350 tempest-ProjectReaderTests-118705706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a8a9330-76ea-4927-a237-972c0f08ef2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:05:19 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-33c0237d-14a9-4e4b-974e-0fd437c4f350 tempest-ProjectReaderTests-118705706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c99844cd-c47f-4f4d-9b30-d178b26930d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:05:19 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-33c0237d-14a9-4e4b-974e-0fd437c4f350 tempest-ProjectReaderTests-118705706 None] Volume 89428959-618e-42d2-b834-1aec21b79b9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89428959-618e-42d2-b834-1aec21b79b9e', 'volume_size': 1} Jul 30 17:05:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-33c0237d-14a9-4e4b-974e-0fd437c4f350 tempest-ProjectReaderTests-118705706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:05:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-33c0237d-14a9-4e4b-974e-0fd437c4f350 tempest-ProjectReaderTests-118705706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:05:19 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-33c0237d-14a9-4e4b-974e-0fd437c4f350 tempest-ProjectReaderTests-118705706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:05:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-259918237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89428959-618e-42d2-b834-1aec21b79b9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='326717ffcbac490095f372d21ec1ef11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:05:19Z,use_quota=True,user_id='82341ae78b444a1ba825f7533b905d2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:05:19 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-33c0237d-14a9-4e4b-974e-0fd437c4f350 tempest-ProjectReaderTests-118705706 None] Creating volume 89428959-618e-42d2-b834-1aec21b79b9e {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:05:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-33c0237d-14a9-4e4b-974e-0fd437c4f350 tempest-ProjectReaderTests-118705706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:05:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-33c0237d-14a9-4e4b-974e-0fd437c4f350 tempest-ProjectReaderTests-118705706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:05:19 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-33c0237d-14a9-4e4b-974e-0fd437c4f350 tempest-ProjectReaderTests-118705706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:05:19 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-33c0237d-14a9-4e4b-974e-0fd437c4f350 tempest-ProjectReaderTests-118705706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:05:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-33c0237d-14a9-4e4b-974e-0fd437c4f350 tempest-ProjectReaderTests-118705706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:05:19 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-33c0237d-14a9-4e4b-974e-0fd437c4f350 tempest-ProjectReaderTests-118705706 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:05:19 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-33c0237d-14a9-4e4b-974e-0fd437c4f350 tempest-ProjectReaderTests-118705706 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:05:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-33c0237d-14a9-4e4b-974e-0fd437c4f350 tempest-ProjectReaderTests-118705706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-89428959-618e-42d2-b834-1aec21b79b9e 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:05:19 devstack sudo[104997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-89428959-618e-42d2-b834-1aec21b79b9e 1073741824 Jul 30 17:05:19 devstack sudo[104997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:05:19 devstack sudo[104997]: pam_unix(sudo:session): session closed for user root Jul 30 17:05:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-33c0237d-14a9-4e4b-974e-0fd437c4f350 tempest-ProjectReaderTests-118705706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-89428959-618e-42d2-b834-1aec21b79b9e 1073741824" returned: 0 in 0.601s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:05:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-33c0237d-14a9-4e4b-974e-0fd437c4f350 tempest-ProjectReaderTests-118705706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-89428959-618e-42d2-b834-1aec21b79b9e {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:05:19 devstack sudo[105011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-89428959-618e-42d2-b834-1aec21b79b9e Jul 30 17:05:19 devstack sudo[105011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:05:20 devstack sudo[105011]: pam_unix(sudo:session): session closed for user root Jul 30 17:05:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-33c0237d-14a9-4e4b-974e-0fd437c4f350 tempest-ProjectReaderTests-118705706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-89428959-618e-42d2-b834-1aec21b79b9e" returned: 0 in 0.362s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:05:20 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-33c0237d-14a9-4e4b-974e-0fd437c4f350 tempest-ProjectReaderTests-118705706 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:05:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-33c0237d-14a9-4e4b-974e-0fd437c4f350 tempest-ProjectReaderTests-118705706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:05:20 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-33c0237d-14a9-4e4b-974e-0fd437c4f350 tempest-ProjectReaderTests-118705706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c99844cd-c47f-4f4d-9b30-d178b26930d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89428959-618e-42d2-b834-1aec21b79b9e', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:05:20 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-33c0237d-14a9-4e4b-974e-0fd437c4f350 tempest-ProjectReaderTests-118705706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c2ca31b-2110-43d7-8e0b-28b06a73c29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:05:20 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-33c0237d-14a9-4e4b-974e-0fd437c4f350 tempest-ProjectReaderTests-118705706 None] Volume volume-89428959-618e-42d2-b834-1aec21b79b9e (89428959-618e-42d2-b834-1aec21b79b9e): created successfully Jul 30 17:05:20 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-33c0237d-14a9-4e4b-974e-0fd437c4f350 tempest-ProjectReaderTests-118705706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c2ca31b-2110-43d7-8e0b-28b06a73c29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:05:20 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-33c0237d-14a9-4e4b-974e-0fd437c4f350 tempest-ProjectReaderTests-118705706 None] Flow 'volume_create_manager' (04a33747-eccf-4ec5-847a-e8ce78858117) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:05:20 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-33c0237d-14a9-4e4b-974e-0fd437c4f350 tempest-ProjectReaderTests-118705706 None] Created volume successfully. Jul 30 17:05:21 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-494fa456-79fc-469b-b430-9921ba48cd1d tempest-ProjectReaderTests-118705706 None] Acquiring lock "cinder-89428959-618e-42d2-b834-1aec21b79b9e-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:05:21 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-494fa456-79fc-469b-b430-9921ba48cd1d tempest-ProjectReaderTests-118705706 None] Lock "cinder-89428959-618e-42d2-b834-1aec21b79b9e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:05:21 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-494fa456-79fc-469b-b430-9921ba48cd1d tempest-ProjectReaderTests-118705706 None] Acquiring lock "cinder-quobyte-89428959-618e-42d2-b834-1aec21b79b9e" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:05:21 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-494fa456-79fc-469b-b430-9921ba48cd1d tempest-ProjectReaderTests-118705706 None] Lock "cinder-quobyte-89428959-618e-42d2-b834-1aec21b79b9e" acquired by "delete_volume" :: waited 0.019s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:05:21 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[7931c698-7128-408e-8e62-82e846c551e3]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:05:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-494fa456-79fc-469b-b430-9921ba48cd1d tempest-ProjectReaderTests-118705706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-89428959-618e-42d2-b834-1aec21b79b9e {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:05:21 devstack sudo[105017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-89428959-618e-42d2-b834-1aec21b79b9e Jul 30 17:05:21 devstack sudo[105017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:05:21 devstack sudo[105017]: pam_unix(sudo:session): session closed for user root Jul 30 17:05:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-494fa456-79fc-469b-b430-9921ba48cd1d tempest-ProjectReaderTests-118705706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-89428959-618e-42d2-b834-1aec21b79b9e" returned: 0 in 0.390s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:05:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-494fa456-79fc-469b-b430-9921ba48cd1d tempest-ProjectReaderTests-118705706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-89428959-618e-42d2-b834-1aec21b79b9e {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:05:21 devstack sudo[105022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-89428959-618e-42d2-b834-1aec21b79b9e Jul 30 17:05:21 devstack sudo[105022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:05:21 devstack sudo[105022]: pam_unix(sudo:session): session closed for user root Jul 30 17:05:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-494fa456-79fc-469b-b430-9921ba48cd1d tempest-ProjectReaderTests-118705706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-89428959-618e-42d2-b834-1aec21b79b9e" returned: 0 in 0.251s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:05:21 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-494fa456-79fc-469b-b430-9921ba48cd1d tempest-ProjectReaderTests-118705706 None] Lock "cinder-quobyte-89428959-618e-42d2-b834-1aec21b79b9e" released by "delete_volume" :: held 0.706s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:05:21 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-494fa456-79fc-469b-b430-9921ba48cd1d tempest-ProjectReaderTests-118705706 None] Created reservations ['6ee6f67d-ade4-498f-957b-ac069414b37e', 'd5621158-c21f-48f6-a795-3290a07f6de0', '43cd6ade-3e2a-4e9d-9150-25578aecbe81', '9e964d9f-17a4-4324-b087-5870b82a0cdc'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:05:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-494fa456-79fc-469b-b430-9921ba48cd1d tempest-ProjectReaderTests-118705706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:05:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-494fa456-79fc-469b-b430-9921ba48cd1d tempest-ProjectReaderTests-118705706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:05:22 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-494fa456-79fc-469b-b430-9921ba48cd1d tempest-ProjectReaderTests-118705706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:05:22 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-494fa456-79fc-469b-b430-9921ba48cd1d tempest-ProjectReaderTests-118705706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:05:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-494fa456-79fc-469b-b430-9921ba48cd1d tempest-ProjectReaderTests-118705706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:05:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-494fa456-79fc-469b-b430-9921ba48cd1d tempest-ProjectReaderTests-118705706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:05:22 devstack sudo[105026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:05:22 devstack sudo[105026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:05:22 devstack sudo[105026]: pam_unix(sudo:session): session closed for user root Jul 30 17:05:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-494fa456-79fc-469b-b430-9921ba48cd1d tempest-ProjectReaderTests-118705706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.262s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:05:22 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-494fa456-79fc-469b-b430-9921ba48cd1d tempest-ProjectReaderTests-118705706 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:05:22 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-494fa456-79fc-469b-b430-9921ba48cd1d tempest-ProjectReaderTests-118705706 None] Deleted volume successfully. Jul 30 17:05:22 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-494fa456-79fc-469b-b430-9921ba48cd1d tempest-ProjectReaderTests-118705706 None] Lock "cinder-89428959-618e-42d2-b834-1aec21b79b9e-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:05:32 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:SELECT=11,cinder:UPDATE=24,cinder:INSERT=4,cinder:DELETE=2 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:05:32 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:UPDATE=19,cinder:INSERT=6,cinder:DELETE=2,cinder:SELECT=16 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:05:41 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-c747f86d-3d44-4fb6-896c-aa95363c4c51 tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:05:41 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c747f86d-3d44-4fb6-896c-aa95363c4c51 tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] Flow 'volume_create_manager' (38ec464f-e626-430f-85b8-7ea0c2067f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:05:41 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c747f86d-3d44-4fb6-896c-aa95363c4c51 tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2f7a099-65a5-40bf-bacf-79c65ab73178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:05:41 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c747f86d-3d44-4fb6-896c-aa95363c4c51 tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2f7a099-65a5-40bf-bacf-79c65ab73178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1359546879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33d74dc1-d0ff-4b6b-814a-88c8f91dcee6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc182d6e947d43b9b8932d82187bcb60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:05:42Z,use_quota=True,user_id='57a5b42fabc84d2684cc4622990778cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:05:41 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c747f86d-3d44-4fb6-896c-aa95363c4c51 tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (057df406-1efc-4b43-8340-1a2f2741af36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:05:41 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c747f86d-3d44-4fb6-896c-aa95363c4c51 tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (057df406-1efc-4b43-8340-1a2f2741af36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:05:41 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c747f86d-3d44-4fb6-896c-aa95363c4c51 tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4167af3-33c3-4a90-bd49-aaee10b9fc86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:05:41 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c747f86d-3d44-4fb6-896c-aa95363c4c51 tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4167af3-33c3-4a90-bd49-aaee10b9fc86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33d74dc1-d0ff-4b6b-814a-88c8f91dcee6', 'volume_name': 'volume-33d74dc1-d0ff-4b6b-814a-88c8f91dcee6', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:05:41 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c747f86d-3d44-4fb6-896c-aa95363c4c51 tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ca5377d-8e5d-4cb0-bb50-2fb13f60e7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:05:41 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c747f86d-3d44-4fb6-896c-aa95363c4c51 tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ca5377d-8e5d-4cb0-bb50-2fb13f60e7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:05:41 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c747f86d-3d44-4fb6-896c-aa95363c4c51 tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d602c2a2-55b7-4f88-95d4-bc2c0fda8213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:05:41 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-c747f86d-3d44-4fb6-896c-aa95363c4c51 tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] Volume 33d74dc1-d0ff-4b6b-814a-88c8f91dcee6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33d74dc1-d0ff-4b6b-814a-88c8f91dcee6', 'volume_size': 1} Jul 30 17:05:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c747f86d-3d44-4fb6-896c-aa95363c4c51 tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:05:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c747f86d-3d44-4fb6-896c-aa95363c4c51 tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:05:41 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-c747f86d-3d44-4fb6-896c-aa95363c4c51 tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1359546879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33d74dc1-d0ff-4b6b-814a-88c8f91dcee6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc182d6e947d43b9b8932d82187bcb60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:05:42Z,use_quota=True,user_id='57a5b42fabc84d2684cc4622990778cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:05:41 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-c747f86d-3d44-4fb6-896c-aa95363c4c51 tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] Creating volume 33d74dc1-d0ff-4b6b-814a-88c8f91dcee6 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:05:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c747f86d-3d44-4fb6-896c-aa95363c4c51 tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:05:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c747f86d-3d44-4fb6-896c-aa95363c4c51 tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:05:41 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-c747f86d-3d44-4fb6-896c-aa95363c4c51 tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:05:41 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-c747f86d-3d44-4fb6-896c-aa95363c4c51 tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:05:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c747f86d-3d44-4fb6-896c-aa95363c4c51 tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:05:41 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-c747f86d-3d44-4fb6-896c-aa95363c4c51 tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:05:41 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-c747f86d-3d44-4fb6-896c-aa95363c4c51 tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:05:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c747f86d-3d44-4fb6-896c-aa95363c4c51 tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-33d74dc1-d0ff-4b6b-814a-88c8f91dcee6 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:05:41 devstack sudo[105054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-33d74dc1-d0ff-4b6b-814a-88c8f91dcee6 1073741824 Jul 30 17:05:41 devstack sudo[105054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:05:42 devstack sudo[105054]: pam_unix(sudo:session): session closed for user root Jul 30 17:05:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c747f86d-3d44-4fb6-896c-aa95363c4c51 tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-33d74dc1-d0ff-4b6b-814a-88c8f91dcee6 1073741824" returned: 0 in 0.464s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:05:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c747f86d-3d44-4fb6-896c-aa95363c4c51 tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-33d74dc1-d0ff-4b6b-814a-88c8f91dcee6 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:05:42 devstack sudo[105061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-33d74dc1-d0ff-4b6b-814a-88c8f91dcee6 Jul 30 17:05:42 devstack sudo[105061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:05:42 devstack sudo[105061]: pam_unix(sudo:session): session closed for user root Jul 30 17:05:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c747f86d-3d44-4fb6-896c-aa95363c4c51 tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-33d74dc1-d0ff-4b6b-814a-88c8f91dcee6" returned: 0 in 0.265s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:05:42 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-c747f86d-3d44-4fb6-896c-aa95363c4c51 tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:05:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c747f86d-3d44-4fb6-896c-aa95363c4c51 tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:05:42 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c747f86d-3d44-4fb6-896c-aa95363c4c51 tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d602c2a2-55b7-4f88-95d4-bc2c0fda8213) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33d74dc1-d0ff-4b6b-814a-88c8f91dcee6', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:05:42 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c747f86d-3d44-4fb6-896c-aa95363c4c51 tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06354b05-2855-439a-998b-db662d77cc4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:05:42 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-c747f86d-3d44-4fb6-896c-aa95363c4c51 tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] Volume volume-33d74dc1-d0ff-4b6b-814a-88c8f91dcee6 (33d74dc1-d0ff-4b6b-814a-88c8f91dcee6): created successfully Jul 30 17:05:42 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c747f86d-3d44-4fb6-896c-aa95363c4c51 tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06354b05-2855-439a-998b-db662d77cc4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:05:42 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c747f86d-3d44-4fb6-896c-aa95363c4c51 tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] Flow 'volume_create_manager' (38ec464f-e626-430f-85b8-7ea0c2067f39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:05:42 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-c747f86d-3d44-4fb6-896c-aa95363c4c51 tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] Created volume successfully. Jul 30 17:05:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-e2d0c906-e6fc-4cbd-a8ca-af3fc5c195ad req-8f2cbf2f-f75d-4df9-bdef-5d98c5ebca1b tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:05:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-e2d0c906-e6fc-4cbd-a8ca-af3fc5c195ad req-8f2cbf2f-f75d-4df9-bdef-5d98c5ebca1b tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:05:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-e2d0c906-e6fc-4cbd-a8ca-af3fc5c195ad req-8f2cbf2f-f75d-4df9-bdef-5d98c5ebca1b tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:05:43 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-e2d0c906-e6fc-4cbd-a8ca-af3fc5c195ad req-8f2cbf2f-f75d-4df9-bdef-5d98c5ebca1b tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202', 'name': 'volume-33d74dc1-d0ff-4b6b-814a-88c8f91dcee6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0e4749b5-6bea-4871-b03d-a24d19e582bb', 'enforce_multipath': True} {{(pid=88591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 17:05:43 devstack cinder-volume[88591]: INFO cinder.volume.manager [req-e2d0c906-e6fc-4cbd-a8ca-af3fc5c195ad req-8f2cbf2f-f75d-4df9-bdef-5d98c5ebca1b tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] attachment_update completed successfully. Jul 30 17:05:47 devstack cinder-volume[88591]: INFO cinder.volume.manager [req-d050eeb8-d756-4202-ad35-4ff0c1b22d70 req-78485529-1da1-4f3c-8f8b-8075147d7e01 tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] Terminate volume connection completed successfully. Jul 30 17:05:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-d050eeb8-d756-4202-ad35-4ff0c1b22d70 req-78485529-1da1-4f3c-8f8b-8075147d7e01 tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] Deleting attachment 0e4749b5-6bea-4871-b03d-a24d19e582bb. {{(pid=88591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 17:05:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-91374881-5f2e-4f5f-8211-6292ec66b00b req-b4705860-6e63-4f3f-b5a8-ea9f6865fa3d tempest-TestStampPattern-175323318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:05:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-91374881-5f2e-4f5f-8211-6292ec66b00b req-b4705860-6e63-4f3f-b5a8-ea9f6865fa3d tempest-TestStampPattern-175323318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:05:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-91374881-5f2e-4f5f-8211-6292ec66b00b req-b4705860-6e63-4f3f-b5a8-ea9f6865fa3d tempest-TestStampPattern-175323318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:05:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-91374881-5f2e-4f5f-8211-6292ec66b00b req-b4705860-6e63-4f3f-b5a8-ea9f6865fa3d tempest-TestStampPattern-175323318 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202', 'name': 'volume-d5154fcd-fff4-4ad4-a37e-ebe77bc53d76', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bafd6275-17b2-41d6-b519-53782fdbd1aa', 'enforce_multipath': True} {{(pid=88591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 17:05:48 devstack cinder-volume[88591]: INFO cinder.volume.manager [req-91374881-5f2e-4f5f-8211-6292ec66b00b req-b4705860-6e63-4f3f-b5a8-ea9f6865fa3d tempest-TestStampPattern-175323318 None] attachment_update completed successfully. Jul 30 17:05:48 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-4af08a70-f5d6-47fd-8232-d506cdc6bb0f tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] Acquiring lock "cinder-33d74dc1-d0ff-4b6b-814a-88c8f91dcee6-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:05:48 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-4af08a70-f5d6-47fd-8232-d506cdc6bb0f tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] Lock "cinder-33d74dc1-d0ff-4b6b-814a-88c8f91dcee6-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:05:48 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-4af08a70-f5d6-47fd-8232-d506cdc6bb0f tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] Acquiring lock "cinder-quobyte-33d74dc1-d0ff-4b6b-814a-88c8f91dcee6" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:05:48 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-4af08a70-f5d6-47fd-8232-d506cdc6bb0f tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] Lock "cinder-quobyte-33d74dc1-d0ff-4b6b-814a-88c8f91dcee6" acquired by "delete_volume" :: waited 0.024s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:05:48 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a2029b-38db-4562-a227-3b7009ff1cd3]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:05:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4af08a70-f5d6-47fd-8232-d506cdc6bb0f tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-33d74dc1-d0ff-4b6b-814a-88c8f91dcee6 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:05:48 devstack sudo[105884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-33d74dc1-d0ff-4b6b-814a-88c8f91dcee6 Jul 30 17:05:48 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:05:48 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root Jul 30 17:05:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4af08a70-f5d6-47fd-8232-d506cdc6bb0f tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-33d74dc1-d0ff-4b6b-814a-88c8f91dcee6" returned: 0 in 0.542s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:05:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4af08a70-f5d6-47fd-8232-d506cdc6bb0f tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-33d74dc1-d0ff-4b6b-814a-88c8f91dcee6 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:05:48 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-33d74dc1-d0ff-4b6b-814a-88c8f91dcee6 Jul 30 17:05:48 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:05:49 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Jul 30 17:05:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4af08a70-f5d6-47fd-8232-d506cdc6bb0f tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-33d74dc1-d0ff-4b6b-814a-88c8f91dcee6" returned: 0 in 0.310s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:05:49 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-4af08a70-f5d6-47fd-8232-d506cdc6bb0f tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] Lock "cinder-quobyte-33d74dc1-d0ff-4b6b-814a-88c8f91dcee6" released by "delete_volume" :: held 0.923s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:05:49 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-4af08a70-f5d6-47fd-8232-d506cdc6bb0f tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] Created reservations ['c0ff09cb-b749-4e3b-82bf-15df59cb796e', '3342f98c-3feb-4c2c-acec-24e5a276839f', '5c9553c5-f3bb-4f20-9638-f772efa4eefe', 'c58117a3-3dfe-4f8c-aef8-8eb219811e28'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:05:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-4af08a70-f5d6-47fd-8232-d506cdc6bb0f tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:05:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-4af08a70-f5d6-47fd-8232-d506cdc6bb0f tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:05:49 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-4af08a70-f5d6-47fd-8232-d506cdc6bb0f tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:05:49 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-4af08a70-f5d6-47fd-8232-d506cdc6bb0f tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:05:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-4af08a70-f5d6-47fd-8232-d506cdc6bb0f tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:05:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4af08a70-f5d6-47fd-8232-d506cdc6bb0f tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:05:49 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:05:49 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:05:49 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7f58843-26e3-44ac-ba01-567c598143ef tempest-SnapshotDependencyTests-1559451915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:05:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f7f58843-26e3-44ac-ba01-567c598143ef tempest-SnapshotDependencyTests-1559451915 None] Flow 'volume_create_manager' (c7f580dc-4b54-4d5b-972a-85729235d3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:05:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f7f58843-26e3-44ac-ba01-567c598143ef tempest-SnapshotDependencyTests-1559451915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6177e661-f526-4b04-9638-8cbebe2f4dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:05:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f7f58843-26e3-44ac-ba01-567c598143ef tempest-SnapshotDependencyTests-1559451915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6177e661-f526-4b04-9638-8cbebe2f4dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:05:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-763598209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26b67a9e1e3845d88aea4f9894e61543',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:05:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:05:49Z,use_quota=True,user_id='63f85066fe3b41f5bb8d824b05505d64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:05:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f7f58843-26e3-44ac-ba01-567c598143ef tempest-SnapshotDependencyTests-1559451915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d36ff9db-e68a-4853-95cc-a3e14e0d4dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:05:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f7f58843-26e3-44ac-ba01-567c598143ef tempest-SnapshotDependencyTests-1559451915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d36ff9db-e68a-4853-95cc-a3e14e0d4dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:05:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f7f58843-26e3-44ac-ba01-567c598143ef tempest-SnapshotDependencyTests-1559451915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ea1349d-830e-4bb5-85c4-1c53f781a6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:05:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f7f58843-26e3-44ac-ba01-567c598143ef tempest-SnapshotDependencyTests-1559451915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ea1349d-830e-4bb5-85c4-1c53f781a6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e', 'volume_name': 'volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:05:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f7f58843-26e3-44ac-ba01-567c598143ef tempest-SnapshotDependencyTests-1559451915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3306cf9-d6e1-49b2-8a80-ae94384312e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:05:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f7f58843-26e3-44ac-ba01-567c598143ef tempest-SnapshotDependencyTests-1559451915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3306cf9-d6e1-49b2-8a80-ae94384312e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:05:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f7f58843-26e3-44ac-ba01-567c598143ef tempest-SnapshotDependencyTests-1559451915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50338163-ba68-4634-8d4e-64095757856c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:05:49 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-f7f58843-26e3-44ac-ba01-567c598143ef tempest-SnapshotDependencyTests-1559451915 None] Volume ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e', 'volume_size': 1} Jul 30 17:05:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f7f58843-26e3-44ac-ba01-567c598143ef tempest-SnapshotDependencyTests-1559451915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:05:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f7f58843-26e3-44ac-ba01-567c598143ef tempest-SnapshotDependencyTests-1559451915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:05:49 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f7f58843-26e3-44ac-ba01-567c598143ef tempest-SnapshotDependencyTests-1559451915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:05:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-763598209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26b67a9e1e3845d88aea4f9894e61543',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:05:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:05:49Z,use_quota=True,user_id='63f85066fe3b41f5bb8d824b05505d64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:05:49 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-f7f58843-26e3-44ac-ba01-567c598143ef tempest-SnapshotDependencyTests-1559451915 None] Creating volume ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:05:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f7f58843-26e3-44ac-ba01-567c598143ef tempest-SnapshotDependencyTests-1559451915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:05:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f7f58843-26e3-44ac-ba01-567c598143ef tempest-SnapshotDependencyTests-1559451915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:05:49 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f7f58843-26e3-44ac-ba01-567c598143ef tempest-SnapshotDependencyTests-1559451915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:05:49 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f7f58843-26e3-44ac-ba01-567c598143ef tempest-SnapshotDependencyTests-1559451915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:05:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f7f58843-26e3-44ac-ba01-567c598143ef tempest-SnapshotDependencyTests-1559451915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:05:49 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f7f58843-26e3-44ac-ba01-567c598143ef tempest-SnapshotDependencyTests-1559451915 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:05:49 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-f7f58843-26e3-44ac-ba01-567c598143ef tempest-SnapshotDependencyTests-1559451915 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:05:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f7f58843-26e3-44ac-ba01-567c598143ef tempest-SnapshotDependencyTests-1559451915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:05:49 devstack sudo[105901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e 1073741824 Jul 30 17:05:49 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:05:49 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Jul 30 17:05:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4af08a70-f5d6-47fd-8232-d506cdc6bb0f tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.245s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:05:49 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-4af08a70-f5d6-47fd-8232-d506cdc6bb0f tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:05:49 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-4af08a70-f5d6-47fd-8232-d506cdc6bb0f tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] Deleted volume successfully. Jul 30 17:05:49 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-4af08a70-f5d6-47fd-8232-d506cdc6bb0f tempest-TestServerVolumeAttachScenarioOldVersion-412939599 None] Lock "cinder-33d74dc1-d0ff-4b6b-814a-88c8f91dcee6-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:05:49 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root Jul 30 17:05:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f7f58843-26e3-44ac-ba01-567c598143ef tempest-SnapshotDependencyTests-1559451915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e 1073741824" returned: 0 in 0.419s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:05:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f7f58843-26e3-44ac-ba01-567c598143ef tempest-SnapshotDependencyTests-1559451915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:05:50 devstack sudo[105913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e Jul 30 17:05:50 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:05:50 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root Jul 30 17:05:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f7f58843-26e3-44ac-ba01-567c598143ef tempest-SnapshotDependencyTests-1559451915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e" returned: 0 in 0.261s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:05:50 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f7f58843-26e3-44ac-ba01-567c598143ef tempest-SnapshotDependencyTests-1559451915 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:05:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f7f58843-26e3-44ac-ba01-567c598143ef tempest-SnapshotDependencyTests-1559451915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:05:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f7f58843-26e3-44ac-ba01-567c598143ef tempest-SnapshotDependencyTests-1559451915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50338163-ba68-4634-8d4e-64095757856c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:05:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f7f58843-26e3-44ac-ba01-567c598143ef tempest-SnapshotDependencyTests-1559451915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75408f44-bff7-482b-beea-7be5a0851e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:05:50 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-f7f58843-26e3-44ac-ba01-567c598143ef tempest-SnapshotDependencyTests-1559451915 None] Volume volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e (ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e): created successfully Jul 30 17:05:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f7f58843-26e3-44ac-ba01-567c598143ef tempest-SnapshotDependencyTests-1559451915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75408f44-bff7-482b-beea-7be5a0851e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:05:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f7f58843-26e3-44ac-ba01-567c598143ef tempest-SnapshotDependencyTests-1559451915 None] Flow 'volume_create_manager' (c7f580dc-4b54-4d5b-972a-85729235d3b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:05:50 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-f7f58843-26e3-44ac-ba01-567c598143ef tempest-SnapshotDependencyTests-1559451915 None] Created volume successfully. Jul 30 17:05:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b08575d0-a247-4df8-a9ef-2d05d109ed24 tempest-SnapshotDependencyTests-1559451915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:05:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b08575d0-a247-4df8-a9ef-2d05d109ed24 tempest-SnapshotDependencyTests-1559451915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:05:50 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-b08575d0-a247-4df8-a9ef-2d05d109ed24 tempest-SnapshotDependencyTests-1559451915 None] Creating offline snapshot 1b7e87d9-83df-4c1a-95dc-a4a28e6158a5 of volume ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:05:50 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[db62b8bc-4060-4dbc-b490-01753b25d163]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:05:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b08575d0-a247-4df8-a9ef-2d05d109ed24 tempest-SnapshotDependencyTests-1559451915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:05:50 devstack sudo[105927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e Jul 30 17:05:50 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:05:51 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root Jul 30 17:05:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b08575d0-a247-4df8-a9ef-2d05d109ed24 tempest-SnapshotDependencyTests-1559451915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e" returned: 0 in 0.646s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:05:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b08575d0-a247-4df8-a9ef-2d05d109ed24 tempest-SnapshotDependencyTests-1559451915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e.1b7e87d9-83df-4c1a-95dc-a4a28e6158a5 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:05:51 devstack sudo[105993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e.1b7e87d9-83df-4c1a-95dc-a4a28e6158a5 1G Jul 30 17:05:51 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:05:51 devstack cinder-volume[88591]: INFO cinder.volume.manager [req-7d0beda2-5e87-4705-887b-2bdf4bb11f0e req-a83bed28-fb3b-4451-89c9-8f37bae03f39 tempest-TestStampPattern-175323318 None] Terminate volume connection completed successfully. Jul 30 17:05:51 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-7d0beda2-5e87-4705-887b-2bdf4bb11f0e req-a83bed28-fb3b-4451-89c9-8f37bae03f39 tempest-TestStampPattern-175323318 None] Deleting attachment bafd6275-17b2-41d6-b519-53782fdbd1aa. {{(pid=88591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 17:05:52 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root Jul 30 17:05:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b08575d0-a247-4df8-a9ef-2d05d109ed24 tempest-SnapshotDependencyTests-1559451915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e.1b7e87d9-83df-4c1a-95dc-a4a28e6158a5 1G" returned: 0 in 0.675s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:05:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b08575d0-a247-4df8-a9ef-2d05d109ed24 tempest-SnapshotDependencyTests-1559451915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e.1b7e87d9-83df-4c1a-95dc-a4a28e6158a5 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:05:52 devstack sudo[106031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e.1b7e87d9-83df-4c1a-95dc-a4a28e6158a5 Jul 30 17:05:52 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:05:52 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root Jul 30 17:05:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b08575d0-a247-4df8-a9ef-2d05d109ed24 tempest-SnapshotDependencyTests-1559451915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e.1b7e87d9-83df-4c1a-95dc-a4a28e6158a5" returned: 0 in 0.407s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:05:52 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-b08575d0-a247-4df8-a9ef-2d05d109ed24 tempest-SnapshotDependencyTests-1559451915 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e.1b7e87d9-83df-4c1a-95dc-a4a28e6158a5 is being set with open permissions: ugo+rw Jul 30 17:05:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b08575d0-a247-4df8-a9ef-2d05d109ed24 tempest-SnapshotDependencyTests-1559451915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e.1b7e87d9-83df-4c1a-95dc-a4a28e6158a5 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:05:52 devstack sudo[106041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e.1b7e87d9-83df-4c1a-95dc-a4a28e6158a5 Jul 30 17:05:52 devstack sudo[106041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:05:52 devstack sudo[106041]: pam_unix(sudo:session): session closed for user root Jul 30 17:05:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b08575d0-a247-4df8-a9ef-2d05d109ed24 tempest-SnapshotDependencyTests-1559451915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e.1b7e87d9-83df-4c1a-95dc-a4a28e6158a5" returned: 0 in 0.299s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:05:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b08575d0-a247-4df8-a9ef-2d05d109ed24 tempest-SnapshotDependencyTests-1559451915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:05:52 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e.info Jul 30 17:05:52 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:05:53 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Jul 30 17:05:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b08575d0-a247-4df8-a9ef-2d05d109ed24 tempest-SnapshotDependencyTests-1559451915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e.info" returned: 0 in 0.372s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:05:53 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-b08575d0-a247-4df8-a9ef-2d05d109ed24 tempest-SnapshotDependencyTests-1559451915 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e.info is being set with open permissions: ugo+rw Jul 30 17:05:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b08575d0-a247-4df8-a9ef-2d05d109ed24 tempest-SnapshotDependencyTests-1559451915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:05:53 devstack sudo[106049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e.info Jul 30 17:05:53 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:05:53 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root Jul 30 17:05:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b08575d0-a247-4df8-a9ef-2d05d109ed24 tempest-SnapshotDependencyTests-1559451915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e.info" returned: 0 in 0.276s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:05:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b08575d0-a247-4df8-a9ef-2d05d109ed24 tempest-SnapshotDependencyTests-1559451915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.850s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:05:53 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-b08575d0-a247-4df8-a9ef-2d05d109ed24 tempest-SnapshotDependencyTests-1559451915 None] Create snapshot completed successfully Jul 30 17:05:54 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c3df363-d650-4a2c-bb0a-f978b6678c98 tempest-SnapshotDependencyTests-1559451915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:05:54 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0c3df363-d650-4a2c-bb0a-f978b6678c98 tempest-SnapshotDependencyTests-1559451915 None] Flow 'volume_create_manager' (8e5003ea-e14f-41e8-a99a-23059651298e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:05:54 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0c3df363-d650-4a2c-bb0a-f978b6678c98 tempest-SnapshotDependencyTests-1559451915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d244c339-dcfd-4bbe-b549-ebff77de506c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:05:54 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0c3df363-d650-4a2c-bb0a-f978b6678c98 tempest-SnapshotDependencyTests-1559451915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d244c339-dcfd-4bbe-b549-ebff77de506c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:05:54Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a21a64f-0d6e-4852-8b98-e05e43afb3de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26b67a9e1e3845d88aea4f9894e61543',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:05:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1b7e87d9-83df-4c1a-95dc-a4a28e6158a5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:05:55Z,use_quota=True,user_id='63f85066fe3b41f5bb8d824b05505d64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:05:54 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0c3df363-d650-4a2c-bb0a-f978b6678c98 tempest-SnapshotDependencyTests-1559451915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbf92f49-4442-4f4d-a5fc-ec78f220d113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:05:54 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0c3df363-d650-4a2c-bb0a-f978b6678c98 tempest-SnapshotDependencyTests-1559451915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbf92f49-4442-4f4d-a5fc-ec78f220d113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:05:54 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0c3df363-d650-4a2c-bb0a-f978b6678c98 tempest-SnapshotDependencyTests-1559451915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c9fd114-4392-413b-a23f-008c7bc6065d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:05:55 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0c3df363-d650-4a2c-bb0a-f978b6678c98 tempest-SnapshotDependencyTests-1559451915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c9fd114-4392-413b-a23f-008c7bc6065d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6a21a64f-0d6e-4852-8b98-e05e43afb3de', 'volume_name': 'volume-6a21a64f-0d6e-4852-8b98-e05e43afb3de', 'volume_size': 1, 'snapshot_id': '1b7e87d9-83df-4c1a-95dc-a4a28e6158a5'}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:05:55 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0c3df363-d650-4a2c-bb0a-f978b6678c98 tempest-SnapshotDependencyTests-1559451915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d895a35-ba48-4cc9-9f71-2c7514398cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:05:55 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0c3df363-d650-4a2c-bb0a-f978b6678c98 tempest-SnapshotDependencyTests-1559451915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d895a35-ba48-4cc9-9f71-2c7514398cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:05:55 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0c3df363-d650-4a2c-bb0a-f978b6678c98 tempest-SnapshotDependencyTests-1559451915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12f8ecac-b780-4187-9989-461139d27864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:05:55 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-0c3df363-d650-4a2c-bb0a-f978b6678c98 tempest-SnapshotDependencyTests-1559451915 None] Volume 6a21a64f-0d6e-4852-8b98-e05e43afb3de: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6a21a64f-0d6e-4852-8b98-e05e43afb3de', 'volume_size': 1, 'snapshot_id': '1b7e87d9-83df-4c1a-95dc-a4a28e6158a5'} Jul 30 17:05:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0c3df363-d650-4a2c-bb0a-f978b6678c98 tempest-SnapshotDependencyTests-1559451915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:05:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0c3df363-d650-4a2c-bb0a-f978b6678c98 tempest-SnapshotDependencyTests-1559451915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:05:55 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-0c3df363-d650-4a2c-bb0a-f978b6678c98 tempest-SnapshotDependencyTests-1559451915 None] Acquiring lock "cinder-quobyte-1b7e87d9-83df-4c1a-95dc-a4a28e6158a5-6a21a64f-0d6e-4852-8b98-e05e43afb3de" by "_create_volume_from_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:05:55 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-0c3df363-d650-4a2c-bb0a-f978b6678c98 tempest-SnapshotDependencyTests-1559451915 None] Lock "cinder-quobyte-1b7e87d9-83df-4c1a-95dc-a4a28e6158a5-6a21a64f-0d6e-4852-8b98-e05e43afb3de" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:05:55 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-0c3df363-d650-4a2c-bb0a-f978b6678c98 tempest-SnapshotDependencyTests-1559451915 None] Creating volume 6a21a64f-0d6e-4852-8b98-e05e43afb3de from snapshot 1b7e87d9-83df-4c1a-95dc-a4a28e6158a5 {{(pid=88591) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 30 17:05:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0c3df363-d650-4a2c-bb0a-f978b6678c98 tempest-SnapshotDependencyTests-1559451915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:05:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0c3df363-d650-4a2c-bb0a-f978b6678c98 tempest-SnapshotDependencyTests-1559451915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:05:55 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-0c3df363-d650-4a2c-bb0a-f978b6678c98 tempest-SnapshotDependencyTests-1559451915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:05:55 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-0c3df363-d650-4a2c-bb0a-f978b6678c98 tempest-SnapshotDependencyTests-1559451915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:05:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0c3df363-d650-4a2c-bb0a-f978b6678c98 tempest-SnapshotDependencyTests-1559451915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:05:55 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-0c3df363-d650-4a2c-bb0a-f978b6678c98 tempest-SnapshotDependencyTests-1559451915 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:05:55 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-0c3df363-d650-4a2c-bb0a-f978b6678c98 tempest-SnapshotDependencyTests-1559451915 None] Acquiring lock "cinder-quobyte-6a21a64f-0d6e-4852-8b98-e05e43afb3de" by "_copy_volume_from_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:05:55 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-0c3df363-d650-4a2c-bb0a-f978b6678c98 tempest-SnapshotDependencyTests-1559451915 None] Lock "cinder-quobyte-6a21a64f-0d6e-4852-8b98-e05e43afb3de" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:05:55 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-0c3df363-d650-4a2c-bb0a-f978b6678c98 tempest-SnapshotDependencyTests-1559451915 None] snapshot: 1b7e87d9-83df-4c1a-95dc-a4a28e6158a5, volume: 6a21a64f-0d6e-4852-8b98-e05e43afb3de, {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 17:05:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0c3df363-d650-4a2c-bb0a-f978b6678c98 tempest-SnapshotDependencyTests-1559451915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:05:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0c3df363-d650-4a2c-bb0a-f978b6678c98 tempest-SnapshotDependencyTests-1559451915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:05:55 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-0c3df363-d650-4a2c-bb0a-f978b6678c98 tempest-SnapshotDependencyTests-1559451915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:05:55 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-0c3df363-d650-4a2c-bb0a-f978b6678c98 tempest-SnapshotDependencyTests-1559451915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:05:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0c3df363-d650-4a2c-bb0a-f978b6678c98 tempest-SnapshotDependencyTests-1559451915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:05:55 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a76419-c22d-432d-abc1-b41587ca90bb]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:05:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0c3df363-d650-4a2c-bb0a-f978b6678c98 tempest-SnapshotDependencyTests-1559451915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e.1b7e87d9-83df-4c1a-95dc-a4a28e6158a5 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:05:55 devstack sudo[106079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e.1b7e87d9-83df-4c1a-95dc-a4a28e6158a5 Jul 30 17:05:55 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:05:55 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root Jul 30 17:05:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0c3df363-d650-4a2c-bb0a-f978b6678c98 tempest-SnapshotDependencyTests-1559451915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e.1b7e87d9-83df-4c1a-95dc-a4a28e6158a5" returned: 0 in 0.473s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:05:55 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-0c3df363-d650-4a2c-bb0a-f978b6678c98 tempest-SnapshotDependencyTests-1559451915 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:05:55 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9bca7cc-65eb-402e-8839-80f6e4da9144]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:05:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0c3df363-d650-4a2c-bb0a-f978b6678c98 tempest-SnapshotDependencyTests-1559451915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:05:55 devstack sudo[106086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e Jul 30 17:05:55 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:05:56 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root Jul 30 17:05:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0c3df363-d650-4a2c-bb0a-f978b6678c98 tempest-SnapshotDependencyTests-1559451915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e" returned: 0 in 0.422s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:05:56 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-0c3df363-d650-4a2c-bb0a-f978b6678c98 tempest-SnapshotDependencyTests-1559451915 None] will copy from snapshot at /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 17:05:56 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-0c3df363-d650-4a2c-bb0a-f978b6678c98 tempest-SnapshotDependencyTests-1559451915 None] Creating direct copy from snapshot {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 17:05:56 devstack cinder-volume[88591]: DEBUG cinder.utils [None req-0c3df363-d650-4a2c-bb0a-f978b6678c98 tempest-SnapshotDependencyTests-1559451915 None] Path /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-6a21a64f-0d6e-4852-8b98-e05e43afb3de not found in is_blk_device check {{(pid=88591) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 17:05:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0c3df363-d650-4a2c-bb0a-f978b6678c98 tempest-SnapshotDependencyTests-1559451915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-6a21a64f-0d6e-4852-8b98-e05e43afb3de {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:05:56 devstack sudo[106091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-6a21a64f-0d6e-4852-8b98-e05e43afb3de Jul 30 17:05:56 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:05:56 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-0779eb78-f4c8-4b2e-9d4e-b44a07199332 tempest-TestStampPattern-175323318 None] Acquiring lock "cinder-d5154fcd-fff4-4ad4-a37e-ebe77bc53d76-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:05:56 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-0779eb78-f4c8-4b2e-9d4e-b44a07199332 tempest-TestStampPattern-175323318 None] Lock "cinder-d5154fcd-fff4-4ad4-a37e-ebe77bc53d76-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:05:56 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-0779eb78-f4c8-4b2e-9d4e-b44a07199332 tempest-TestStampPattern-175323318 None] Acquiring lock "cinder-quobyte-d5154fcd-fff4-4ad4-a37e-ebe77bc53d76" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:05:56 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-0779eb78-f4c8-4b2e-9d4e-b44a07199332 tempest-TestStampPattern-175323318 None] Lock "cinder-quobyte-d5154fcd-fff4-4ad4-a37e-ebe77bc53d76" acquired by "delete_volume" :: waited 0.048s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:05:56 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d29faf6-f00e-4419-a8ce-b005ab0deeec]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:05:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0779eb78-f4c8-4b2e-9d4e-b44a07199332 tempest-TestStampPattern-175323318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d5154fcd-fff4-4ad4-a37e-ebe77bc53d76 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:05:57 devstack sudo[106104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d5154fcd-fff4-4ad4-a37e-ebe77bc53d76 Jul 30 17:05:57 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:05:57 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root Jul 30 17:05:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0779eb78-f4c8-4b2e-9d4e-b44a07199332 tempest-TestStampPattern-175323318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d5154fcd-fff4-4ad4-a37e-ebe77bc53d76" returned: 0 in 0.926s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:05:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0779eb78-f4c8-4b2e-9d4e-b44a07199332 tempest-TestStampPattern-175323318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d5154fcd-fff4-4ad4-a37e-ebe77bc53d76 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:05:57 devstack sudo[106114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d5154fcd-fff4-4ad4-a37e-ebe77bc53d76 Jul 30 17:05:57 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:05:58 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root Jul 30 17:05:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0779eb78-f4c8-4b2e-9d4e-b44a07199332 tempest-TestStampPattern-175323318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d5154fcd-fff4-4ad4-a37e-ebe77bc53d76" returned: 0 in 0.857s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:05:58 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-0779eb78-f4c8-4b2e-9d4e-b44a07199332 tempest-TestStampPattern-175323318 None] Lock "cinder-quobyte-d5154fcd-fff4-4ad4-a37e-ebe77bc53d76" released by "delete_volume" :: held 1.919s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:05:58 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-0779eb78-f4c8-4b2e-9d4e-b44a07199332 tempest-TestStampPattern-175323318 None] Created reservations ['606cfbad-a870-4be4-be29-f24a0265f33a', '24876e4e-53dc-4499-b5eb-c20ed85591ff', '479b99df-f9af-46bd-96c1-e3946d79d80b', '7af84efc-3ca4-4065-9db5-ee6ad1c61efb'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:05:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0779eb78-f4c8-4b2e-9d4e-b44a07199332 tempest-TestStampPattern-175323318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:05:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0779eb78-f4c8-4b2e-9d4e-b44a07199332 tempest-TestStampPattern-175323318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:05:59 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-0779eb78-f4c8-4b2e-9d4e-b44a07199332 tempest-TestStampPattern-175323318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:05:59 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-0779eb78-f4c8-4b2e-9d4e-b44a07199332 tempest-TestStampPattern-175323318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:05:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0779eb78-f4c8-4b2e-9d4e-b44a07199332 tempest-TestStampPattern-175323318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:05:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0779eb78-f4c8-4b2e-9d4e-b44a07199332 tempest-TestStampPattern-175323318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:05:59 devstack sudo[106121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:05:59 devstack sudo[106121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:00 devstack sudo[106121]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0779eb78-f4c8-4b2e-9d4e-b44a07199332 tempest-TestStampPattern-175323318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.825s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:00 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-0779eb78-f4c8-4b2e-9d4e-b44a07199332 tempest-TestStampPattern-175323318 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:06:00 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-0779eb78-f4c8-4b2e-9d4e-b44a07199332 tempest-TestStampPattern-175323318 None] Deleted volume successfully. Jul 30 17:06:00 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f58dcd13-579c-4c34-a187-bf3e817b66c2 tempest-TestStampPattern-175323318 None] Acquiring lock "cinder-a4263675-7926-418f-bdef-be8a8ad9aa91-delete_snapshot" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:06:00 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-0779eb78-f4c8-4b2e-9d4e-b44a07199332 tempest-TestStampPattern-175323318 None] Lock "cinder-d5154fcd-fff4-4ad4-a37e-ebe77bc53d76-delete_volume" released by "delete_volume" :: held 3.450s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:06:00 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f58dcd13-579c-4c34-a187-bf3e817b66c2 tempest-TestStampPattern-175323318 None] Lock "cinder-a4263675-7926-418f-bdef-be8a8ad9aa91-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:06:00 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f58dcd13-579c-4c34-a187-bf3e817b66c2 tempest-TestStampPattern-175323318 None] Acquiring lock "cinder-quobyte-9990c0c7-e431-40eb-955e-4855b5808fbe" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:06:00 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f58dcd13-579c-4c34-a187-bf3e817b66c2 tempest-TestStampPattern-175323318 None] Lock "cinder-quobyte-9990c0c7-e431-40eb-955e-4855b5808fbe" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:06:00 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f58dcd13-579c-4c34-a187-bf3e817b66c2 tempest-TestStampPattern-175323318 None] Acquiring lock "cinder-quobyte-a4263675-7926-418f-bdef-be8a8ad9aa91" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:06:00 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f58dcd13-579c-4c34-a187-bf3e817b66c2 tempest-TestStampPattern-175323318 None] Lock "cinder-quobyte-a4263675-7926-418f-bdef-be8a8ad9aa91" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:06:00 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-f58dcd13-579c-4c34-a187-bf3e817b66c2 tempest-TestStampPattern-175323318 None] Deleting offline snapshot a4263675-7926-418f-bdef-be8a8ad9aa91 of volume 9990c0c7-e431-40eb-955e-4855b5808fbe {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:06:00 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-f58dcd13-579c-4c34-a187-bf3e817b66c2 tempest-TestStampPattern-175323318 None] snapshot_file for this snap is: volume-9990c0c7-e431-40eb-955e-4855b5808fbe.a4263675-7926-418f-bdef-be8a8ad9aa91 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:06:00 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf46dcc0-ce07-4557-9303-09ea9b8ca53b]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:06:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f58dcd13-579c-4c34-a187-bf3e817b66c2 tempest-TestStampPattern-175323318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9990c0c7-e431-40eb-955e-4855b5808fbe.a4263675-7926-418f-bdef-be8a8ad9aa91 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:00 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9990c0c7-e431-40eb-955e-4855b5808fbe.a4263675-7926-418f-bdef-be8a8ad9aa91 Jul 30 17:06:00 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:01 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f58dcd13-579c-4c34-a187-bf3e817b66c2 tempest-TestStampPattern-175323318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9990c0c7-e431-40eb-955e-4855b5808fbe.a4263675-7926-418f-bdef-be8a8ad9aa91" returned: 0 in 1.013s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:01 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-f58dcd13-579c-4c34-a187-bf3e817b66c2 tempest-TestStampPattern-175323318 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9990c0c7-e431-40eb-955e-4855b5808fbe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:06:01 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf04669-635a-4875-ad00-d2a9085f0fff]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:06:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f58dcd13-579c-4c34-a187-bf3e817b66c2 tempest-TestStampPattern-175323318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9990c0c7-e431-40eb-955e-4855b5808fbe {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:01 devstack sudo[106129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9990c0c7-e431-40eb-955e-4855b5808fbe Jul 30 17:06:01 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0c3df363-d650-4a2c-bb0a-f978b6678c98 tempest-SnapshotDependencyTests-1559451915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-6a21a64f-0d6e-4852-8b98-e05e43afb3de" returned: 0 in 6.439s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:02 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-0c3df363-d650-4a2c-bb0a-f978b6678c98 tempest-SnapshotDependencyTests-1559451915 None] Image conversion details: src /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e, size 1024.00 MB, duration 6.44 sec, destination /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-6a21a64f-0d6e-4852-8b98-e05e43afb3de {{(pid=88591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 17:06:02 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-0c3df363-d650-4a2c-bb0a-f978b6678c98 tempest-SnapshotDependencyTests-1559451915 None] Converted 1024.00 MB image at 158.99 MB/s Jul 30 17:06:02 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-0c3df363-d650-4a2c-bb0a-f978b6678c98 tempest-SnapshotDependencyTests-1559451915 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-6a21a64f-0d6e-4852-8b98-e05e43afb3de is being set with open permissions: ugo+rw Jul 30 17:06:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0c3df363-d650-4a2c-bb0a-f978b6678c98 tempest-SnapshotDependencyTests-1559451915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-6a21a64f-0d6e-4852-8b98-e05e43afb3de {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:02 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-6a21a64f-0d6e-4852-8b98-e05e43afb3de Jul 30 17:06:02 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:02 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f58dcd13-579c-4c34-a187-bf3e817b66c2 tempest-TestStampPattern-175323318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9990c0c7-e431-40eb-955e-4855b5808fbe" returned: 0 in 1.229s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f58dcd13-579c-4c34-a187-bf3e817b66c2 tempest-TestStampPattern-175323318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9990c0c7-e431-40eb-955e-4855b5808fbe.a4263675-7926-418f-bdef-be8a8ad9aa91 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:02 devstack sudo[106138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9990c0c7-e431-40eb-955e-4855b5808fbe.a4263675-7926-418f-bdef-be8a8ad9aa91 Jul 30 17:06:02 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:02 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0c3df363-d650-4a2c-bb0a-f978b6678c98 tempest-SnapshotDependencyTests-1559451915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-6a21a64f-0d6e-4852-8b98-e05e43afb3de" returned: 0 in 0.368s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:02 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-0c3df363-d650-4a2c-bb0a-f978b6678c98 tempest-SnapshotDependencyTests-1559451915 None] Lock "cinder-quobyte-6a21a64f-0d6e-4852-8b98-e05e43afb3de" released by "_copy_volume_from_snapshot" :: held 7.823s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:06:02 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-0c3df363-d650-4a2c-bb0a-f978b6678c98 tempest-SnapshotDependencyTests-1559451915 None] Lock "cinder-quobyte-1b7e87d9-83df-4c1a-95dc-a4a28e6158a5-6a21a64f-0d6e-4852-8b98-e05e43afb3de" released by "_create_volume_from_snapshot" :: held 7.912s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:06:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0c3df363-d650-4a2c-bb0a-f978b6678c98 tempest-SnapshotDependencyTests-1559451915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.933s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:06:03 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0c3df363-d650-4a2c-bb0a-f978b6678c98 tempest-SnapshotDependencyTests-1559451915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12f8ecac-b780-4187-9989-461139d27864) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a21a64f-0d6e-4852-8b98-e05e43afb3de', 'volume_size': 1, 'snapshot_id': '1b7e87d9-83df-4c1a-95dc-a4a28e6158a5'}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:03 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0c3df363-d650-4a2c-bb0a-f978b6678c98 tempest-SnapshotDependencyTests-1559451915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5a1305e-b9b9-4914-a1fe-28543b17f489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:03 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-0c3df363-d650-4a2c-bb0a-f978b6678c98 tempest-SnapshotDependencyTests-1559451915 None] Volume volume-6a21a64f-0d6e-4852-8b98-e05e43afb3de (6a21a64f-0d6e-4852-8b98-e05e43afb3de): created successfully Jul 30 17:06:03 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0c3df363-d650-4a2c-bb0a-f978b6678c98 tempest-SnapshotDependencyTests-1559451915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5a1305e-b9b9-4914-a1fe-28543b17f489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:03 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-0c3df363-d650-4a2c-bb0a-f978b6678c98 tempest-SnapshotDependencyTests-1559451915 None] Flow 'volume_create_manager' (8e5003ea-e14f-41e8-a99a-23059651298e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:06:03 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-0c3df363-d650-4a2c-bb0a-f978b6678c98 tempest-SnapshotDependencyTests-1559451915 None] Created volume successfully. Jul 30 17:06:03 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f58dcd13-579c-4c34-a187-bf3e817b66c2 tempest-TestStampPattern-175323318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9990c0c7-e431-40eb-955e-4855b5808fbe.a4263675-7926-418f-bdef-be8a8ad9aa91" returned: 0 in 0.585s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f58dcd13-579c-4c34-a187-bf3e817b66c2 tempest-TestStampPattern-175323318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9990c0c7-e431-40eb-955e-4855b5808fbe.a4263675-7926-418f-bdef-be8a8ad9aa91 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:03 devstack sudo[106145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9990c0c7-e431-40eb-955e-4855b5808fbe.a4263675-7926-418f-bdef-be8a8ad9aa91 Jul 30 17:06:03 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:03 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f58dcd13-579c-4c34-a187-bf3e817b66c2 tempest-TestStampPattern-175323318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9990c0c7-e431-40eb-955e-4855b5808fbe.a4263675-7926-418f-bdef-be8a8ad9aa91" returned: 0 in 0.455s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:03 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f58dcd13-579c-4c34-a187-bf3e817b66c2 tempest-TestStampPattern-175323318 None] Lock "cinder-quobyte-a4263675-7926-418f-bdef-be8a8ad9aa91" released by "_delete_snapshot" :: held 3.562s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:06:03 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f58dcd13-579c-4c34-a187-bf3e817b66c2 tempest-TestStampPattern-175323318 None] Lock "cinder-quobyte-9990c0c7-e431-40eb-955e-4855b5808fbe" released by "delete_snapshot" :: held 3.621s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:06:03 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f3e94a74-87cf-4599-a1c9-f221e5b94cf3 tempest-SnapshotDependencyTests-1559451915 None] Acquiring lock "cinder-1b7e87d9-83df-4c1a-95dc-a4a28e6158a5-delete_snapshot" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:06:03 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-f58dcd13-579c-4c34-a187-bf3e817b66c2 tempest-TestStampPattern-175323318 None] Created reservations ['5ed6f052-d89c-4343-866a-a6efe37ad65a', '94a00420-8087-4356-86bb-e6e9ac7445d7', '34e27cef-c81d-46c0-b248-a3d92df8f537', '963f26f1-f972-404e-8b9b-8db0aaedcb83'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:06:04 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f3e94a74-87cf-4599-a1c9-f221e5b94cf3 tempest-SnapshotDependencyTests-1559451915 None] Lock "cinder-1b7e87d9-83df-4c1a-95dc-a4a28e6158a5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:06:04 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f3e94a74-87cf-4599-a1c9-f221e5b94cf3 tempest-SnapshotDependencyTests-1559451915 None] Acquiring lock "cinder-quobyte-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:06:04 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f3e94a74-87cf-4599-a1c9-f221e5b94cf3 tempest-SnapshotDependencyTests-1559451915 None] Lock "cinder-quobyte-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:06:04 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f3e94a74-87cf-4599-a1c9-f221e5b94cf3 tempest-SnapshotDependencyTests-1559451915 None] Acquiring lock "cinder-quobyte-1b7e87d9-83df-4c1a-95dc-a4a28e6158a5" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:06:04 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f3e94a74-87cf-4599-a1c9-f221e5b94cf3 tempest-SnapshotDependencyTests-1559451915 None] Lock "cinder-quobyte-1b7e87d9-83df-4c1a-95dc-a4a28e6158a5" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:06:04 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-f3e94a74-87cf-4599-a1c9-f221e5b94cf3 tempest-SnapshotDependencyTests-1559451915 None] Deleting offline snapshot 1b7e87d9-83df-4c1a-95dc-a4a28e6158a5 of volume ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:06:04 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-f3e94a74-87cf-4599-a1c9-f221e5b94cf3 tempest-SnapshotDependencyTests-1559451915 None] snapshot_file for this snap is: volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e.1b7e87d9-83df-4c1a-95dc-a4a28e6158a5 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:06:04 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8879cf80-138a-4ec1-8e0b-ea9c63a0301e]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:06:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f3e94a74-87cf-4599-a1c9-f221e5b94cf3 tempest-SnapshotDependencyTests-1559451915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e.1b7e87d9-83df-4c1a-95dc-a4a28e6158a5 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:04 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-f58dcd13-579c-4c34-a187-bf3e817b66c2 tempest-TestStampPattern-175323318 None] Delete snapshot completed successfully. Jul 30 17:06:04 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f58dcd13-579c-4c34-a187-bf3e817b66c2 tempest-TestStampPattern-175323318 None] Lock "cinder-a4263675-7926-418f-bdef-be8a8ad9aa91-delete_snapshot" released by "delete_snapshot" :: held 3.954s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:06:04 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e.1b7e87d9-83df-4c1a-95dc-a4a28e6158a5 Jul 30 17:06:04 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:04 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f3e94a74-87cf-4599-a1c9-f221e5b94cf3 tempest-SnapshotDependencyTests-1559451915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e.1b7e87d9-83df-4c1a-95dc-a4a28e6158a5" returned: 0 in 0.414s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:04 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-f3e94a74-87cf-4599-a1c9-f221e5b94cf3 tempest-SnapshotDependencyTests-1559451915 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:06:04 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7188a8-9417-4bf6-bfc9-0f9ee025a47f]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:06:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f3e94a74-87cf-4599-a1c9-f221e5b94cf3 tempest-SnapshotDependencyTests-1559451915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:04 devstack sudo[106153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e Jul 30 17:06:04 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:05 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f3e94a74-87cf-4599-a1c9-f221e5b94cf3 tempest-SnapshotDependencyTests-1559451915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e" returned: 0 in 0.581s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f3e94a74-87cf-4599-a1c9-f221e5b94cf3 tempest-SnapshotDependencyTests-1559451915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e.1b7e87d9-83df-4c1a-95dc-a4a28e6158a5 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:05 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e.1b7e87d9-83df-4c1a-95dc-a4a28e6158a5 Jul 30 17:06:05 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:05 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f3e94a74-87cf-4599-a1c9-f221e5b94cf3 tempest-SnapshotDependencyTests-1559451915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e.1b7e87d9-83df-4c1a-95dc-a4a28e6158a5" returned: 0 in 0.486s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f3e94a74-87cf-4599-a1c9-f221e5b94cf3 tempest-SnapshotDependencyTests-1559451915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e.1b7e87d9-83df-4c1a-95dc-a4a28e6158a5 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:05 devstack sudo[106167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e.1b7e87d9-83df-4c1a-95dc-a4a28e6158a5 Jul 30 17:06:05 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:05 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f3e94a74-87cf-4599-a1c9-f221e5b94cf3 tempest-SnapshotDependencyTests-1559451915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e.1b7e87d9-83df-4c1a-95dc-a4a28e6158a5" returned: 0 in 0.296s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:06 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f3e94a74-87cf-4599-a1c9-f221e5b94cf3 tempest-SnapshotDependencyTests-1559451915 None] Lock "cinder-quobyte-1b7e87d9-83df-4c1a-95dc-a4a28e6158a5" released by "_delete_snapshot" :: held 1.919s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:06:06 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f3e94a74-87cf-4599-a1c9-f221e5b94cf3 tempest-SnapshotDependencyTests-1559451915 None] Lock "cinder-quobyte-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e" released by "delete_snapshot" :: held 1.972s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:06:06 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-f3e94a74-87cf-4599-a1c9-f221e5b94cf3 tempest-SnapshotDependencyTests-1559451915 None] Created reservations ['f4030630-f506-4cc2-ad90-1edcf2b1aceb', 'e363dddb-c159-4208-a182-1410b2aa2684', '20a7b0ed-7c64-4859-8419-be3a3cbded1a', '99f5af7f-21b9-4b95-b321-a1a2a46092c9'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:06:06 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-f3e94a74-87cf-4599-a1c9-f221e5b94cf3 tempest-SnapshotDependencyTests-1559451915 None] Delete snapshot completed successfully. Jul 30 17:06:06 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f3e94a74-87cf-4599-a1c9-f221e5b94cf3 tempest-SnapshotDependencyTests-1559451915 None] Lock "cinder-1b7e87d9-83df-4c1a-95dc-a4a28e6158a5-delete_snapshot" released by "delete_snapshot" :: held 2.266s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:06:07 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-a6d855b6-4b70-4610-9520-1fa8489a5817 tempest-SnapshotDependencyTests-1559451915 None] Acquiring lock "cinder-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:06:07 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-a6d855b6-4b70-4610-9520-1fa8489a5817 tempest-SnapshotDependencyTests-1559451915 None] Lock "cinder-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:06:07 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-a6d855b6-4b70-4610-9520-1fa8489a5817 tempest-SnapshotDependencyTests-1559451915 None] Acquiring lock "cinder-quobyte-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:06:07 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-a6d855b6-4b70-4610-9520-1fa8489a5817 tempest-SnapshotDependencyTests-1559451915 None] Lock "cinder-quobyte-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e" acquired by "delete_volume" :: waited 0.018s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:06:07 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[305db34b-b715-4542-a4b2-29e5911979d6]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:06:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a6d855b6-4b70-4610-9520-1fa8489a5817 tempest-SnapshotDependencyTests-1559451915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:07 devstack sudo[106194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e Jul 30 17:06:07 devstack sudo[106194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:07 devstack sudo[106194]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a6d855b6-4b70-4610-9520-1fa8489a5817 tempest-SnapshotDependencyTests-1559451915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e" returned: 0 in 0.490s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a6d855b6-4b70-4610-9520-1fa8489a5817 tempest-SnapshotDependencyTests-1559451915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:07 devstack sudo[106201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e Jul 30 17:06:07 devstack sudo[106201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:08 devstack sudo[106201]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a6d855b6-4b70-4610-9520-1fa8489a5817 tempest-SnapshotDependencyTests-1559451915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e" returned: 0 in 0.361s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:08 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-a6d855b6-4b70-4610-9520-1fa8489a5817 tempest-SnapshotDependencyTests-1559451915 None] Lock "cinder-quobyte-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e" released by "delete_volume" :: held 0.932s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:06:08 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-a6d855b6-4b70-4610-9520-1fa8489a5817 tempest-SnapshotDependencyTests-1559451915 None] Created reservations ['f4e3a453-a9eb-4b92-a8ab-9c5115c5f38b', 'e3d34e4f-459f-4e08-89a1-aa721644d9a0', '5b3096f1-bd2e-41fb-b7c3-e19652e3f202', '5fee8c66-9a3a-4633-99d6-c2a6791f1ac5'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:06:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a6d855b6-4b70-4610-9520-1fa8489a5817 tempest-SnapshotDependencyTests-1559451915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:06:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a6d855b6-4b70-4610-9520-1fa8489a5817 tempest-SnapshotDependencyTests-1559451915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:06:08 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a6d855b6-4b70-4610-9520-1fa8489a5817 tempest-SnapshotDependencyTests-1559451915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:06:08 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a6d855b6-4b70-4610-9520-1fa8489a5817 tempest-SnapshotDependencyTests-1559451915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:06:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a6d855b6-4b70-4610-9520-1fa8489a5817 tempest-SnapshotDependencyTests-1559451915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:06:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a6d855b6-4b70-4610-9520-1fa8489a5817 tempest-SnapshotDependencyTests-1559451915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:08 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:06:08 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:08 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a6d855b6-4b70-4610-9520-1fa8489a5817 tempest-SnapshotDependencyTests-1559451915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.280s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:08 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-a6d855b6-4b70-4610-9520-1fa8489a5817 tempest-SnapshotDependencyTests-1559451915 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:06:08 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-a6d855b6-4b70-4610-9520-1fa8489a5817 tempest-SnapshotDependencyTests-1559451915 None] Deleted volume successfully. Jul 30 17:06:08 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-a6d855b6-4b70-4610-9520-1fa8489a5817 tempest-SnapshotDependencyTests-1559451915 None] Lock "cinder-ba8a094b-aed1-42c3-8fe9-1a1f6a0ddd7e-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:06:08 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-fd8e411f-5b17-47e1-a805-8c53817be805 tempest-TestStampPattern-175323318 None] Acquiring lock "cinder-9990c0c7-e431-40eb-955e-4855b5808fbe-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:06:08 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-fd8e411f-5b17-47e1-a805-8c53817be805 tempest-TestStampPattern-175323318 None] Lock "cinder-9990c0c7-e431-40eb-955e-4855b5808fbe-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:06:08 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-fd8e411f-5b17-47e1-a805-8c53817be805 tempest-TestStampPattern-175323318 None] Acquiring lock "cinder-quobyte-9990c0c7-e431-40eb-955e-4855b5808fbe" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:06:08 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-fd8e411f-5b17-47e1-a805-8c53817be805 tempest-TestStampPattern-175323318 None] Lock "cinder-quobyte-9990c0c7-e431-40eb-955e-4855b5808fbe" acquired by "delete_volume" :: waited 0.017s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:06:08 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[213c9c77-f294-4ae9-a069-2f264f6a5d09]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:06:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fd8e411f-5b17-47e1-a805-8c53817be805 tempest-TestStampPattern-175323318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9990c0c7-e431-40eb-955e-4855b5808fbe {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:09 devstack sudo[106208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9990c0c7-e431-40eb-955e-4855b5808fbe Jul 30 17:06:09 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:09 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fd8e411f-5b17-47e1-a805-8c53817be805 tempest-TestStampPattern-175323318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9990c0c7-e431-40eb-955e-4855b5808fbe" returned: 0 in 0.403s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fd8e411f-5b17-47e1-a805-8c53817be805 tempest-TestStampPattern-175323318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9990c0c7-e431-40eb-955e-4855b5808fbe {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:09 devstack sudo[106213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9990c0c7-e431-40eb-955e-4855b5808fbe Jul 30 17:06:09 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:09 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7f5be18e-5fcb-4cc4-ac27-86a8fd43910a tempest-SnapshotDependencyTests-1559451915 None] Acquiring lock "cinder-6a21a64f-0d6e-4852-8b98-e05e43afb3de-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:06:09 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7f5be18e-5fcb-4cc4-ac27-86a8fd43910a tempest-SnapshotDependencyTests-1559451915 None] Lock "cinder-6a21a64f-0d6e-4852-8b98-e05e43afb3de-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:06:09 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7f5be18e-5fcb-4cc4-ac27-86a8fd43910a tempest-SnapshotDependencyTests-1559451915 None] Acquiring lock "cinder-quobyte-6a21a64f-0d6e-4852-8b98-e05e43afb3de" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:06:09 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7f5be18e-5fcb-4cc4-ac27-86a8fd43910a tempest-SnapshotDependencyTests-1559451915 None] Lock "cinder-quobyte-6a21a64f-0d6e-4852-8b98-e05e43afb3de" acquired by "delete_volume" :: waited 0.018s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:06:09 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac4c28e-0869-430a-a32f-c507d0a831a1]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:06:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7f5be18e-5fcb-4cc4-ac27-86a8fd43910a tempest-SnapshotDependencyTests-1559451915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-6a21a64f-0d6e-4852-8b98-e05e43afb3de {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:09 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fd8e411f-5b17-47e1-a805-8c53817be805 tempest-TestStampPattern-175323318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9990c0c7-e431-40eb-955e-4855b5808fbe" returned: 0 in 0.298s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:09 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-fd8e411f-5b17-47e1-a805-8c53817be805 tempest-TestStampPattern-175323318 None] Lock "cinder-quobyte-9990c0c7-e431-40eb-955e-4855b5808fbe" released by "delete_volume" :: held 0.778s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:06:09 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-fd8e411f-5b17-47e1-a805-8c53817be805 tempest-TestStampPattern-175323318 None] Created reservations ['2e0d2ead-35f4-489d-bfdb-713dc5bfa936', 'ff2b84ad-63f6-4c5a-bd1c-89e647c8c129', '4a7fa706-daf6-4961-ab10-eee008e3c8d4', 'b7806304-1c28-40e9-bbc8-67d64ba0124e'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:06:09 devstack sudo[106216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-6a21a64f-0d6e-4852-8b98-e05e43afb3de Jul 30 17:06:09 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-fd8e411f-5b17-47e1-a805-8c53817be805 tempest-TestStampPattern-175323318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:06:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-fd8e411f-5b17-47e1-a805-8c53817be805 tempest-TestStampPattern-175323318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:06:09 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-fd8e411f-5b17-47e1-a805-8c53817be805 tempest-TestStampPattern-175323318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:06:09 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-fd8e411f-5b17-47e1-a805-8c53817be805 tempest-TestStampPattern-175323318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:06:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-fd8e411f-5b17-47e1-a805-8c53817be805 tempest-TestStampPattern-175323318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:06:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fd8e411f-5b17-47e1-a805-8c53817be805 tempest-TestStampPattern-175323318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:09 devstack sudo[106218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:06:09 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:10 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7f5be18e-5fcb-4cc4-ac27-86a8fd43910a tempest-SnapshotDependencyTests-1559451915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-6a21a64f-0d6e-4852-8b98-e05e43afb3de" returned: 0 in 0.488s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7f5be18e-5fcb-4cc4-ac27-86a8fd43910a tempest-SnapshotDependencyTests-1559451915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-6a21a64f-0d6e-4852-8b98-e05e43afb3de {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:10 devstack sudo[106225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-6a21a64f-0d6e-4852-8b98-e05e43afb3de Jul 30 17:06:10 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:10 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fd8e411f-5b17-47e1-a805-8c53817be805 tempest-TestStampPattern-175323318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.377s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:10 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-fd8e411f-5b17-47e1-a805-8c53817be805 tempest-TestStampPattern-175323318 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:06:10 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-fd8e411f-5b17-47e1-a805-8c53817be805 tempest-TestStampPattern-175323318 None] Deleted volume successfully. Jul 30 17:06:10 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-fd8e411f-5b17-47e1-a805-8c53817be805 tempest-TestStampPattern-175323318 None] Lock "cinder-9990c0c7-e431-40eb-955e-4855b5808fbe-delete_volume" released by "delete_volume" :: held 1.404s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:06:10 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7f5be18e-5fcb-4cc4-ac27-86a8fd43910a tempest-SnapshotDependencyTests-1559451915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-6a21a64f-0d6e-4852-8b98-e05e43afb3de" returned: 0 in 0.353s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:10 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7f5be18e-5fcb-4cc4-ac27-86a8fd43910a tempest-SnapshotDependencyTests-1559451915 None] Lock "cinder-quobyte-6a21a64f-0d6e-4852-8b98-e05e43afb3de" released by "delete_volume" :: held 0.909s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:06:10 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-7f5be18e-5fcb-4cc4-ac27-86a8fd43910a tempest-SnapshotDependencyTests-1559451915 None] Created reservations ['b98e50a6-9ab7-4b3a-814b-024164427b8d', '7c3f005f-93c7-4d86-8f06-3089e5cab3bd', '6f8a2e2a-ee0a-4ad8-a577-49d5935bc93a', '09f48ad0-a30f-492f-bdef-a5e6117b4e66'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:06:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7f5be18e-5fcb-4cc4-ac27-86a8fd43910a tempest-SnapshotDependencyTests-1559451915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:06:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7f5be18e-5fcb-4cc4-ac27-86a8fd43910a tempest-SnapshotDependencyTests-1559451915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:06:10 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7f5be18e-5fcb-4cc4-ac27-86a8fd43910a tempest-SnapshotDependencyTests-1559451915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:06:10 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7f5be18e-5fcb-4cc4-ac27-86a8fd43910a tempest-SnapshotDependencyTests-1559451915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:06:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7f5be18e-5fcb-4cc4-ac27-86a8fd43910a tempest-SnapshotDependencyTests-1559451915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:06:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7f5be18e-5fcb-4cc4-ac27-86a8fd43910a tempest-SnapshotDependencyTests-1559451915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:10 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:06:10 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:10 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7f5be18e-5fcb-4cc4-ac27-86a8fd43910a tempest-SnapshotDependencyTests-1559451915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.275s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:10 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-7f5be18e-5fcb-4cc4-ac27-86a8fd43910a tempest-SnapshotDependencyTests-1559451915 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:06:10 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-7f5be18e-5fcb-4cc4-ac27-86a8fd43910a tempest-SnapshotDependencyTests-1559451915 None] Deleted volume successfully. Jul 30 17:06:10 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7f5be18e-5fcb-4cc4-ac27-86a8fd43910a tempest-SnapshotDependencyTests-1559451915 None] Lock "cinder-6a21a64f-0d6e-4852-8b98-e05e43afb3de-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:06:12 devstack cinder-volume[88591]: DEBUG oslo_service.periodic_task [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 17:06:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:06:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:06:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:06:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:06:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:06:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:12 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:06:12 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:12 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.256s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:12 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:06:12 devstack cinder-volume[88591]: DEBUG oslo_service.periodic_task [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running periodic task VolumeManager._thread_info {{(pid=88591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 17:06:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] thread count: 28 {{(pid=88591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 17:06:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] thread info: [<_MainThread(MainThread, started 140677178003584)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 17:06:20 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:SELECT=63,cinder:UPDATE=64,cinder:DELETE=5,cinder:INSERT=15 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:06:20 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:UPDATE=66,cinder:SELECT=62,cinder:INSERT=17,cinder:DELETE=4 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:06:30 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bd4d6f8-1be3-4762-b261-64b0c68776c7 tempest-CreateVolumesFromImageTest-199074704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:06:30 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1bd4d6f8-1be3-4762-b261-64b0c68776c7 tempest-CreateVolumesFromImageTest-199074704 None] Flow 'volume_create_manager' (b09659fc-8608-4b6c-89a9-24700803c038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:06:30 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1bd4d6f8-1be3-4762-b261-64b0c68776c7 tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df52fbbf-fc3e-41ad-904a-7bc702a2b06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:30 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1bd4d6f8-1be3-4762-b261-64b0c68776c7 tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df52fbbf-fc3e-41ad-904a-7bc702a2b06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1228566134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af3f5473-e2f2-4492-a095-83d0132f3efb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1cd3254988048ba8b83e0348d32dc8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:06:31Z,use_quota=True,user_id='8d224e8b786f46bda81cd38827125f90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:30 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1bd4d6f8-1be3-4762-b261-64b0c68776c7 tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (894f2189-490d-4987-94a9-826e98d654ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:30 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1bd4d6f8-1be3-4762-b261-64b0c68776c7 tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (894f2189-490d-4987-94a9-826e98d654ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:30 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1bd4d6f8-1be3-4762-b261-64b0c68776c7 tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a6306a5-1f32-4110-8bd6-6890f5829ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:30 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1bd4d6f8-1be3-4762-b261-64b0c68776c7 tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a6306a5-1f32-4110-8bd6-6890f5829ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af3f5473-e2f2-4492-a095-83d0132f3efb', 'volume_name': 'volume-af3f5473-e2f2-4492-a095-83d0132f3efb', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:30 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1bd4d6f8-1be3-4762-b261-64b0c68776c7 tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ce8d363-60cc-4b04-b141-8257db5f704c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:30 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1bd4d6f8-1be3-4762-b261-64b0c68776c7 tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ce8d363-60cc-4b04-b141-8257db5f704c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:30 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1bd4d6f8-1be3-4762-b261-64b0c68776c7 tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5204aac5-1eb4-45b5-b7eb-5ede30a186b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:30 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-1bd4d6f8-1be3-4762-b261-64b0c68776c7 tempest-CreateVolumesFromImageTest-199074704 None] Volume af3f5473-e2f2-4492-a095-83d0132f3efb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af3f5473-e2f2-4492-a095-83d0132f3efb', 'volume_size': 1} Jul 30 17:06:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1bd4d6f8-1be3-4762-b261-64b0c68776c7 tempest-CreateVolumesFromImageTest-199074704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:06:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1bd4d6f8-1be3-4762-b261-64b0c68776c7 tempest-CreateVolumesFromImageTest-199074704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:06:30 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-1bd4d6f8-1be3-4762-b261-64b0c68776c7 tempest-CreateVolumesFromImageTest-199074704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1228566134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af3f5473-e2f2-4492-a095-83d0132f3efb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1cd3254988048ba8b83e0348d32dc8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:06:31Z,use_quota=True,user_id='8d224e8b786f46bda81cd38827125f90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:06:30 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-1bd4d6f8-1be3-4762-b261-64b0c68776c7 tempest-CreateVolumesFromImageTest-199074704 None] Creating volume af3f5473-e2f2-4492-a095-83d0132f3efb {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:06:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1bd4d6f8-1be3-4762-b261-64b0c68776c7 tempest-CreateVolumesFromImageTest-199074704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:06:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1bd4d6f8-1be3-4762-b261-64b0c68776c7 tempest-CreateVolumesFromImageTest-199074704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:06:30 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-1bd4d6f8-1be3-4762-b261-64b0c68776c7 tempest-CreateVolumesFromImageTest-199074704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:06:30 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-1bd4d6f8-1be3-4762-b261-64b0c68776c7 tempest-CreateVolumesFromImageTest-199074704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:06:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1bd4d6f8-1be3-4762-b261-64b0c68776c7 tempest-CreateVolumesFromImageTest-199074704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:06:30 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-1bd4d6f8-1be3-4762-b261-64b0c68776c7 tempest-CreateVolumesFromImageTest-199074704 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:06:30 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-1bd4d6f8-1be3-4762-b261-64b0c68776c7 tempest-CreateVolumesFromImageTest-199074704 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:06:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1bd4d6f8-1be3-4762-b261-64b0c68776c7 tempest-CreateVolumesFromImageTest-199074704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-af3f5473-e2f2-4492-a095-83d0132f3efb 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:30 devstack sudo[106247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-af3f5473-e2f2-4492-a095-83d0132f3efb 1073741824 Jul 30 17:06:30 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:31 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-5275c46a-46e6-4a4d-9ff6-e1395fa341ab tempest-CreateVolumesFromImageTest-199074704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:06:31 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5275c46a-46e6-4a4d-9ff6-e1395fa341ab tempest-CreateVolumesFromImageTest-199074704 None] Flow 'volume_create_manager' (d43fa5c9-d573-4415-b3e6-35e6abef1c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:06:31 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5275c46a-46e6-4a4d-9ff6-e1395fa341ab tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc96e06c-9f98-4233-8b62-f022da3b2614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:31 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5275c46a-46e6-4a4d-9ff6-e1395fa341ab tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc96e06c-9f98-4233-8b62-f022da3b2614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-556484122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81cabfe1-dc97-4b59-aa74-51f17fc50b11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1cd3254988048ba8b83e0348d32dc8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:06:31Z,use_quota=True,user_id='8d224e8b786f46bda81cd38827125f90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:31 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5275c46a-46e6-4a4d-9ff6-e1395fa341ab tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ceedbc6-9fff-4c3b-8296-7e6eaf8dec98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:31 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5275c46a-46e6-4a4d-9ff6-e1395fa341ab tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ceedbc6-9fff-4c3b-8296-7e6eaf8dec98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:31 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5275c46a-46e6-4a4d-9ff6-e1395fa341ab tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7174885a-b45c-4f2f-a42b-0b36fdb98d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:31 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5275c46a-46e6-4a4d-9ff6-e1395fa341ab tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7174885a-b45c-4f2f-a42b-0b36fdb98d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81cabfe1-dc97-4b59-aa74-51f17fc50b11', 'volume_name': 'volume-81cabfe1-dc97-4b59-aa74-51f17fc50b11', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:31 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5275c46a-46e6-4a4d-9ff6-e1395fa341ab tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e59acd3-24fe-45cd-9e14-8d24edb2b0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:31 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5275c46a-46e6-4a4d-9ff6-e1395fa341ab tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e59acd3-24fe-45cd-9e14-8d24edb2b0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:31 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5275c46a-46e6-4a4d-9ff6-e1395fa341ab tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (174858be-2051-4c9c-90be-fadf78d687e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:31 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-5275c46a-46e6-4a4d-9ff6-e1395fa341ab tempest-CreateVolumesFromImageTest-199074704 None] Volume 81cabfe1-dc97-4b59-aa74-51f17fc50b11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81cabfe1-dc97-4b59-aa74-51f17fc50b11', 'volume_size': 1} Jul 30 17:06:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5275c46a-46e6-4a4d-9ff6-e1395fa341ab tempest-CreateVolumesFromImageTest-199074704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:06:31 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1bd4d6f8-1be3-4762-b261-64b0c68776c7 tempest-CreateVolumesFromImageTest-199074704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-af3f5473-e2f2-4492-a095-83d0132f3efb 1073741824" returned: 0 in 0.767s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:31 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba166f40-3a4f-4883-9e76-c0029e33a0bb tempest-CreateVolumesFromImageTest-199074704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:06:31 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ba166f40-3a4f-4883-9e76-c0029e33a0bb tempest-CreateVolumesFromImageTest-199074704 None] Flow 'volume_create_manager' (e0f1db03-b414-4cc1-84ed-4bb7c368d753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:06:31 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ba166f40-3a4f-4883-9e76-c0029e33a0bb tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4687e0fe-0d74-40b0-b9de-093f80d6a01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:31 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ba166f40-3a4f-4883-9e76-c0029e33a0bb tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4687e0fe-0d74-40b0-b9de-093f80d6a01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-503781925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abcfb475-e076-45eb-af44-27165640e271,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1cd3254988048ba8b83e0348d32dc8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:06:31Z,use_quota=True,user_id='8d224e8b786f46bda81cd38827125f90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:31 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ba166f40-3a4f-4883-9e76-c0029e33a0bb tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57a823e8-3b1f-4f3e-8af0-28c8aaf4b2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:31 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ba166f40-3a4f-4883-9e76-c0029e33a0bb tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57a823e8-3b1f-4f3e-8af0-28c8aaf4b2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:31 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ba166f40-3a4f-4883-9e76-c0029e33a0bb tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a25b378e-95bf-4dc4-95d0-a089743e9958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:31 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ba166f40-3a4f-4883-9e76-c0029e33a0bb tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a25b378e-95bf-4dc4-95d0-a089743e9958) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abcfb475-e076-45eb-af44-27165640e271', 'volume_name': 'volume-abcfb475-e076-45eb-af44-27165640e271', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:31 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ba166f40-3a4f-4883-9e76-c0029e33a0bb tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (636e8fc1-91c8-4e91-9957-1157c5f9641e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:31 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ba166f40-3a4f-4883-9e76-c0029e33a0bb tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (636e8fc1-91c8-4e91-9957-1157c5f9641e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:31 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ba166f40-3a4f-4883-9e76-c0029e33a0bb tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0f95cf7-8541-4465-b455-912ad25666bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:31 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-ba166f40-3a4f-4883-9e76-c0029e33a0bb tempest-CreateVolumesFromImageTest-199074704 None] Volume abcfb475-e076-45eb-af44-27165640e271: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abcfb475-e076-45eb-af44-27165640e271', 'volume_size': 1} Jul 30 17:06:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ba166f40-3a4f-4883-9e76-c0029e33a0bb tempest-CreateVolumesFromImageTest-199074704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:06:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1bd4d6f8-1be3-4762-b261-64b0c68776c7 tempest-CreateVolumesFromImageTest-199074704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-af3f5473-e2f2-4492-a095-83d0132f3efb {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:31 devstack sudo[106253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-af3f5473-e2f2-4492-a095-83d0132f3efb Jul 30 17:06:31 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:32 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1bd4d6f8-1be3-4762-b261-64b0c68776c7 tempest-CreateVolumesFromImageTest-199074704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-af3f5473-e2f2-4492-a095-83d0132f3efb" returned: 0 in 0.430s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:32 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-1bd4d6f8-1be3-4762-b261-64b0c68776c7 tempest-CreateVolumesFromImageTest-199074704 None] <== create_volume: return (1431ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:06:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1bd4d6f8-1be3-4762-b261-64b0c68776c7 tempest-CreateVolumesFromImageTest-199074704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.436s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:06:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5275c46a-46e6-4a4d-9ff6-e1395fa341ab tempest-CreateVolumesFromImageTest-199074704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.967s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:06:32 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-5275c46a-46e6-4a4d-9ff6-e1395fa341ab tempest-CreateVolumesFromImageTest-199074704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-556484122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81cabfe1-dc97-4b59-aa74-51f17fc50b11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1cd3254988048ba8b83e0348d32dc8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:06:31Z,use_quota=True,user_id='8d224e8b786f46bda81cd38827125f90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:06:32 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-5275c46a-46e6-4a4d-9ff6-e1395fa341ab tempest-CreateVolumesFromImageTest-199074704 None] Creating volume 81cabfe1-dc97-4b59-aa74-51f17fc50b11 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:06:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5275c46a-46e6-4a4d-9ff6-e1395fa341ab tempest-CreateVolumesFromImageTest-199074704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:06:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5275c46a-46e6-4a4d-9ff6-e1395fa341ab tempest-CreateVolumesFromImageTest-199074704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:06:32 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-5275c46a-46e6-4a4d-9ff6-e1395fa341ab tempest-CreateVolumesFromImageTest-199074704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:06:32 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-5275c46a-46e6-4a4d-9ff6-e1395fa341ab tempest-CreateVolumesFromImageTest-199074704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:06:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5275c46a-46e6-4a4d-9ff6-e1395fa341ab tempest-CreateVolumesFromImageTest-199074704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:06:32 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-5275c46a-46e6-4a4d-9ff6-e1395fa341ab tempest-CreateVolumesFromImageTest-199074704 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:06:32 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-5275c46a-46e6-4a4d-9ff6-e1395fa341ab tempest-CreateVolumesFromImageTest-199074704 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:06:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5275c46a-46e6-4a4d-9ff6-e1395fa341ab tempest-CreateVolumesFromImageTest-199074704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-81cabfe1-dc97-4b59-aa74-51f17fc50b11 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:32 devstack sudo[106256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-81cabfe1-dc97-4b59-aa74-51f17fc50b11 1073741824 Jul 30 17:06:32 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:32 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1bd4d6f8-1be3-4762-b261-64b0c68776c7 tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5204aac5-1eb4-45b5-b7eb-5ede30a186b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af3f5473-e2f2-4492-a095-83d0132f3efb', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:32 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1bd4d6f8-1be3-4762-b261-64b0c68776c7 tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ea1ff23-b98c-4dee-817d-74323f07cb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:32 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a59b6cd-4c9e-4aad-a370-60ecb5d11ea2 tempest-CreateVolumesFromImageTest-199074704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:06:32 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8a59b6cd-4c9e-4aad-a370-60ecb5d11ea2 tempest-CreateVolumesFromImageTest-199074704 None] Flow 'volume_create_manager' (329643ed-9f45-40df-8760-e4b585b99541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:06:32 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8a59b6cd-4c9e-4aad-a370-60ecb5d11ea2 tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a93cdb1-62d8-4ff3-98c5-f8dd145670ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:32 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-1bd4d6f8-1be3-4762-b261-64b0c68776c7 tempest-CreateVolumesFromImageTest-199074704 None] Volume volume-af3f5473-e2f2-4492-a095-83d0132f3efb (af3f5473-e2f2-4492-a095-83d0132f3efb): created successfully Jul 30 17:06:32 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1bd4d6f8-1be3-4762-b261-64b0c68776c7 tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ea1ff23-b98c-4dee-817d-74323f07cb98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:32 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1bd4d6f8-1be3-4762-b261-64b0c68776c7 tempest-CreateVolumesFromImageTest-199074704 None] Flow 'volume_create_manager' (b09659fc-8608-4b6c-89a9-24700803c038) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:06:32 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8a59b6cd-4c9e-4aad-a370-60ecb5d11ea2 tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a93cdb1-62d8-4ff3-98c5-f8dd145670ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1734654331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17f4a30a-84e8-409d-826a-e825ab056255,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1cd3254988048ba8b83e0348d32dc8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:06:32Z,use_quota=True,user_id='8d224e8b786f46bda81cd38827125f90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:32 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8a59b6cd-4c9e-4aad-a370-60ecb5d11ea2 tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ab32f80-a475-4a13-b35a-bdc84e0475f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:32 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8a59b6cd-4c9e-4aad-a370-60ecb5d11ea2 tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ab32f80-a475-4a13-b35a-bdc84e0475f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:32 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8a59b6cd-4c9e-4aad-a370-60ecb5d11ea2 tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (807bea3f-1706-4448-b6bb-44d8c06d86dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:32 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8a59b6cd-4c9e-4aad-a370-60ecb5d11ea2 tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (807bea3f-1706-4448-b6bb-44d8c06d86dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17f4a30a-84e8-409d-826a-e825ab056255', 'volume_name': 'volume-17f4a30a-84e8-409d-826a-e825ab056255', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:32 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8a59b6cd-4c9e-4aad-a370-60ecb5d11ea2 tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c53ddb6-cf85-40d2-9bc7-ef868a6b4acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:32 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8a59b6cd-4c9e-4aad-a370-60ecb5d11ea2 tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c53ddb6-cf85-40d2-9bc7-ef868a6b4acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:32 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8a59b6cd-4c9e-4aad-a370-60ecb5d11ea2 tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3db00cd8-f408-403f-a33f-5b25755b8e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:32 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-8a59b6cd-4c9e-4aad-a370-60ecb5d11ea2 tempest-CreateVolumesFromImageTest-199074704 None] Volume 17f4a30a-84e8-409d-826a-e825ab056255: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17f4a30a-84e8-409d-826a-e825ab056255', 'volume_size': 1} Jul 30 17:06:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8a59b6cd-4c9e-4aad-a370-60ecb5d11ea2 tempest-CreateVolumesFromImageTest-199074704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:06:32 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-1bd4d6f8-1be3-4762-b261-64b0c68776c7 tempest-CreateVolumesFromImageTest-199074704 None] Created volume successfully. Jul 30 17:06:32 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e8b2c23-196a-412c-88ad-d8aeb720ab81 tempest-CreateVolumesFromImageTest-199074704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:06:32 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-4e8b2c23-196a-412c-88ad-d8aeb720ab81 tempest-CreateVolumesFromImageTest-199074704 None] Flow 'volume_create_manager' (db91180a-c08c-4465-95e5-e3c1ccff37cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:06:32 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-4e8b2c23-196a-412c-88ad-d8aeb720ab81 tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68ceee64-adb8-490f-9df2-30649237c0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:32 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-4e8b2c23-196a-412c-88ad-d8aeb720ab81 tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68ceee64-adb8-490f-9df2-30649237c0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2075899156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18f03037-80c5-4e4e-bf6e-3801b9222993,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1cd3254988048ba8b83e0348d32dc8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:06:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:06:33Z,use_quota=True,user_id='8d224e8b786f46bda81cd38827125f90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:32 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-4e8b2c23-196a-412c-88ad-d8aeb720ab81 tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9866e31-0c41-41f5-b209-b7d927127e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:32 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-4e8b2c23-196a-412c-88ad-d8aeb720ab81 tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9866e31-0c41-41f5-b209-b7d927127e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:32 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-4e8b2c23-196a-412c-88ad-d8aeb720ab81 tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb27be59-620b-4aae-8e34-a4cbb3e897d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:32 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-4e8b2c23-196a-412c-88ad-d8aeb720ab81 tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb27be59-620b-4aae-8e34-a4cbb3e897d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18f03037-80c5-4e4e-bf6e-3801b9222993', 'volume_name': 'volume-18f03037-80c5-4e4e-bf6e-3801b9222993', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:32 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-4e8b2c23-196a-412c-88ad-d8aeb720ab81 tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57e8a4cf-b6d4-4cbd-8fa1-3641038bfa64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:32 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-4e8b2c23-196a-412c-88ad-d8aeb720ab81 tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57e8a4cf-b6d4-4cbd-8fa1-3641038bfa64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:32 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-4e8b2c23-196a-412c-88ad-d8aeb720ab81 tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (065c0ad4-db03-4ad1-98e7-b0f651ec0e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:32 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-4e8b2c23-196a-412c-88ad-d8aeb720ab81 tempest-CreateVolumesFromImageTest-199074704 None] Volume 18f03037-80c5-4e4e-bf6e-3801b9222993: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18f03037-80c5-4e4e-bf6e-3801b9222993', 'volume_size': 1} Jul 30 17:06:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-4e8b2c23-196a-412c-88ad-d8aeb720ab81 tempest-CreateVolumesFromImageTest-199074704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:06:32 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5275c46a-46e6-4a4d-9ff6-e1395fa341ab tempest-CreateVolumesFromImageTest-199074704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-81cabfe1-dc97-4b59-aa74-51f17fc50b11 1073741824" returned: 0 in 0.685s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5275c46a-46e6-4a4d-9ff6-e1395fa341ab tempest-CreateVolumesFromImageTest-199074704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-81cabfe1-dc97-4b59-aa74-51f17fc50b11 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:32 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-81cabfe1-dc97-4b59-aa74-51f17fc50b11 Jul 30 17:06:32 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:33 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5275c46a-46e6-4a4d-9ff6-e1395fa341ab tempest-CreateVolumesFromImageTest-199074704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-81cabfe1-dc97-4b59-aa74-51f17fc50b11" returned: 0 in 0.277s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:33 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-5275c46a-46e6-4a4d-9ff6-e1395fa341ab tempest-CreateVolumesFromImageTest-199074704 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:06:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5275c46a-46e6-4a4d-9ff6-e1395fa341ab tempest-CreateVolumesFromImageTest-199074704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:06:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ba166f40-3a4f-4883-9e76-c0029e33a0bb tempest-CreateVolumesFromImageTest-199074704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.466s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:06:33 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ba166f40-3a4f-4883-9e76-c0029e33a0bb tempest-CreateVolumesFromImageTest-199074704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-503781925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abcfb475-e076-45eb-af44-27165640e271,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1cd3254988048ba8b83e0348d32dc8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:06:31Z,use_quota=True,user_id='8d224e8b786f46bda81cd38827125f90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:06:33 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-ba166f40-3a4f-4883-9e76-c0029e33a0bb tempest-CreateVolumesFromImageTest-199074704 None] Creating volume abcfb475-e076-45eb-af44-27165640e271 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:06:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ba166f40-3a4f-4883-9e76-c0029e33a0bb tempest-CreateVolumesFromImageTest-199074704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:06:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ba166f40-3a4f-4883-9e76-c0029e33a0bb tempest-CreateVolumesFromImageTest-199074704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:06:33 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ba166f40-3a4f-4883-9e76-c0029e33a0bb tempest-CreateVolumesFromImageTest-199074704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:06:33 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ba166f40-3a4f-4883-9e76-c0029e33a0bb tempest-CreateVolumesFromImageTest-199074704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:06:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ba166f40-3a4f-4883-9e76-c0029e33a0bb tempest-CreateVolumesFromImageTest-199074704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:06:33 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ba166f40-3a4f-4883-9e76-c0029e33a0bb tempest-CreateVolumesFromImageTest-199074704 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:06:33 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-ba166f40-3a4f-4883-9e76-c0029e33a0bb tempest-CreateVolumesFromImageTest-199074704 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:06:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ba166f40-3a4f-4883-9e76-c0029e33a0bb tempest-CreateVolumesFromImageTest-199074704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-abcfb475-e076-45eb-af44-27165640e271 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:33 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5275c46a-46e6-4a4d-9ff6-e1395fa341ab tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (174858be-2051-4c9c-90be-fadf78d687e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81cabfe1-dc97-4b59-aa74-51f17fc50b11', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:33 devstack sudo[106266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-abcfb475-e076-45eb-af44-27165640e271 1073741824 Jul 30 17:06:33 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:33 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5275c46a-46e6-4a4d-9ff6-e1395fa341ab tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6070fcf8-8b59-4914-b167-cae3e1297012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:33 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-5275c46a-46e6-4a4d-9ff6-e1395fa341ab tempest-CreateVolumesFromImageTest-199074704 None] Volume volume-81cabfe1-dc97-4b59-aa74-51f17fc50b11 (81cabfe1-dc97-4b59-aa74-51f17fc50b11): created successfully Jul 30 17:06:33 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5275c46a-46e6-4a4d-9ff6-e1395fa341ab tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6070fcf8-8b59-4914-b167-cae3e1297012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:33 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5275c46a-46e6-4a4d-9ff6-e1395fa341ab tempest-CreateVolumesFromImageTest-199074704 None] Flow 'volume_create_manager' (d43fa5c9-d573-4415-b3e6-35e6abef1c56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:06:33 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-5275c46a-46e6-4a4d-9ff6-e1395fa341ab tempest-CreateVolumesFromImageTest-199074704 None] Created volume successfully. Jul 30 17:06:33 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ba166f40-3a4f-4883-9e76-c0029e33a0bb tempest-CreateVolumesFromImageTest-199074704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-abcfb475-e076-45eb-af44-27165640e271 1073741824" returned: 0 in 0.484s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ba166f40-3a4f-4883-9e76-c0029e33a0bb tempest-CreateVolumesFromImageTest-199074704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-abcfb475-e076-45eb-af44-27165640e271 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:33 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-abcfb475-e076-45eb-af44-27165640e271 Jul 30 17:06:33 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:34 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ba166f40-3a4f-4883-9e76-c0029e33a0bb tempest-CreateVolumesFromImageTest-199074704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-abcfb475-e076-45eb-af44-27165640e271" returned: 0 in 0.270s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:34 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ba166f40-3a4f-4883-9e76-c0029e33a0bb tempest-CreateVolumesFromImageTest-199074704 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:06:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ba166f40-3a4f-4883-9e76-c0029e33a0bb tempest-CreateVolumesFromImageTest-199074704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:06:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8a59b6cd-4c9e-4aad-a370-60ecb5d11ea2 tempest-CreateVolumesFromImageTest-199074704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.498s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:06:34 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-8a59b6cd-4c9e-4aad-a370-60ecb5d11ea2 tempest-CreateVolumesFromImageTest-199074704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1734654331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17f4a30a-84e8-409d-826a-e825ab056255,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1cd3254988048ba8b83e0348d32dc8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:06:32Z,use_quota=True,user_id='8d224e8b786f46bda81cd38827125f90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:06:34 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-8a59b6cd-4c9e-4aad-a370-60ecb5d11ea2 tempest-CreateVolumesFromImageTest-199074704 None] Creating volume 17f4a30a-84e8-409d-826a-e825ab056255 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:06:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8a59b6cd-4c9e-4aad-a370-60ecb5d11ea2 tempest-CreateVolumesFromImageTest-199074704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:06:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8a59b6cd-4c9e-4aad-a370-60ecb5d11ea2 tempest-CreateVolumesFromImageTest-199074704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:06:34 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-8a59b6cd-4c9e-4aad-a370-60ecb5d11ea2 tempest-CreateVolumesFromImageTest-199074704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:06:34 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-8a59b6cd-4c9e-4aad-a370-60ecb5d11ea2 tempest-CreateVolumesFromImageTest-199074704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:06:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8a59b6cd-4c9e-4aad-a370-60ecb5d11ea2 tempest-CreateVolumesFromImageTest-199074704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:06:34 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-8a59b6cd-4c9e-4aad-a370-60ecb5d11ea2 tempest-CreateVolumesFromImageTest-199074704 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:06:34 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-8a59b6cd-4c9e-4aad-a370-60ecb5d11ea2 tempest-CreateVolumesFromImageTest-199074704 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:06:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8a59b6cd-4c9e-4aad-a370-60ecb5d11ea2 tempest-CreateVolumesFromImageTest-199074704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-17f4a30a-84e8-409d-826a-e825ab056255 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ba166f40-3a4f-4883-9e76-c0029e33a0bb tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0f95cf7-8541-4465-b455-912ad25666bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abcfb475-e076-45eb-af44-27165640e271', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:34 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-17f4a30a-84e8-409d-826a-e825ab056255 1073741824 Jul 30 17:06:34 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ba166f40-3a4f-4883-9e76-c0029e33a0bb tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be8c9ffe-378d-46ba-9a31-dcf7f4304696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:34 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-ba166f40-3a4f-4883-9e76-c0029e33a0bb tempest-CreateVolumesFromImageTest-199074704 None] Volume volume-abcfb475-e076-45eb-af44-27165640e271 (abcfb475-e076-45eb-af44-27165640e271): created successfully Jul 30 17:06:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ba166f40-3a4f-4883-9e76-c0029e33a0bb tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be8c9ffe-378d-46ba-9a31-dcf7f4304696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ba166f40-3a4f-4883-9e76-c0029e33a0bb tempest-CreateVolumesFromImageTest-199074704 None] Flow 'volume_create_manager' (e0f1db03-b414-4cc1-84ed-4bb7c368d753) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:06:34 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-ba166f40-3a4f-4883-9e76-c0029e33a0bb tempest-CreateVolumesFromImageTest-199074704 None] Created volume successfully. Jul 30 17:06:34 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8a59b6cd-4c9e-4aad-a370-60ecb5d11ea2 tempest-CreateVolumesFromImageTest-199074704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-17f4a30a-84e8-409d-826a-e825ab056255 1073741824" returned: 0 in 0.452s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8a59b6cd-4c9e-4aad-a370-60ecb5d11ea2 tempest-CreateVolumesFromImageTest-199074704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-17f4a30a-84e8-409d-826a-e825ab056255 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:34 devstack sudo[106281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-17f4a30a-84e8-409d-826a-e825ab056255 Jul 30 17:06:34 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:34 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8a59b6cd-4c9e-4aad-a370-60ecb5d11ea2 tempest-CreateVolumesFromImageTest-199074704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-17f4a30a-84e8-409d-826a-e825ab056255" returned: 0 in 0.262s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:34 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-8a59b6cd-4c9e-4aad-a370-60ecb5d11ea2 tempest-CreateVolumesFromImageTest-199074704 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:06:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8a59b6cd-4c9e-4aad-a370-60ecb5d11ea2 tempest-CreateVolumesFromImageTest-199074704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:06:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-4e8b2c23-196a-412c-88ad-d8aeb720ab81 tempest-CreateVolumesFromImageTest-199074704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.992s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:06:34 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-4e8b2c23-196a-412c-88ad-d8aeb720ab81 tempest-CreateVolumesFromImageTest-199074704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2075899156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18f03037-80c5-4e4e-bf6e-3801b9222993,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1cd3254988048ba8b83e0348d32dc8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:06:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:06:33Z,use_quota=True,user_id='8d224e8b786f46bda81cd38827125f90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:06:34 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-4e8b2c23-196a-412c-88ad-d8aeb720ab81 tempest-CreateVolumesFromImageTest-199074704 None] Creating volume 18f03037-80c5-4e4e-bf6e-3801b9222993 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:06:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-4e8b2c23-196a-412c-88ad-d8aeb720ab81 tempest-CreateVolumesFromImageTest-199074704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:06:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-4e8b2c23-196a-412c-88ad-d8aeb720ab81 tempest-CreateVolumesFromImageTest-199074704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:06:34 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-4e8b2c23-196a-412c-88ad-d8aeb720ab81 tempest-CreateVolumesFromImageTest-199074704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:06:34 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-4e8b2c23-196a-412c-88ad-d8aeb720ab81 tempest-CreateVolumesFromImageTest-199074704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:06:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-4e8b2c23-196a-412c-88ad-d8aeb720ab81 tempest-CreateVolumesFromImageTest-199074704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:06:34 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-4e8b2c23-196a-412c-88ad-d8aeb720ab81 tempest-CreateVolumesFromImageTest-199074704 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:06:34 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-4e8b2c23-196a-412c-88ad-d8aeb720ab81 tempest-CreateVolumesFromImageTest-199074704 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:06:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4e8b2c23-196a-412c-88ad-d8aeb720ab81 tempest-CreateVolumesFromImageTest-199074704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-18f03037-80c5-4e4e-bf6e-3801b9222993 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8a59b6cd-4c9e-4aad-a370-60ecb5d11ea2 tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3db00cd8-f408-403f-a33f-5b25755b8e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17f4a30a-84e8-409d-826a-e825ab056255', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8a59b6cd-4c9e-4aad-a370-60ecb5d11ea2 tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94fc6cd3-09ea-4ebf-8738-3abc53bf8294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:34 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-18f03037-80c5-4e4e-bf6e-3801b9222993 1073741824 Jul 30 17:06:34 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:34 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-8a59b6cd-4c9e-4aad-a370-60ecb5d11ea2 tempest-CreateVolumesFromImageTest-199074704 None] Volume volume-17f4a30a-84e8-409d-826a-e825ab056255 (17f4a30a-84e8-409d-826a-e825ab056255): created successfully Jul 30 17:06:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8a59b6cd-4c9e-4aad-a370-60ecb5d11ea2 tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94fc6cd3-09ea-4ebf-8738-3abc53bf8294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8a59b6cd-4c9e-4aad-a370-60ecb5d11ea2 tempest-CreateVolumesFromImageTest-199074704 None] Flow 'volume_create_manager' (329643ed-9f45-40df-8760-e4b585b99541) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:06:34 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-8a59b6cd-4c9e-4aad-a370-60ecb5d11ea2 tempest-CreateVolumesFromImageTest-199074704 None] Created volume successfully. Jul 30 17:06:35 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4e8b2c23-196a-412c-88ad-d8aeb720ab81 tempest-CreateVolumesFromImageTest-199074704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-18f03037-80c5-4e4e-bf6e-3801b9222993 1073741824" returned: 0 in 0.588s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4e8b2c23-196a-412c-88ad-d8aeb720ab81 tempest-CreateVolumesFromImageTest-199074704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-18f03037-80c5-4e4e-bf6e-3801b9222993 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:35 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-18f03037-80c5-4e4e-bf6e-3801b9222993 Jul 30 17:06:35 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:35 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4e8b2c23-196a-412c-88ad-d8aeb720ab81 tempest-CreateVolumesFromImageTest-199074704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-18f03037-80c5-4e4e-bf6e-3801b9222993" returned: 0 in 0.277s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:35 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-4e8b2c23-196a-412c-88ad-d8aeb720ab81 tempest-CreateVolumesFromImageTest-199074704 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:06:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-4e8b2c23-196a-412c-88ad-d8aeb720ab81 tempest-CreateVolumesFromImageTest-199074704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:06:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-4e8b2c23-196a-412c-88ad-d8aeb720ab81 tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (065c0ad4-db03-4ad1-98e7-b0f651ec0e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18f03037-80c5-4e4e-bf6e-3801b9222993', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-4e8b2c23-196a-412c-88ad-d8aeb720ab81 tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2204765a-7787-4c76-a4cf-8f23fa58a341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:35 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-4e8b2c23-196a-412c-88ad-d8aeb720ab81 tempest-CreateVolumesFromImageTest-199074704 None] Volume volume-18f03037-80c5-4e4e-bf6e-3801b9222993 (18f03037-80c5-4e4e-bf6e-3801b9222993): created successfully Jul 30 17:06:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-4e8b2c23-196a-412c-88ad-d8aeb720ab81 tempest-CreateVolumesFromImageTest-199074704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2204765a-7787-4c76-a4cf-8f23fa58a341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-4e8b2c23-196a-412c-88ad-d8aeb720ab81 tempest-CreateVolumesFromImageTest-199074704 None] Flow 'volume_create_manager' (db91180a-c08c-4465-95e5-e3c1ccff37cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:06:35 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-4e8b2c23-196a-412c-88ad-d8aeb720ab81 tempest-CreateVolumesFromImageTest-199074704 None] Created volume successfully. Jul 30 17:06:36 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-96ccf198-0f61-47ab-9004-57fc8ef8d36d tempest-CreateVolumesFromImageTest-199074704 None] Acquiring lock "cinder-18f03037-80c5-4e4e-bf6e-3801b9222993-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:06:36 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-96ccf198-0f61-47ab-9004-57fc8ef8d36d tempest-CreateVolumesFromImageTest-199074704 None] Lock "cinder-18f03037-80c5-4e4e-bf6e-3801b9222993-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:06:36 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-82c3859f-8450-4c8b-afa6-1811e4c5dc22 tempest-TestServerVolumeAttachmentScenario-976284454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:06:36 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-82c3859f-8450-4c8b-afa6-1811e4c5dc22 tempest-TestServerVolumeAttachmentScenario-976284454 None] Flow 'volume_create_manager' (677c671d-94c3-4542-bdcd-ee02a4dfd157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:06:36 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-82c3859f-8450-4c8b-afa6-1811e4c5dc22 tempest-TestServerVolumeAttachmentScenario-976284454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e62d2e79-ca7d-484c-be4b-f006cd0e986a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:36 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-82c3859f-8450-4c8b-afa6-1811e4c5dc22 tempest-TestServerVolumeAttachmentScenario-976284454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e62d2e79-ca7d-484c-be4b-f006cd0e986a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-673922362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d758c84a-992d-483d-a50f-98353f771e66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e28e4648fa044f9871a1d7cfae603bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:06:36Z,use_quota=True,user_id='29cc659e7ed8451fa0cdbf250ef22f6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:36 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-82c3859f-8450-4c8b-afa6-1811e4c5dc22 tempest-TestServerVolumeAttachmentScenario-976284454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f85770c-a53e-4649-a4cb-0c3dffabac90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:36 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-82c3859f-8450-4c8b-afa6-1811e4c5dc22 tempest-TestServerVolumeAttachmentScenario-976284454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f85770c-a53e-4649-a4cb-0c3dffabac90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:36 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-82c3859f-8450-4c8b-afa6-1811e4c5dc22 tempest-TestServerVolumeAttachmentScenario-976284454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (703025aa-8229-45cf-bcde-c49c01cff21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:36 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-82c3859f-8450-4c8b-afa6-1811e4c5dc22 tempest-TestServerVolumeAttachmentScenario-976284454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (703025aa-8229-45cf-bcde-c49c01cff21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd758c84a-992d-483d-a50f-98353f771e66', 'volume_name': 'volume-d758c84a-992d-483d-a50f-98353f771e66', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:36 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-82c3859f-8450-4c8b-afa6-1811e4c5dc22 tempest-TestServerVolumeAttachmentScenario-976284454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6c8dcf9-4fbd-46d5-84c3-4b97cd361d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:36 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-82c3859f-8450-4c8b-afa6-1811e4c5dc22 tempest-TestServerVolumeAttachmentScenario-976284454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6c8dcf9-4fbd-46d5-84c3-4b97cd361d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:36 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-82c3859f-8450-4c8b-afa6-1811e4c5dc22 tempest-TestServerVolumeAttachmentScenario-976284454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9720497a-cad1-49e8-8ff8-5af38536a53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:36 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-82c3859f-8450-4c8b-afa6-1811e4c5dc22 tempest-TestServerVolumeAttachmentScenario-976284454 None] Volume d758c84a-992d-483d-a50f-98353f771e66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d758c84a-992d-483d-a50f-98353f771e66', 'volume_size': 1} Jul 30 17:06:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-82c3859f-8450-4c8b-afa6-1811e4c5dc22 tempest-TestServerVolumeAttachmentScenario-976284454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:06:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-82c3859f-8450-4c8b-afa6-1811e4c5dc22 tempest-TestServerVolumeAttachmentScenario-976284454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:06:36 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-82c3859f-8450-4c8b-afa6-1811e4c5dc22 tempest-TestServerVolumeAttachmentScenario-976284454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-673922362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d758c84a-992d-483d-a50f-98353f771e66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e28e4648fa044f9871a1d7cfae603bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:06:36Z,use_quota=True,user_id='29cc659e7ed8451fa0cdbf250ef22f6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:06:36 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-82c3859f-8450-4c8b-afa6-1811e4c5dc22 tempest-TestServerVolumeAttachmentScenario-976284454 None] Creating volume d758c84a-992d-483d-a50f-98353f771e66 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:06:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-82c3859f-8450-4c8b-afa6-1811e4c5dc22 tempest-TestServerVolumeAttachmentScenario-976284454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:06:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-82c3859f-8450-4c8b-afa6-1811e4c5dc22 tempest-TestServerVolumeAttachmentScenario-976284454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:06:36 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-82c3859f-8450-4c8b-afa6-1811e4c5dc22 tempest-TestServerVolumeAttachmentScenario-976284454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:06:36 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-82c3859f-8450-4c8b-afa6-1811e4c5dc22 tempest-TestServerVolumeAttachmentScenario-976284454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:06:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-82c3859f-8450-4c8b-afa6-1811e4c5dc22 tempest-TestServerVolumeAttachmentScenario-976284454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:06:36 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-82c3859f-8450-4c8b-afa6-1811e4c5dc22 tempest-TestServerVolumeAttachmentScenario-976284454 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:06:36 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-82c3859f-8450-4c8b-afa6-1811e4c5dc22 tempest-TestServerVolumeAttachmentScenario-976284454 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:06:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-82c3859f-8450-4c8b-afa6-1811e4c5dc22 tempest-TestServerVolumeAttachmentScenario-976284454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d758c84a-992d-483d-a50f-98353f771e66 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:36 devstack sudo[106293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d758c84a-992d-483d-a50f-98353f771e66 1073741824 Jul 30 17:06:36 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-96ccf198-0f61-47ab-9004-57fc8ef8d36d tempest-CreateVolumesFromImageTest-199074704 None] Acquiring lock "cinder-quobyte-18f03037-80c5-4e4e-bf6e-3801b9222993" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:06:36 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:36 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-96ccf198-0f61-47ab-9004-57fc8ef8d36d tempest-CreateVolumesFromImageTest-199074704 None] Lock "cinder-quobyte-18f03037-80c5-4e4e-bf6e-3801b9222993" acquired by "delete_volume" :: waited 0.018s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:06:36 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e195e974-363c-4b22-aa30-25b37412f769]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:06:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-96ccf198-0f61-47ab-9004-57fc8ef8d36d tempest-CreateVolumesFromImageTest-199074704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-18f03037-80c5-4e4e-bf6e-3801b9222993 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:36 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-18f03037-80c5-4e4e-bf6e-3801b9222993 Jul 30 17:06:36 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:36 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd0ecd36-0611-4917-b31a-2d3b2ad5a0d8 tempest-TestServerVolumeAttachmentScenario-976284454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:06:36 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-cd0ecd36-0611-4917-b31a-2d3b2ad5a0d8 tempest-TestServerVolumeAttachmentScenario-976284454 None] Flow 'volume_create_manager' (801b46f3-c040-4074-a5a8-d827ab4252c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:06:36 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-cd0ecd36-0611-4917-b31a-2d3b2ad5a0d8 tempest-TestServerVolumeAttachmentScenario-976284454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ee113aa-febd-40f8-9ad8-d41189914752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:36 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-cd0ecd36-0611-4917-b31a-2d3b2ad5a0d8 tempest-TestServerVolumeAttachmentScenario-976284454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ee113aa-febd-40f8-9ad8-d41189914752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-249517360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c70ef632-088b-4ecc-83b3-14a03594722e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e28e4648fa044f9871a1d7cfae603bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:06:36Z,use_quota=True,user_id='29cc659e7ed8451fa0cdbf250ef22f6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:36 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-cd0ecd36-0611-4917-b31a-2d3b2ad5a0d8 tempest-TestServerVolumeAttachmentScenario-976284454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c087bb4-7927-4236-9c30-4fcb623c6a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:36 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-cd0ecd36-0611-4917-b31a-2d3b2ad5a0d8 tempest-TestServerVolumeAttachmentScenario-976284454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c087bb4-7927-4236-9c30-4fcb623c6a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:36 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-cd0ecd36-0611-4917-b31a-2d3b2ad5a0d8 tempest-TestServerVolumeAttachmentScenario-976284454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd56572b-1360-46a3-b69a-450e49c53b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:36 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-cd0ecd36-0611-4917-b31a-2d3b2ad5a0d8 tempest-TestServerVolumeAttachmentScenario-976284454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd56572b-1360-46a3-b69a-450e49c53b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c70ef632-088b-4ecc-83b3-14a03594722e', 'volume_name': 'volume-c70ef632-088b-4ecc-83b3-14a03594722e', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:36 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-cd0ecd36-0611-4917-b31a-2d3b2ad5a0d8 tempest-TestServerVolumeAttachmentScenario-976284454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72abcf68-3ea4-4009-8dce-f7a9a6f49d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:36 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-cd0ecd36-0611-4917-b31a-2d3b2ad5a0d8 tempest-TestServerVolumeAttachmentScenario-976284454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72abcf68-3ea4-4009-8dce-f7a9a6f49d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:36 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-cd0ecd36-0611-4917-b31a-2d3b2ad5a0d8 tempest-TestServerVolumeAttachmentScenario-976284454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b21ff47-7d64-4262-a687-7b1670f7c857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:36 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-cd0ecd36-0611-4917-b31a-2d3b2ad5a0d8 tempest-TestServerVolumeAttachmentScenario-976284454 None] Volume c70ef632-088b-4ecc-83b3-14a03594722e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c70ef632-088b-4ecc-83b3-14a03594722e', 'volume_size': 1} Jul 30 17:06:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-cd0ecd36-0611-4917-b31a-2d3b2ad5a0d8 tempest-TestServerVolumeAttachmentScenario-976284454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:06:36 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-82c3859f-8450-4c8b-afa6-1811e4c5dc22 tempest-TestServerVolumeAttachmentScenario-976284454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d758c84a-992d-483d-a50f-98353f771e66 1073741824" returned: 0 in 0.518s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:36 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-96ccf198-0f61-47ab-9004-57fc8ef8d36d tempest-CreateVolumesFromImageTest-199074704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-18f03037-80c5-4e4e-bf6e-3801b9222993" returned: 0 in 0.458s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-96ccf198-0f61-47ab-9004-57fc8ef8d36d tempest-CreateVolumesFromImageTest-199074704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-18f03037-80c5-4e4e-bf6e-3801b9222993 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-82c3859f-8450-4c8b-afa6-1811e4c5dc22 tempest-TestServerVolumeAttachmentScenario-976284454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d758c84a-992d-483d-a50f-98353f771e66 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:36 devstack sudo[106304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-18f03037-80c5-4e4e-bf6e-3801b9222993 Jul 30 17:06:36 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:36 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d758c84a-992d-483d-a50f-98353f771e66 Jul 30 17:06:36 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:37 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-96ccf198-0f61-47ab-9004-57fc8ef8d36d tempest-CreateVolumesFromImageTest-199074704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-18f03037-80c5-4e4e-bf6e-3801b9222993" returned: 0 in 0.263s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:37 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-96ccf198-0f61-47ab-9004-57fc8ef8d36d tempest-CreateVolumesFromImageTest-199074704 None] Lock "cinder-quobyte-18f03037-80c5-4e4e-bf6e-3801b9222993" released by "delete_volume" :: held 0.778s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:06:37 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-82c3859f-8450-4c8b-afa6-1811e4c5dc22 tempest-TestServerVolumeAttachmentScenario-976284454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d758c84a-992d-483d-a50f-98353f771e66" returned: 0 in 0.274s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:37 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-82c3859f-8450-4c8b-afa6-1811e4c5dc22 tempest-TestServerVolumeAttachmentScenario-976284454 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:06:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-82c3859f-8450-4c8b-afa6-1811e4c5dc22 tempest-TestServerVolumeAttachmentScenario-976284454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:06:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-cd0ecd36-0611-4917-b31a-2d3b2ad5a0d8 tempest-TestServerVolumeAttachmentScenario-976284454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.504s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:06:37 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-cd0ecd36-0611-4917-b31a-2d3b2ad5a0d8 tempest-TestServerVolumeAttachmentScenario-976284454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-249517360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c70ef632-088b-4ecc-83b3-14a03594722e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e28e4648fa044f9871a1d7cfae603bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:06:36Z,use_quota=True,user_id='29cc659e7ed8451fa0cdbf250ef22f6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:06:37 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-cd0ecd36-0611-4917-b31a-2d3b2ad5a0d8 tempest-TestServerVolumeAttachmentScenario-976284454 None] Creating volume c70ef632-088b-4ecc-83b3-14a03594722e {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:06:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-cd0ecd36-0611-4917-b31a-2d3b2ad5a0d8 tempest-TestServerVolumeAttachmentScenario-976284454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:06:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-cd0ecd36-0611-4917-b31a-2d3b2ad5a0d8 tempest-TestServerVolumeAttachmentScenario-976284454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:06:37 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-cd0ecd36-0611-4917-b31a-2d3b2ad5a0d8 tempest-TestServerVolumeAttachmentScenario-976284454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:06:37 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-cd0ecd36-0611-4917-b31a-2d3b2ad5a0d8 tempest-TestServerVolumeAttachmentScenario-976284454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:06:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-cd0ecd36-0611-4917-b31a-2d3b2ad5a0d8 tempest-TestServerVolumeAttachmentScenario-976284454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:06:37 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-cd0ecd36-0611-4917-b31a-2d3b2ad5a0d8 tempest-TestServerVolumeAttachmentScenario-976284454 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:06:37 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-cd0ecd36-0611-4917-b31a-2d3b2ad5a0d8 tempest-TestServerVolumeAttachmentScenario-976284454 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:06:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cd0ecd36-0611-4917-b31a-2d3b2ad5a0d8 tempest-TestServerVolumeAttachmentScenario-976284454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c70ef632-088b-4ecc-83b3-14a03594722e 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:37 devstack sudo[106310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c70ef632-088b-4ecc-83b3-14a03594722e 1073741824 Jul 30 17:06:37 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:37 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-82c3859f-8450-4c8b-afa6-1811e4c5dc22 tempest-TestServerVolumeAttachmentScenario-976284454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9720497a-cad1-49e8-8ff8-5af38536a53d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d758c84a-992d-483d-a50f-98353f771e66', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:37 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-82c3859f-8450-4c8b-afa6-1811e4c5dc22 tempest-TestServerVolumeAttachmentScenario-976284454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4dce439-a3f9-4ea9-b6ca-990eb2cabed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:37 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-82c3859f-8450-4c8b-afa6-1811e4c5dc22 tempest-TestServerVolumeAttachmentScenario-976284454 None] Volume volume-d758c84a-992d-483d-a50f-98353f771e66 (d758c84a-992d-483d-a50f-98353f771e66): created successfully Jul 30 17:06:37 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-82c3859f-8450-4c8b-afa6-1811e4c5dc22 tempest-TestServerVolumeAttachmentScenario-976284454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4dce439-a3f9-4ea9-b6ca-990eb2cabed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:37 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-82c3859f-8450-4c8b-afa6-1811e4c5dc22 tempest-TestServerVolumeAttachmentScenario-976284454 None] Flow 'volume_create_manager' (677c671d-94c3-4542-bdcd-ee02a4dfd157) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:06:37 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-82c3859f-8450-4c8b-afa6-1811e4c5dc22 tempest-TestServerVolumeAttachmentScenario-976284454 None] Created volume successfully. Jul 30 17:06:37 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-96ccf198-0f61-47ab-9004-57fc8ef8d36d tempest-CreateVolumesFromImageTest-199074704 None] Created reservations ['1688f17d-9028-411a-a6f1-c1033d2e5189', 'd0810352-0845-4d00-93ad-aa5b40d5b821', 'f9db6a55-54b0-440b-8a0d-50fbe313d067', '24514d01-bd03-47b6-baf6-ecb9c2b70f6f'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:06:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-96ccf198-0f61-47ab-9004-57fc8ef8d36d tempest-CreateVolumesFromImageTest-199074704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:06:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-96ccf198-0f61-47ab-9004-57fc8ef8d36d tempest-CreateVolumesFromImageTest-199074704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:06:37 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-96ccf198-0f61-47ab-9004-57fc8ef8d36d tempest-CreateVolumesFromImageTest-199074704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:06:37 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-96ccf198-0f61-47ab-9004-57fc8ef8d36d tempest-CreateVolumesFromImageTest-199074704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:06:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-96ccf198-0f61-47ab-9004-57fc8ef8d36d tempest-CreateVolumesFromImageTest-199074704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:06:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-96ccf198-0f61-47ab-9004-57fc8ef8d36d tempest-CreateVolumesFromImageTest-199074704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:37 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:06:37 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:37 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-96ccf198-0f61-47ab-9004-57fc8ef8d36d tempest-CreateVolumesFromImageTest-199074704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.302s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:37 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-96ccf198-0f61-47ab-9004-57fc8ef8d36d tempest-CreateVolumesFromImageTest-199074704 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:06:37 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-96ccf198-0f61-47ab-9004-57fc8ef8d36d tempest-CreateVolumesFromImageTest-199074704 None] Deleted volume successfully. Jul 30 17:06:37 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cd0ecd36-0611-4917-b31a-2d3b2ad5a0d8 tempest-TestServerVolumeAttachmentScenario-976284454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c70ef632-088b-4ecc-83b3-14a03594722e 1073741824" returned: 0 in 0.516s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:37 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-96ccf198-0f61-47ab-9004-57fc8ef8d36d tempest-CreateVolumesFromImageTest-199074704 None] Lock "cinder-18f03037-80c5-4e4e-bf6e-3801b9222993-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:06:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cd0ecd36-0611-4917-b31a-2d3b2ad5a0d8 tempest-TestServerVolumeAttachmentScenario-976284454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c70ef632-088b-4ecc-83b3-14a03594722e {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:37 devstack sudo[106318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c70ef632-088b-4ecc-83b3-14a03594722e Jul 30 17:06:37 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:37 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cd0ecd36-0611-4917-b31a-2d3b2ad5a0d8 tempest-TestServerVolumeAttachmentScenario-976284454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c70ef632-088b-4ecc-83b3-14a03594722e" returned: 0 in 0.262s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:37 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-cd0ecd36-0611-4917-b31a-2d3b2ad5a0d8 tempest-TestServerVolumeAttachmentScenario-976284454 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:06:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-cd0ecd36-0611-4917-b31a-2d3b2ad5a0d8 tempest-TestServerVolumeAttachmentScenario-976284454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:06:37 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-cd0ecd36-0611-4917-b31a-2d3b2ad5a0d8 tempest-TestServerVolumeAttachmentScenario-976284454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b21ff47-7d64-4262-a687-7b1670f7c857) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c70ef632-088b-4ecc-83b3-14a03594722e', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:38 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-cd0ecd36-0611-4917-b31a-2d3b2ad5a0d8 tempest-TestServerVolumeAttachmentScenario-976284454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62115f84-1694-4256-95ad-2d290ffdf5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:38 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-cd0ecd36-0611-4917-b31a-2d3b2ad5a0d8 tempest-TestServerVolumeAttachmentScenario-976284454 None] Volume volume-c70ef632-088b-4ecc-83b3-14a03594722e (c70ef632-088b-4ecc-83b3-14a03594722e): created successfully Jul 30 17:06:38 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-cd0ecd36-0611-4917-b31a-2d3b2ad5a0d8 tempest-TestServerVolumeAttachmentScenario-976284454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62115f84-1694-4256-95ad-2d290ffdf5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:38 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-cd0ecd36-0611-4917-b31a-2d3b2ad5a0d8 tempest-TestServerVolumeAttachmentScenario-976284454 None] Flow 'volume_create_manager' (801b46f3-c040-4074-a5a8-d827ab4252c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:06:38 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-cd0ecd36-0611-4917-b31a-2d3b2ad5a0d8 tempest-TestServerVolumeAttachmentScenario-976284454 None] Created volume successfully. Jul 30 17:06:38 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-aad05b7c-9e9c-4385-a978-4caedb2f0c13 tempest-CreateVolumesFromImageTest-199074704 None] Acquiring lock "cinder-17f4a30a-84e8-409d-826a-e825ab056255-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:06:38 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-aad05b7c-9e9c-4385-a978-4caedb2f0c13 tempest-CreateVolumesFromImageTest-199074704 None] Lock "cinder-17f4a30a-84e8-409d-826a-e825ab056255-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:06:38 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-aad05b7c-9e9c-4385-a978-4caedb2f0c13 tempest-CreateVolumesFromImageTest-199074704 None] Acquiring lock "cinder-quobyte-17f4a30a-84e8-409d-826a-e825ab056255" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:06:38 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-aad05b7c-9e9c-4385-a978-4caedb2f0c13 tempest-CreateVolumesFromImageTest-199074704 None] Lock "cinder-quobyte-17f4a30a-84e8-409d-826a-e825ab056255" acquired by "delete_volume" :: waited 0.018s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:06:38 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5cfa578-883b-409d-aac4-89fa09c295a7]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:06:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-aad05b7c-9e9c-4385-a978-4caedb2f0c13 tempest-CreateVolumesFromImageTest-199074704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-17f4a30a-84e8-409d-826a-e825ab056255 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:38 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-17f4a30a-84e8-409d-826a-e825ab056255 Jul 30 17:06:38 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:38 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-aad05b7c-9e9c-4385-a978-4caedb2f0c13 tempest-CreateVolumesFromImageTest-199074704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-17f4a30a-84e8-409d-826a-e825ab056255" returned: 0 in 0.390s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-aad05b7c-9e9c-4385-a978-4caedb2f0c13 tempest-CreateVolumesFromImageTest-199074704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-17f4a30a-84e8-409d-826a-e825ab056255 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:38 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-17f4a30a-84e8-409d-826a-e825ab056255 Jul 30 17:06:38 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:39 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-aad05b7c-9e9c-4385-a978-4caedb2f0c13 tempest-CreateVolumesFromImageTest-199074704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-17f4a30a-84e8-409d-826a-e825ab056255" returned: 0 in 0.260s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:39 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-aad05b7c-9e9c-4385-a978-4caedb2f0c13 tempest-CreateVolumesFromImageTest-199074704 None] Lock "cinder-quobyte-17f4a30a-84e8-409d-826a-e825ab056255" released by "delete_volume" :: held 0.698s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:06:39 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-aad05b7c-9e9c-4385-a978-4caedb2f0c13 tempest-CreateVolumesFromImageTest-199074704 None] Created reservations ['cff5c580-5bba-4c57-b3dd-adc4a1b4cc59', 'ee90a346-1954-4ed8-8448-889e20425aea', 'cf805d0f-7ab9-4043-973f-7e07da7c2a60', 'f5329957-bdb4-45d4-96f9-4adc6e4f97a0'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:06:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-aad05b7c-9e9c-4385-a978-4caedb2f0c13 tempest-CreateVolumesFromImageTest-199074704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:06:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-aad05b7c-9e9c-4385-a978-4caedb2f0c13 tempest-CreateVolumesFromImageTest-199074704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:06:39 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-aad05b7c-9e9c-4385-a978-4caedb2f0c13 tempest-CreateVolumesFromImageTest-199074704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:06:39 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-aad05b7c-9e9c-4385-a978-4caedb2f0c13 tempest-CreateVolumesFromImageTest-199074704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:06:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-aad05b7c-9e9c-4385-a978-4caedb2f0c13 tempest-CreateVolumesFromImageTest-199074704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:06:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-aad05b7c-9e9c-4385-a978-4caedb2f0c13 tempest-CreateVolumesFromImageTest-199074704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:39 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:06:39 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:39 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ac12ca0e-7ba8-4dc1-907d-e6bb5205bda3 tempest-CreateVolumesFromImageTest-199074704 None] Acquiring lock "cinder-abcfb475-e076-45eb-af44-27165640e271-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:06:39 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ac12ca0e-7ba8-4dc1-907d-e6bb5205bda3 tempest-CreateVolumesFromImageTest-199074704 None] Lock "cinder-abcfb475-e076-45eb-af44-27165640e271-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:06:39 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-aad05b7c-9e9c-4385-a978-4caedb2f0c13 tempest-CreateVolumesFromImageTest-199074704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.330s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:39 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-aad05b7c-9e9c-4385-a978-4caedb2f0c13 tempest-CreateVolumesFromImageTest-199074704 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:06:39 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-aad05b7c-9e9c-4385-a978-4caedb2f0c13 tempest-CreateVolumesFromImageTest-199074704 None] Deleted volume successfully. Jul 30 17:06:39 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ac12ca0e-7ba8-4dc1-907d-e6bb5205bda3 tempest-CreateVolumesFromImageTest-199074704 None] Acquiring lock "cinder-quobyte-abcfb475-e076-45eb-af44-27165640e271" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:06:39 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-aad05b7c-9e9c-4385-a978-4caedb2f0c13 tempest-CreateVolumesFromImageTest-199074704 None] Lock "cinder-17f4a30a-84e8-409d-826a-e825ab056255-delete_volume" released by "delete_volume" :: held 1.249s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:06:39 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ac12ca0e-7ba8-4dc1-907d-e6bb5205bda3 tempest-CreateVolumesFromImageTest-199074704 None] Lock "cinder-quobyte-abcfb475-e076-45eb-af44-27165640e271" acquired by "delete_volume" :: waited 0.026s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:06:39 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17e865e-92b4-4cb6-aaeb-90a8996f879c]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:06:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ac12ca0e-7ba8-4dc1-907d-e6bb5205bda3 tempest-CreateVolumesFromImageTest-199074704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-abcfb475-e076-45eb-af44-27165640e271 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:39 devstack sudo[106335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-abcfb475-e076-45eb-af44-27165640e271 Jul 30 17:06:39 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:40 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ac12ca0e-7ba8-4dc1-907d-e6bb5205bda3 tempest-CreateVolumesFromImageTest-199074704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-abcfb475-e076-45eb-af44-27165640e271" returned: 0 in 0.418s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ac12ca0e-7ba8-4dc1-907d-e6bb5205bda3 tempest-CreateVolumesFromImageTest-199074704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-abcfb475-e076-45eb-af44-27165640e271 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:40 devstack sudo[106340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-abcfb475-e076-45eb-af44-27165640e271 Jul 30 17:06:40 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:40 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ac12ca0e-7ba8-4dc1-907d-e6bb5205bda3 tempest-CreateVolumesFromImageTest-199074704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-abcfb475-e076-45eb-af44-27165640e271" returned: 0 in 0.282s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:40 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ac12ca0e-7ba8-4dc1-907d-e6bb5205bda3 tempest-CreateVolumesFromImageTest-199074704 None] Lock "cinder-quobyte-abcfb475-e076-45eb-af44-27165640e271" released by "delete_volume" :: held 0.749s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:06:40 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-ac12ca0e-7ba8-4dc1-907d-e6bb5205bda3 tempest-CreateVolumesFromImageTest-199074704 None] Created reservations ['00b0d276-4a29-4c04-bd19-edb7276447ba', '5ae146e9-9149-4b46-8fb2-c4d0421081e5', '94a3d950-cbb5-4673-8c2c-cbd255d33e02', '355e0b18-9f5d-43a4-8c24-1669ad38833a'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:06:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ac12ca0e-7ba8-4dc1-907d-e6bb5205bda3 tempest-CreateVolumesFromImageTest-199074704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:06:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ac12ca0e-7ba8-4dc1-907d-e6bb5205bda3 tempest-CreateVolumesFromImageTest-199074704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:06:40 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ac12ca0e-7ba8-4dc1-907d-e6bb5205bda3 tempest-CreateVolumesFromImageTest-199074704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:06:40 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ac12ca0e-7ba8-4dc1-907d-e6bb5205bda3 tempest-CreateVolumesFromImageTest-199074704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:06:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ac12ca0e-7ba8-4dc1-907d-e6bb5205bda3 tempest-CreateVolumesFromImageTest-199074704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:06:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ac12ca0e-7ba8-4dc1-907d-e6bb5205bda3 tempest-CreateVolumesFromImageTest-199074704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:40 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:06:40 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:40 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-a29d7e40-d6c5-4d93-8b0c-aefaca89a178 tempest-CreateVolumesFromImageTest-199074704 None] Acquiring lock "cinder-81cabfe1-dc97-4b59-aa74-51f17fc50b11-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:06:40 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-a29d7e40-d6c5-4d93-8b0c-aefaca89a178 tempest-CreateVolumesFromImageTest-199074704 None] Lock "cinder-81cabfe1-dc97-4b59-aa74-51f17fc50b11-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:06:40 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-a29d7e40-d6c5-4d93-8b0c-aefaca89a178 tempest-CreateVolumesFromImageTest-199074704 None] Acquiring lock "cinder-quobyte-81cabfe1-dc97-4b59-aa74-51f17fc50b11" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:06:40 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-a29d7e40-d6c5-4d93-8b0c-aefaca89a178 tempest-CreateVolumesFromImageTest-199074704 None] Lock "cinder-quobyte-81cabfe1-dc97-4b59-aa74-51f17fc50b11" acquired by "delete_volume" :: waited 0.016s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:06:40 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9a3741-b907-43e2-aca7-3d42e886f51e]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:06:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a29d7e40-d6c5-4d93-8b0c-aefaca89a178 tempest-CreateVolumesFromImageTest-199074704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-81cabfe1-dc97-4b59-aa74-51f17fc50b11 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:40 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ac12ca0e-7ba8-4dc1-907d-e6bb5205bda3 tempest-CreateVolumesFromImageTest-199074704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.434s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:41 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-ac12ca0e-7ba8-4dc1-907d-e6bb5205bda3 tempest-CreateVolumesFromImageTest-199074704 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:06:41 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-ac12ca0e-7ba8-4dc1-907d-e6bb5205bda3 tempest-CreateVolumesFromImageTest-199074704 None] Deleted volume successfully. Jul 30 17:06:41 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ac12ca0e-7ba8-4dc1-907d-e6bb5205bda3 tempest-CreateVolumesFromImageTest-199074704 None] Lock "cinder-abcfb475-e076-45eb-af44-27165640e271-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:06:41 devstack sudo[106347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-81cabfe1-dc97-4b59-aa74-51f17fc50b11 Jul 30 17:06:41 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:41 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a29d7e40-d6c5-4d93-8b0c-aefaca89a178 tempest-CreateVolumesFromImageTest-199074704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-81cabfe1-dc97-4b59-aa74-51f17fc50b11" returned: 0 in 0.440s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a29d7e40-d6c5-4d93-8b0c-aefaca89a178 tempest-CreateVolumesFromImageTest-199074704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-81cabfe1-dc97-4b59-aa74-51f17fc50b11 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:41 devstack sudo[106364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-81cabfe1-dc97-4b59-aa74-51f17fc50b11 Jul 30 17:06:41 devstack sudo[106364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:41 devstack sudo[106364]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a29d7e40-d6c5-4d93-8b0c-aefaca89a178 tempest-CreateVolumesFromImageTest-199074704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-81cabfe1-dc97-4b59-aa74-51f17fc50b11" returned: 0 in 0.306s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:41 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-a29d7e40-d6c5-4d93-8b0c-aefaca89a178 tempest-CreateVolumesFromImageTest-199074704 None] Lock "cinder-quobyte-81cabfe1-dc97-4b59-aa74-51f17fc50b11" released by "delete_volume" :: held 0.806s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:06:41 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-a29d7e40-d6c5-4d93-8b0c-aefaca89a178 tempest-CreateVolumesFromImageTest-199074704 None] Created reservations ['24f7ff41-fda1-4775-a16a-860e5c405e91', '42f7a8da-eb54-4a85-b403-aab8fa63f33d', '810995fd-9aef-46ef-901a-d6aa7720df53', '2cc5554f-2556-4fde-b9a3-e7f88d481013'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:06:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a29d7e40-d6c5-4d93-8b0c-aefaca89a178 tempest-CreateVolumesFromImageTest-199074704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:06:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a29d7e40-d6c5-4d93-8b0c-aefaca89a178 tempest-CreateVolumesFromImageTest-199074704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:06:41 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a29d7e40-d6c5-4d93-8b0c-aefaca89a178 tempest-CreateVolumesFromImageTest-199074704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:06:41 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a29d7e40-d6c5-4d93-8b0c-aefaca89a178 tempest-CreateVolumesFromImageTest-199074704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:06:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a29d7e40-d6c5-4d93-8b0c-aefaca89a178 tempest-CreateVolumesFromImageTest-199074704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:06:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a29d7e40-d6c5-4d93-8b0c-aefaca89a178 tempest-CreateVolumesFromImageTest-199074704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:41 devstack sudo[106370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:06:41 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:42 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-2c9df24e-cb08-40e3-8a35-e95ac7cf0c1d tempest-CreateVolumesFromImageTest-199074704 None] Acquiring lock "cinder-af3f5473-e2f2-4492-a095-83d0132f3efb-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:06:42 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-2c9df24e-cb08-40e3-8a35-e95ac7cf0c1d tempest-CreateVolumesFromImageTest-199074704 None] Lock "cinder-af3f5473-e2f2-4492-a095-83d0132f3efb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:06:42 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-2c9df24e-cb08-40e3-8a35-e95ac7cf0c1d tempest-CreateVolumesFromImageTest-199074704 None] Acquiring lock "cinder-quobyte-af3f5473-e2f2-4492-a095-83d0132f3efb" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:06:42 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-2c9df24e-cb08-40e3-8a35-e95ac7cf0c1d tempest-CreateVolumesFromImageTest-199074704 None] Lock "cinder-quobyte-af3f5473-e2f2-4492-a095-83d0132f3efb" acquired by "delete_volume" :: waited 0.022s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:06:42 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[db322a98-0727-4c69-bae2-7880d5033d8f]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:06:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2c9df24e-cb08-40e3-8a35-e95ac7cf0c1d tempest-CreateVolumesFromImageTest-199074704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-af3f5473-e2f2-4492-a095-83d0132f3efb {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:42 devstack sudo[106372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-af3f5473-e2f2-4492-a095-83d0132f3efb Jul 30 17:06:42 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:42 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a29d7e40-d6c5-4d93-8b0c-aefaca89a178 tempest-CreateVolumesFromImageTest-199074704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.371s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:42 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-a29d7e40-d6c5-4d93-8b0c-aefaca89a178 tempest-CreateVolumesFromImageTest-199074704 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:06:42 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-a29d7e40-d6c5-4d93-8b0c-aefaca89a178 tempest-CreateVolumesFromImageTest-199074704 None] Deleted volume successfully. Jul 30 17:06:42 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-a29d7e40-d6c5-4d93-8b0c-aefaca89a178 tempest-CreateVolumesFromImageTest-199074704 None] Lock "cinder-81cabfe1-dc97-4b59-aa74-51f17fc50b11-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:06:42 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2c9df24e-cb08-40e3-8a35-e95ac7cf0c1d tempest-CreateVolumesFromImageTest-199074704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-af3f5473-e2f2-4492-a095-83d0132f3efb" returned: 0 in 0.407s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2c9df24e-cb08-40e3-8a35-e95ac7cf0c1d tempest-CreateVolumesFromImageTest-199074704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-af3f5473-e2f2-4492-a095-83d0132f3efb {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:42 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-af3f5473-e2f2-4492-a095-83d0132f3efb Jul 30 17:06:42 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:42 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2c9df24e-cb08-40e3-8a35-e95ac7cf0c1d tempest-CreateVolumesFromImageTest-199074704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-af3f5473-e2f2-4492-a095-83d0132f3efb" returned: 0 in 0.279s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:42 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-2c9df24e-cb08-40e3-8a35-e95ac7cf0c1d tempest-CreateVolumesFromImageTest-199074704 None] Lock "cinder-quobyte-af3f5473-e2f2-4492-a095-83d0132f3efb" released by "delete_volume" :: held 0.738s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:06:42 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-2c9df24e-cb08-40e3-8a35-e95ac7cf0c1d tempest-CreateVolumesFromImageTest-199074704 None] Created reservations ['114c79a2-c791-4d11-a7ff-eb5c83f16c11', '0799909d-766c-4c71-9f4b-1c54eb24eded', 'c590d0e8-eccc-497e-904e-8554778d7bc7', '292afb6c-1944-4fbf-9240-456fea5e9251'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:06:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2c9df24e-cb08-40e3-8a35-e95ac7cf0c1d tempest-CreateVolumesFromImageTest-199074704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:06:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2c9df24e-cb08-40e3-8a35-e95ac7cf0c1d tempest-CreateVolumesFromImageTest-199074704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:06:42 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-2c9df24e-cb08-40e3-8a35-e95ac7cf0c1d tempest-CreateVolumesFromImageTest-199074704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:06:42 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-2c9df24e-cb08-40e3-8a35-e95ac7cf0c1d tempest-CreateVolumesFromImageTest-199074704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:06:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2c9df24e-cb08-40e3-8a35-e95ac7cf0c1d tempest-CreateVolumesFromImageTest-199074704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:06:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2c9df24e-cb08-40e3-8a35-e95ac7cf0c1d tempest-CreateVolumesFromImageTest-199074704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:42 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:06:42 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:43 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2c9df24e-cb08-40e3-8a35-e95ac7cf0c1d tempest-CreateVolumesFromImageTest-199074704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.308s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:43 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-2c9df24e-cb08-40e3-8a35-e95ac7cf0c1d tempest-CreateVolumesFromImageTest-199074704 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:06:43 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-2c9df24e-cb08-40e3-8a35-e95ac7cf0c1d tempest-CreateVolumesFromImageTest-199074704 None] Deleted volume successfully. Jul 30 17:06:43 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-2c9df24e-cb08-40e3-8a35-e95ac7cf0c1d tempest-CreateVolumesFromImageTest-199074704 None] Lock "cinder-af3f5473-e2f2-4492-a095-83d0132f3efb-delete_volume" released by "delete_volume" :: held 1.277s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:06:46 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c77aec6-0f07-42d1-8e70-a0df3461b5df tempest-CinderUnicodeTest-1254190413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:06:46 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2c77aec6-0f07-42d1-8e70-a0df3461b5df tempest-CinderUnicodeTest-1254190413 None] Flow 'volume_create_manager' (8b190de7-5515-4e97-84c6-419ce388c533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:06:46 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2c77aec6-0f07-42d1-8e70-a0df3461b5df tempest-CinderUnicodeTest-1254190413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (634bb42e-bbe2-4f63-9d99-08e6127897ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:46 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2c77aec6-0f07-42d1-8e70-a0df3461b5df tempest-CinderUnicodeTest-1254190413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (634bb42e-bbe2-4f63-9d99-08e6127897ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:06:47Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d04462b-354f-4cd1-b254-1fcca03f20f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='184eafa174954f70bdb3e2a5e2806909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:06:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:06:47Z,use_quota=True,user_id='9877b7f33fe64b63921a0a2dae395302',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:46 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2c77aec6-0f07-42d1-8e70-a0df3461b5df tempest-CinderUnicodeTest-1254190413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0ddf1df-59ef-4f2e-98a4-d95c0e0c431c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:46 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2c77aec6-0f07-42d1-8e70-a0df3461b5df tempest-CinderUnicodeTest-1254190413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0ddf1df-59ef-4f2e-98a4-d95c0e0c431c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:46 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2c77aec6-0f07-42d1-8e70-a0df3461b5df tempest-CinderUnicodeTest-1254190413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab9ddbe4-e159-4393-83df-f60f53c53490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:46 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2c77aec6-0f07-42d1-8e70-a0df3461b5df tempest-CinderUnicodeTest-1254190413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab9ddbe4-e159-4393-83df-f60f53c53490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d04462b-354f-4cd1-b254-1fcca03f20f1', 'volume_name': 'volume-0d04462b-354f-4cd1-b254-1fcca03f20f1', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:46 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2c77aec6-0f07-42d1-8e70-a0df3461b5df tempest-CinderUnicodeTest-1254190413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3007e0d6-5ee3-455f-8a61-c414419e954e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:46 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2c77aec6-0f07-42d1-8e70-a0df3461b5df tempest-CinderUnicodeTest-1254190413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3007e0d6-5ee3-455f-8a61-c414419e954e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:46 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2c77aec6-0f07-42d1-8e70-a0df3461b5df tempest-CinderUnicodeTest-1254190413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf0594a2-bbd9-4fae-83b6-e017ab7ce9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:46 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-2c77aec6-0f07-42d1-8e70-a0df3461b5df tempest-CinderUnicodeTest-1254190413 None] Volume 0d04462b-354f-4cd1-b254-1fcca03f20f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d04462b-354f-4cd1-b254-1fcca03f20f1', 'volume_size': 1} Jul 30 17:06:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2c77aec6-0f07-42d1-8e70-a0df3461b5df tempest-CinderUnicodeTest-1254190413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:06:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2c77aec6-0f07-42d1-8e70-a0df3461b5df tempest-CinderUnicodeTest-1254190413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:06:46 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-2c77aec6-0f07-42d1-8e70-a0df3461b5df tempest-CinderUnicodeTest-1254190413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:06:47Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d04462b-354f-4cd1-b254-1fcca03f20f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='184eafa174954f70bdb3e2a5e2806909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:06:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:06:47Z,use_quota=True,user_id='9877b7f33fe64b63921a0a2dae395302',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:06:46 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-2c77aec6-0f07-42d1-8e70-a0df3461b5df tempest-CinderUnicodeTest-1254190413 None] Creating volume 0d04462b-354f-4cd1-b254-1fcca03f20f1 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:06:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2c77aec6-0f07-42d1-8e70-a0df3461b5df tempest-CinderUnicodeTest-1254190413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:06:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2c77aec6-0f07-42d1-8e70-a0df3461b5df tempest-CinderUnicodeTest-1254190413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:06:46 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-2c77aec6-0f07-42d1-8e70-a0df3461b5df tempest-CinderUnicodeTest-1254190413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:06:46 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-2c77aec6-0f07-42d1-8e70-a0df3461b5df tempest-CinderUnicodeTest-1254190413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:06:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2c77aec6-0f07-42d1-8e70-a0df3461b5df tempest-CinderUnicodeTest-1254190413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:06:46 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-2c77aec6-0f07-42d1-8e70-a0df3461b5df tempest-CinderUnicodeTest-1254190413 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:06:46 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-2c77aec6-0f07-42d1-8e70-a0df3461b5df tempest-CinderUnicodeTest-1254190413 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:06:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2c77aec6-0f07-42d1-8e70-a0df3461b5df tempest-CinderUnicodeTest-1254190413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d04462b-354f-4cd1-b254-1fcca03f20f1 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:47 devstack sudo[106470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d04462b-354f-4cd1-b254-1fcca03f20f1 1073741824 Jul 30 17:06:47 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:47 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2c77aec6-0f07-42d1-8e70-a0df3461b5df tempest-CinderUnicodeTest-1254190413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d04462b-354f-4cd1-b254-1fcca03f20f1 1073741824" returned: 0 in 0.536s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2c77aec6-0f07-42d1-8e70-a0df3461b5df tempest-CinderUnicodeTest-1254190413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d04462b-354f-4cd1-b254-1fcca03f20f1 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:47 devstack sudo[106476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d04462b-354f-4cd1-b254-1fcca03f20f1 Jul 30 17:06:47 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:47 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2c77aec6-0f07-42d1-8e70-a0df3461b5df tempest-CinderUnicodeTest-1254190413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d04462b-354f-4cd1-b254-1fcca03f20f1" returned: 0 in 0.262s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:47 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-2c77aec6-0f07-42d1-8e70-a0df3461b5df tempest-CinderUnicodeTest-1254190413 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:06:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2c77aec6-0f07-42d1-8e70-a0df3461b5df tempest-CinderUnicodeTest-1254190413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:06:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2c77aec6-0f07-42d1-8e70-a0df3461b5df tempest-CinderUnicodeTest-1254190413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf0594a2-bbd9-4fae-83b6-e017ab7ce9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d04462b-354f-4cd1-b254-1fcca03f20f1', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2c77aec6-0f07-42d1-8e70-a0df3461b5df tempest-CinderUnicodeTest-1254190413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e2316d6-f7ea-4067-9687-d740cc3cfdf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:47 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-2c77aec6-0f07-42d1-8e70-a0df3461b5df tempest-CinderUnicodeTest-1254190413 None] Volume volume-0d04462b-354f-4cd1-b254-1fcca03f20f1 (0d04462b-354f-4cd1-b254-1fcca03f20f1): created successfully Jul 30 17:06:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2c77aec6-0f07-42d1-8e70-a0df3461b5df tempest-CinderUnicodeTest-1254190413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e2316d6-f7ea-4067-9687-d740cc3cfdf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2c77aec6-0f07-42d1-8e70-a0df3461b5df tempest-CinderUnicodeTest-1254190413 None] Flow 'volume_create_manager' (8b190de7-5515-4e97-84c6-419ce388c533) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:06:47 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-2c77aec6-0f07-42d1-8e70-a0df3461b5df tempest-CinderUnicodeTest-1254190413 None] Created volume successfully. Jul 30 17:06:49 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-85deb38a-113a-413a-90d4-2545905bafd7 tempest-CinderUnicodeTest-1254190413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:06:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-85deb38a-113a-413a-90d4-2545905bafd7 tempest-CinderUnicodeTest-1254190413 None] Flow 'volume_create_manager' (6e8aece4-ee41-43c3-af1f-1eb2e5df8c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:06:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-85deb38a-113a-413a-90d4-2545905bafd7 tempest-CinderUnicodeTest-1254190413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b5467d4-5f1c-442e-80c7-a4531398bc96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-85deb38a-113a-413a-90d4-2545905bafd7 tempest-CinderUnicodeTest-1254190413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b5467d4-5f1c-442e-80c7-a4531398bc96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:06:49Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-465935598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3be91259-de03-40be-8607-007fc00643b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='184eafa174954f70bdb3e2a5e2806909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:06:50Z,use_quota=True,user_id='9877b7f33fe64b63921a0a2dae395302',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-85deb38a-113a-413a-90d4-2545905bafd7 tempest-CinderUnicodeTest-1254190413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3495b80c-533c-4e83-a638-a5b1048772e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-85deb38a-113a-413a-90d4-2545905bafd7 tempest-CinderUnicodeTest-1254190413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3495b80c-533c-4e83-a638-a5b1048772e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-85deb38a-113a-413a-90d4-2545905bafd7 tempest-CinderUnicodeTest-1254190413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b379b570-d036-4bcb-b556-8ad2a0d03f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-85deb38a-113a-413a-90d4-2545905bafd7 tempest-CinderUnicodeTest-1254190413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b379b570-d036-4bcb-b556-8ad2a0d03f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3be91259-de03-40be-8607-007fc00643b1', 'volume_name': 'volume-3be91259-de03-40be-8607-007fc00643b1', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-85deb38a-113a-413a-90d4-2545905bafd7 tempest-CinderUnicodeTest-1254190413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6db26b61-83de-4fc3-bf9d-35a532b6e9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-85deb38a-113a-413a-90d4-2545905bafd7 tempest-CinderUnicodeTest-1254190413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6db26b61-83de-4fc3-bf9d-35a532b6e9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-85deb38a-113a-413a-90d4-2545905bafd7 tempest-CinderUnicodeTest-1254190413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df6ec876-38e4-4a7e-b261-bbef32e8bfc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:49 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-85deb38a-113a-413a-90d4-2545905bafd7 tempest-CinderUnicodeTest-1254190413 None] Volume 3be91259-de03-40be-8607-007fc00643b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3be91259-de03-40be-8607-007fc00643b1', 'volume_size': 1} Jul 30 17:06:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-85deb38a-113a-413a-90d4-2545905bafd7 tempest-CinderUnicodeTest-1254190413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:06:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-85deb38a-113a-413a-90d4-2545905bafd7 tempest-CinderUnicodeTest-1254190413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:06:49 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-85deb38a-113a-413a-90d4-2545905bafd7 tempest-CinderUnicodeTest-1254190413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:06:49Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-465935598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3be91259-de03-40be-8607-007fc00643b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='184eafa174954f70bdb3e2a5e2806909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:06:50Z,use_quota=True,user_id='9877b7f33fe64b63921a0a2dae395302',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:06:49 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-85deb38a-113a-413a-90d4-2545905bafd7 tempest-CinderUnicodeTest-1254190413 None] Creating volume 3be91259-de03-40be-8607-007fc00643b1 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:06:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-85deb38a-113a-413a-90d4-2545905bafd7 tempest-CinderUnicodeTest-1254190413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:06:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-85deb38a-113a-413a-90d4-2545905bafd7 tempest-CinderUnicodeTest-1254190413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:06:49 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-85deb38a-113a-413a-90d4-2545905bafd7 tempest-CinderUnicodeTest-1254190413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:06:49 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-85deb38a-113a-413a-90d4-2545905bafd7 tempest-CinderUnicodeTest-1254190413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:06:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-85deb38a-113a-413a-90d4-2545905bafd7 tempest-CinderUnicodeTest-1254190413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:06:49 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-85deb38a-113a-413a-90d4-2545905bafd7 tempest-CinderUnicodeTest-1254190413 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:06:49 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-85deb38a-113a-413a-90d4-2545905bafd7 tempest-CinderUnicodeTest-1254190413 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:06:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-85deb38a-113a-413a-90d4-2545905bafd7 tempest-CinderUnicodeTest-1254190413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3be91259-de03-40be-8607-007fc00643b1 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:49 devstack sudo[106481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3be91259-de03-40be-8607-007fc00643b1 1073741824 Jul 30 17:06:49 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:50 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-85deb38a-113a-413a-90d4-2545905bafd7 tempest-CinderUnicodeTest-1254190413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3be91259-de03-40be-8607-007fc00643b1 1073741824" returned: 0 in 0.434s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-85deb38a-113a-413a-90d4-2545905bafd7 tempest-CinderUnicodeTest-1254190413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3be91259-de03-40be-8607-007fc00643b1 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:50 devstack sudo[106486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3be91259-de03-40be-8607-007fc00643b1 Jul 30 17:06:50 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:50 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-85deb38a-113a-413a-90d4-2545905bafd7 tempest-CinderUnicodeTest-1254190413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3be91259-de03-40be-8607-007fc00643b1" returned: 0 in 0.254s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:50 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-85deb38a-113a-413a-90d4-2545905bafd7 tempest-CinderUnicodeTest-1254190413 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:06:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-85deb38a-113a-413a-90d4-2545905bafd7 tempest-CinderUnicodeTest-1254190413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:06:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-85deb38a-113a-413a-90d4-2545905bafd7 tempest-CinderUnicodeTest-1254190413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df6ec876-38e4-4a7e-b261-bbef32e8bfc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3be91259-de03-40be-8607-007fc00643b1', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-85deb38a-113a-413a-90d4-2545905bafd7 tempest-CinderUnicodeTest-1254190413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad9f8e36-6d6a-4ffb-a8eb-068497c16815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:06:50 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-85deb38a-113a-413a-90d4-2545905bafd7 tempest-CinderUnicodeTest-1254190413 None] Volume volume-3be91259-de03-40be-8607-007fc00643b1 (3be91259-de03-40be-8607-007fc00643b1): created successfully Jul 30 17:06:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-85deb38a-113a-413a-90d4-2545905bafd7 tempest-CinderUnicodeTest-1254190413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad9f8e36-6d6a-4ffb-a8eb-068497c16815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:06:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-85deb38a-113a-413a-90d4-2545905bafd7 tempest-CinderUnicodeTest-1254190413 None] Flow 'volume_create_manager' (6e8aece4-ee41-43c3-af1f-1eb2e5df8c42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:06:50 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-85deb38a-113a-413a-90d4-2545905bafd7 tempest-CinderUnicodeTest-1254190413 None] Created volume successfully. Jul 30 17:06:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-bf393810-32e5-4348-8d7b-c92698726e22 tempest-CinderUnicodeTest-1254190413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:06:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-bf393810-32e5-4348-8d7b-c92698726e22 tempest-CinderUnicodeTest-1254190413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:06:50 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-bf393810-32e5-4348-8d7b-c92698726e22 tempest-CinderUnicodeTest-1254190413 None] Creating offline snapshot cb4c70ed-ded7-4fab-9a73-2ad2213f6290 of volume 3be91259-de03-40be-8607-007fc00643b1 {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:06:50 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed977af1-5ddc-4994-ab8d-e3b01edef13f]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:06:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bf393810-32e5-4348-8d7b-c92698726e22 tempest-CinderUnicodeTest-1254190413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3be91259-de03-40be-8607-007fc00643b1 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:50 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3be91259-de03-40be-8607-007fc00643b1 Jul 30 17:06:50 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:51 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bf393810-32e5-4348-8d7b-c92698726e22 tempest-CinderUnicodeTest-1254190413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3be91259-de03-40be-8607-007fc00643b1" returned: 0 in 0.362s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bf393810-32e5-4348-8d7b-c92698726e22 tempest-CinderUnicodeTest-1254190413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3be91259-de03-40be-8607-007fc00643b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3be91259-de03-40be-8607-007fc00643b1.cb4c70ed-ded7-4fab-9a73-2ad2213f6290 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:51 devstack sudo[106500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3be91259-de03-40be-8607-007fc00643b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3be91259-de03-40be-8607-007fc00643b1.cb4c70ed-ded7-4fab-9a73-2ad2213f6290 1G Jul 30 17:06:51 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:51 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bf393810-32e5-4348-8d7b-c92698726e22 tempest-CinderUnicodeTest-1254190413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3be91259-de03-40be-8607-007fc00643b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3be91259-de03-40be-8607-007fc00643b1.cb4c70ed-ded7-4fab-9a73-2ad2213f6290 1G" returned: 0 in 0.373s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bf393810-32e5-4348-8d7b-c92698726e22 tempest-CinderUnicodeTest-1254190413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3be91259-de03-40be-8607-007fc00643b1 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3be91259-de03-40be-8607-007fc00643b1.cb4c70ed-ded7-4fab-9a73-2ad2213f6290 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:51 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3be91259-de03-40be-8607-007fc00643b1 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3be91259-de03-40be-8607-007fc00643b1.cb4c70ed-ded7-4fab-9a73-2ad2213f6290 Jul 30 17:06:51 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:51 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bf393810-32e5-4348-8d7b-c92698726e22 tempest-CinderUnicodeTest-1254190413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3be91259-de03-40be-8607-007fc00643b1 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3be91259-de03-40be-8607-007fc00643b1.cb4c70ed-ded7-4fab-9a73-2ad2213f6290" returned: 0 in 0.295s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:51 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-bf393810-32e5-4348-8d7b-c92698726e22 tempest-CinderUnicodeTest-1254190413 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3be91259-de03-40be-8607-007fc00643b1.cb4c70ed-ded7-4fab-9a73-2ad2213f6290 is being set with open permissions: ugo+rw Jul 30 17:06:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bf393810-32e5-4348-8d7b-c92698726e22 tempest-CinderUnicodeTest-1254190413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3be91259-de03-40be-8607-007fc00643b1.cb4c70ed-ded7-4fab-9a73-2ad2213f6290 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:51 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3be91259-de03-40be-8607-007fc00643b1.cb4c70ed-ded7-4fab-9a73-2ad2213f6290 Jul 30 17:06:51 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:52 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bf393810-32e5-4348-8d7b-c92698726e22 tempest-CinderUnicodeTest-1254190413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3be91259-de03-40be-8607-007fc00643b1.cb4c70ed-ded7-4fab-9a73-2ad2213f6290" returned: 0 in 0.289s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bf393810-32e5-4348-8d7b-c92698726e22 tempest-CinderUnicodeTest-1254190413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3be91259-de03-40be-8607-007fc00643b1.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:52 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3be91259-de03-40be-8607-007fc00643b1.info Jul 30 17:06:52 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:52 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bf393810-32e5-4348-8d7b-c92698726e22 tempest-CinderUnicodeTest-1254190413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3be91259-de03-40be-8607-007fc00643b1.info" returned: 0 in 0.261s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:52 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-bf393810-32e5-4348-8d7b-c92698726e22 tempest-CinderUnicodeTest-1254190413 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3be91259-de03-40be-8607-007fc00643b1.info is being set with open permissions: ugo+rw Jul 30 17:06:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bf393810-32e5-4348-8d7b-c92698726e22 tempest-CinderUnicodeTest-1254190413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3be91259-de03-40be-8607-007fc00643b1.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:52 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3be91259-de03-40be-8607-007fc00643b1.info Jul 30 17:06:52 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:52 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bf393810-32e5-4348-8d7b-c92698726e22 tempest-CinderUnicodeTest-1254190413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3be91259-de03-40be-8607-007fc00643b1.info" returned: 0 in 0.257s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-bf393810-32e5-4348-8d7b-c92698726e22 tempest-CinderUnicodeTest-1254190413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.931s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:06:52 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-bf393810-32e5-4348-8d7b-c92698726e22 tempest-CinderUnicodeTest-1254190413 None] Create snapshot completed successfully Jul 30 17:06:53 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f30b1d44-a1a7-4fdd-9c50-3edd7020e6f4 tempest-CinderUnicodeTest-1254190413 None] Acquiring lock "cinder-cb4c70ed-ded7-4fab-9a73-2ad2213f6290-delete_snapshot" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:06:53 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f30b1d44-a1a7-4fdd-9c50-3edd7020e6f4 tempest-CinderUnicodeTest-1254190413 None] Lock "cinder-cb4c70ed-ded7-4fab-9a73-2ad2213f6290-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:06:53 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f30b1d44-a1a7-4fdd-9c50-3edd7020e6f4 tempest-CinderUnicodeTest-1254190413 None] Acquiring lock "cinder-quobyte-3be91259-de03-40be-8607-007fc00643b1" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:06:53 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f30b1d44-a1a7-4fdd-9c50-3edd7020e6f4 tempest-CinderUnicodeTest-1254190413 None] Lock "cinder-quobyte-3be91259-de03-40be-8607-007fc00643b1" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:06:53 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f30b1d44-a1a7-4fdd-9c50-3edd7020e6f4 tempest-CinderUnicodeTest-1254190413 None] Acquiring lock "cinder-quobyte-cb4c70ed-ded7-4fab-9a73-2ad2213f6290" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:06:53 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f30b1d44-a1a7-4fdd-9c50-3edd7020e6f4 tempest-CinderUnicodeTest-1254190413 None] Lock "cinder-quobyte-cb4c70ed-ded7-4fab-9a73-2ad2213f6290" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:06:53 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-f30b1d44-a1a7-4fdd-9c50-3edd7020e6f4 tempest-CinderUnicodeTest-1254190413 None] Deleting offline snapshot cb4c70ed-ded7-4fab-9a73-2ad2213f6290 of volume 3be91259-de03-40be-8607-007fc00643b1 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:06:53 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-f30b1d44-a1a7-4fdd-9c50-3edd7020e6f4 tempest-CinderUnicodeTest-1254190413 None] snapshot_file for this snap is: volume-3be91259-de03-40be-8607-007fc00643b1.cb4c70ed-ded7-4fab-9a73-2ad2213f6290 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:06:53 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5c799a-cba1-4b50-9353-66ed6962afb7]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:06:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f30b1d44-a1a7-4fdd-9c50-3edd7020e6f4 tempest-CinderUnicodeTest-1254190413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3be91259-de03-40be-8607-007fc00643b1.cb4c70ed-ded7-4fab-9a73-2ad2213f6290 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:53 devstack sudo[106556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3be91259-de03-40be-8607-007fc00643b1.cb4c70ed-ded7-4fab-9a73-2ad2213f6290 Jul 30 17:06:53 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:53 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f30b1d44-a1a7-4fdd-9c50-3edd7020e6f4 tempest-CinderUnicodeTest-1254190413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3be91259-de03-40be-8607-007fc00643b1.cb4c70ed-ded7-4fab-9a73-2ad2213f6290" returned: 0 in 0.380s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:53 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-f30b1d44-a1a7-4fdd-9c50-3edd7020e6f4 tempest-CinderUnicodeTest-1254190413 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3be91259-de03-40be-8607-007fc00643b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:06:53 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dbd387a-5f0a-4614-b5a8-4ead903a6e36]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:06:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f30b1d44-a1a7-4fdd-9c50-3edd7020e6f4 tempest-CinderUnicodeTest-1254190413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3be91259-de03-40be-8607-007fc00643b1 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:53 devstack sudo[106561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3be91259-de03-40be-8607-007fc00643b1 Jul 30 17:06:53 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:53 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f30b1d44-a1a7-4fdd-9c50-3edd7020e6f4 tempest-CinderUnicodeTest-1254190413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3be91259-de03-40be-8607-007fc00643b1" returned: 0 in 0.360s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f30b1d44-a1a7-4fdd-9c50-3edd7020e6f4 tempest-CinderUnicodeTest-1254190413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3be91259-de03-40be-8607-007fc00643b1.cb4c70ed-ded7-4fab-9a73-2ad2213f6290 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:53 devstack sudo[106566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3be91259-de03-40be-8607-007fc00643b1.cb4c70ed-ded7-4fab-9a73-2ad2213f6290 Jul 30 17:06:53 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:54 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f30b1d44-a1a7-4fdd-9c50-3edd7020e6f4 tempest-CinderUnicodeTest-1254190413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3be91259-de03-40be-8607-007fc00643b1.cb4c70ed-ded7-4fab-9a73-2ad2213f6290" returned: 0 in 0.363s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f30b1d44-a1a7-4fdd-9c50-3edd7020e6f4 tempest-CinderUnicodeTest-1254190413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3be91259-de03-40be-8607-007fc00643b1.cb4c70ed-ded7-4fab-9a73-2ad2213f6290 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:54 devstack sudo[106571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3be91259-de03-40be-8607-007fc00643b1.cb4c70ed-ded7-4fab-9a73-2ad2213f6290 Jul 30 17:06:54 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:54 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f30b1d44-a1a7-4fdd-9c50-3edd7020e6f4 tempest-CinderUnicodeTest-1254190413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3be91259-de03-40be-8607-007fc00643b1.cb4c70ed-ded7-4fab-9a73-2ad2213f6290" returned: 0 in 0.253s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:54 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f30b1d44-a1a7-4fdd-9c50-3edd7020e6f4 tempest-CinderUnicodeTest-1254190413 None] Lock "cinder-quobyte-cb4c70ed-ded7-4fab-9a73-2ad2213f6290" released by "_delete_snapshot" :: held 1.466s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:06:54 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f30b1d44-a1a7-4fdd-9c50-3edd7020e6f4 tempest-CinderUnicodeTest-1254190413 None] Lock "cinder-quobyte-3be91259-de03-40be-8607-007fc00643b1" released by "delete_snapshot" :: held 1.493s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:06:54 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-f30b1d44-a1a7-4fdd-9c50-3edd7020e6f4 tempest-CinderUnicodeTest-1254190413 None] Created reservations ['043d7a99-95f7-4b8b-bdae-e4cc918a4939', '39a6387d-1443-4b0a-b3be-94a366fc872e', '260c8527-a7b2-4614-a347-c74cb2d06244', '03d91581-0f26-4f49-bbb1-d88d30dd6ae8'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:06:54 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-f30b1d44-a1a7-4fdd-9c50-3edd7020e6f4 tempest-CinderUnicodeTest-1254190413 None] Delete snapshot completed successfully. Jul 30 17:06:54 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f30b1d44-a1a7-4fdd-9c50-3edd7020e6f4 tempest-CinderUnicodeTest-1254190413 None] Lock "cinder-cb4c70ed-ded7-4fab-9a73-2ad2213f6290-delete_snapshot" released by "delete_snapshot" :: held 1.629s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:06:55 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ccbae879-830c-4687-b065-8fc9d89b3c87 tempest-CinderUnicodeTest-1254190413 None] Acquiring lock "cinder-3be91259-de03-40be-8607-007fc00643b1-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:06:55 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ccbae879-830c-4687-b065-8fc9d89b3c87 tempest-CinderUnicodeTest-1254190413 None] Lock "cinder-3be91259-de03-40be-8607-007fc00643b1-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:06:55 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ccbae879-830c-4687-b065-8fc9d89b3c87 tempest-CinderUnicodeTest-1254190413 None] Acquiring lock "cinder-quobyte-3be91259-de03-40be-8607-007fc00643b1" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:06:55 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ccbae879-830c-4687-b065-8fc9d89b3c87 tempest-CinderUnicodeTest-1254190413 None] Lock "cinder-quobyte-3be91259-de03-40be-8607-007fc00643b1" acquired by "delete_volume" :: waited 0.027s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:06:55 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e5a01e-dfb8-4d84-898b-2dea6ca45ee0]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:06:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ccbae879-830c-4687-b065-8fc9d89b3c87 tempest-CinderUnicodeTest-1254190413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3be91259-de03-40be-8607-007fc00643b1 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:55 devstack sudo[106574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3be91259-de03-40be-8607-007fc00643b1 Jul 30 17:06:55 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:55 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ccbae879-830c-4687-b065-8fc9d89b3c87 tempest-CinderUnicodeTest-1254190413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3be91259-de03-40be-8607-007fc00643b1" returned: 0 in 0.367s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ccbae879-830c-4687-b065-8fc9d89b3c87 tempest-CinderUnicodeTest-1254190413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3be91259-de03-40be-8607-007fc00643b1 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:55 devstack sudo[106579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3be91259-de03-40be-8607-007fc00643b1 Jul 30 17:06:55 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:55 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ccbae879-830c-4687-b065-8fc9d89b3c87 tempest-CinderUnicodeTest-1254190413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3be91259-de03-40be-8607-007fc00643b1" returned: 0 in 0.244s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:55 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ccbae879-830c-4687-b065-8fc9d89b3c87 tempest-CinderUnicodeTest-1254190413 None] Lock "cinder-quobyte-3be91259-de03-40be-8607-007fc00643b1" released by "delete_volume" :: held 0.674s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:06:55 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-ccbae879-830c-4687-b065-8fc9d89b3c87 tempest-CinderUnicodeTest-1254190413 None] Created reservations ['483657e7-73d1-4917-a019-b304239e6675', '4a6e4c94-b8a7-4da0-9956-cf8a5d0f70ab', 'c1d288b6-9074-4be0-89e0-7a8753563ed2', '214df0c3-d87a-4e07-80c8-45be64391f54'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:06:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ccbae879-830c-4687-b065-8fc9d89b3c87 tempest-CinderUnicodeTest-1254190413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:06:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ccbae879-830c-4687-b065-8fc9d89b3c87 tempest-CinderUnicodeTest-1254190413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:06:56 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ccbae879-830c-4687-b065-8fc9d89b3c87 tempest-CinderUnicodeTest-1254190413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:06:56 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ccbae879-830c-4687-b065-8fc9d89b3c87 tempest-CinderUnicodeTest-1254190413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:06:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ccbae879-830c-4687-b065-8fc9d89b3c87 tempest-CinderUnicodeTest-1254190413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:06:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ccbae879-830c-4687-b065-8fc9d89b3c87 tempest-CinderUnicodeTest-1254190413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:56 devstack sudo[106582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:06:56 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:56 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ccbae879-830c-4687-b065-8fc9d89b3c87 tempest-CinderUnicodeTest-1254190413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.261s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:56 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-ccbae879-830c-4687-b065-8fc9d89b3c87 tempest-CinderUnicodeTest-1254190413 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:06:56 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-ccbae879-830c-4687-b065-8fc9d89b3c87 tempest-CinderUnicodeTest-1254190413 None] Deleted volume successfully. Jul 30 17:06:56 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ccbae879-830c-4687-b065-8fc9d89b3c87 tempest-CinderUnicodeTest-1254190413 None] Lock "cinder-3be91259-de03-40be-8607-007fc00643b1-delete_volume" released by "delete_volume" :: held 1.172s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:06:56 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d9091667-7b0b-4937-b695-2373fcd0a1c8 tempest-CinderUnicodeTest-1254190413 None] Acquiring lock "cinder-0d04462b-354f-4cd1-b254-1fcca03f20f1-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:06:56 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d9091667-7b0b-4937-b695-2373fcd0a1c8 tempest-CinderUnicodeTest-1254190413 None] Lock "cinder-0d04462b-354f-4cd1-b254-1fcca03f20f1-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:06:56 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d9091667-7b0b-4937-b695-2373fcd0a1c8 tempest-CinderUnicodeTest-1254190413 None] Acquiring lock "cinder-quobyte-0d04462b-354f-4cd1-b254-1fcca03f20f1" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:06:56 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d9091667-7b0b-4937-b695-2373fcd0a1c8 tempest-CinderUnicodeTest-1254190413 None] Lock "cinder-quobyte-0d04462b-354f-4cd1-b254-1fcca03f20f1" acquired by "delete_volume" :: waited 0.018s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:06:56 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[297ce732-f188-40a6-8856-3ca2b8ef1479]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:06:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d9091667-7b0b-4937-b695-2373fcd0a1c8 tempest-CinderUnicodeTest-1254190413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d04462b-354f-4cd1-b254-1fcca03f20f1 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:56 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d04462b-354f-4cd1-b254-1fcca03f20f1 Jul 30 17:06:56 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:56 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d9091667-7b0b-4937-b695-2373fcd0a1c8 tempest-CinderUnicodeTest-1254190413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d04462b-354f-4cd1-b254-1fcca03f20f1" returned: 0 in 0.350s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d9091667-7b0b-4937-b695-2373fcd0a1c8 tempest-CinderUnicodeTest-1254190413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d04462b-354f-4cd1-b254-1fcca03f20f1 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:56 devstack sudo[106590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d04462b-354f-4cd1-b254-1fcca03f20f1 Jul 30 17:06:56 devstack sudo[106590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:57 devstack sudo[106590]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d9091667-7b0b-4937-b695-2373fcd0a1c8 tempest-CinderUnicodeTest-1254190413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0d04462b-354f-4cd1-b254-1fcca03f20f1" returned: 0 in 0.246s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:57 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d9091667-7b0b-4937-b695-2373fcd0a1c8 tempest-CinderUnicodeTest-1254190413 None] Lock "cinder-quobyte-0d04462b-354f-4cd1-b254-1fcca03f20f1" released by "delete_volume" :: held 0.636s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:06:57 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-d9091667-7b0b-4937-b695-2373fcd0a1c8 tempest-CinderUnicodeTest-1254190413 None] Created reservations ['3fe957f5-4faa-4d9c-9e40-2dd35c959a7a', 'bbefbf96-e8c1-41bd-b8c9-8f07ea7b2283', '0a6308fe-3914-4b0e-b302-6385b9e48570', '17c946ee-32da-43e0-b4bf-08af4352092e'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:06:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d9091667-7b0b-4937-b695-2373fcd0a1c8 tempest-CinderUnicodeTest-1254190413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:06:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d9091667-7b0b-4937-b695-2373fcd0a1c8 tempest-CinderUnicodeTest-1254190413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:06:57 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d9091667-7b0b-4937-b695-2373fcd0a1c8 tempest-CinderUnicodeTest-1254190413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:06:57 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d9091667-7b0b-4937-b695-2373fcd0a1c8 tempest-CinderUnicodeTest-1254190413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:06:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d9091667-7b0b-4937-b695-2373fcd0a1c8 tempest-CinderUnicodeTest-1254190413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:06:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d9091667-7b0b-4937-b695-2373fcd0a1c8 tempest-CinderUnicodeTest-1254190413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:06:57 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:06:57 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:06:57 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Jul 30 17:06:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d9091667-7b0b-4937-b695-2373fcd0a1c8 tempest-CinderUnicodeTest-1254190413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.266s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:06:57 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-d9091667-7b0b-4937-b695-2373fcd0a1c8 tempest-CinderUnicodeTest-1254190413 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:06:57 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-d9091667-7b0b-4937-b695-2373fcd0a1c8 tempest-CinderUnicodeTest-1254190413 None] Deleted volume successfully. Jul 30 17:06:57 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d9091667-7b0b-4937-b695-2373fcd0a1c8 tempest-CinderUnicodeTest-1254190413 None] Lock "cinder-0d04462b-354f-4cd1-b254-1fcca03f20f1-delete_volume" released by "delete_volume" :: held 1.118s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:07:07 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:SELECT=66,cinder:UPDATE=87,cinder:DELETE=9,cinder:INSERT=20 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:07:07 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:UPDATE=93,cinder:SELECT=58,cinder:INSERT=22,cinder:DELETE=8 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:07:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-0407e713-fc9b-4ef2-ace5-b9c23572d966 req-93fae42c-70cd-4a8c-a887-c9d8e269d107 tempest-TestServerVolumeAttachmentScenario-976284454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:07:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-0407e713-fc9b-4ef2-ace5-b9c23572d966 req-93fae42c-70cd-4a8c-a887-c9d8e269d107 tempest-TestServerVolumeAttachmentScenario-976284454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:07:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-0407e713-fc9b-4ef2-ace5-b9c23572d966 req-93fae42c-70cd-4a8c-a887-c9d8e269d107 tempest-TestServerVolumeAttachmentScenario-976284454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:07:09 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-0407e713-fc9b-4ef2-ace5-b9c23572d966 req-93fae42c-70cd-4a8c-a887-c9d8e269d107 tempest-TestServerVolumeAttachmentScenario-976284454 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202', 'name': 'volume-d758c84a-992d-483d-a50f-98353f771e66', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '926bf6e1-4553-4969-aedb-adde4ebe6368', 'enforce_multipath': True} {{(pid=88591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 17:07:09 devstack cinder-volume[88591]: INFO cinder.volume.manager [req-0407e713-fc9b-4ef2-ace5-b9c23572d966 req-93fae42c-70cd-4a8c-a887-c9d8e269d107 tempest-TestServerVolumeAttachmentScenario-976284454 None] attachment_update completed successfully. Jul 30 17:07:12 devstack cinder-volume[88591]: DEBUG oslo_service.periodic_task [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 17:07:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:07:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:07:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:07:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:07:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:07:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:12 devstack sudo[107027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:07:12 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:12 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.248s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:12 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:07:12 devstack cinder-volume[88591]: DEBUG oslo_service.periodic_task [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running periodic task VolumeManager._thread_info {{(pid=88591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 17:07:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] thread count: 28 {{(pid=88591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 17:07:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] thread info: [<_MainThread(MainThread, started 140677178003584)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 17:07:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-0bac8ebd-854f-4549-a6ad-77fc070cc075 req-e6c97a6a-126b-4e2b-9434-c3859240cf40 tempest-TestServerVolumeAttachmentScenario-976284454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:07:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-0bac8ebd-854f-4549-a6ad-77fc070cc075 req-e6c97a6a-126b-4e2b-9434-c3859240cf40 tempest-TestServerVolumeAttachmentScenario-976284454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:07:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [req-0bac8ebd-854f-4549-a6ad-77fc070cc075 req-e6c97a6a-126b-4e2b-9434-c3859240cf40 tempest-TestServerVolumeAttachmentScenario-976284454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:07:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-0bac8ebd-854f-4549-a6ad-77fc070cc075 req-e6c97a6a-126b-4e2b-9434-c3859240cf40 tempest-TestServerVolumeAttachmentScenario-976284454 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202', 'name': 'volume-c70ef632-088b-4ecc-83b3-14a03594722e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fdef8fd1-4e5b-4c6e-a626-6350f4b02c04', 'enforce_multipath': True} {{(pid=88591) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 17:07:13 devstack cinder-volume[88591]: INFO cinder.volume.manager [req-0bac8ebd-854f-4549-a6ad-77fc070cc075 req-e6c97a6a-126b-4e2b-9434-c3859240cf40 tempest-TestServerVolumeAttachmentScenario-976284454 None] attachment_update completed successfully. Jul 30 17:07:15 devstack cinder-volume[88591]: INFO cinder.volume.manager [req-f174b8d9-878e-4c62-b640-3b277806db7c req-9b04d34d-f0cf-4d64-9fdc-68f11655621f tempest-TestServerVolumeAttachmentScenario-976284454 None] Terminate volume connection completed successfully. Jul 30 17:07:15 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-f174b8d9-878e-4c62-b640-3b277806db7c req-9b04d34d-f0cf-4d64-9fdc-68f11655621f tempest-TestServerVolumeAttachmentScenario-976284454 None] Deleting attachment fdef8fd1-4e5b-4c6e-a626-6350f4b02c04. {{(pid=88591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 17:07:16 devstack cinder-volume[88591]: INFO cinder.volume.manager [req-84838b80-b114-4afa-b7b7-b3898d7f47a5 req-e8abda75-0312-439a-8c5d-40e5b18e17ef tempest-TestServerVolumeAttachmentScenario-976284454 None] Terminate volume connection completed successfully. Jul 30 17:07:16 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [req-84838b80-b114-4afa-b7b7-b3898d7f47a5 req-e8abda75-0312-439a-8c5d-40e5b18e17ef tempest-TestServerVolumeAttachmentScenario-976284454 None] Deleting attachment 926bf6e1-4553-4969-aedb-adde4ebe6368. {{(pid=88591) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 17:07:21 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f38d2019-b694-44ea-92ac-a572fcc3cabd tempest-TestServerVolumeAttachmentScenario-976284454 None] Acquiring lock "cinder-c70ef632-088b-4ecc-83b3-14a03594722e-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:07:21 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f38d2019-b694-44ea-92ac-a572fcc3cabd tempest-TestServerVolumeAttachmentScenario-976284454 None] Lock "cinder-c70ef632-088b-4ecc-83b3-14a03594722e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:07:21 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f38d2019-b694-44ea-92ac-a572fcc3cabd tempest-TestServerVolumeAttachmentScenario-976284454 None] Acquiring lock "cinder-quobyte-c70ef632-088b-4ecc-83b3-14a03594722e" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:07:21 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f38d2019-b694-44ea-92ac-a572fcc3cabd tempest-TestServerVolumeAttachmentScenario-976284454 None] Lock "cinder-quobyte-c70ef632-088b-4ecc-83b3-14a03594722e" acquired by "delete_volume" :: waited 0.013s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:07:21 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55833cd-309d-41a9-8b99-62e3f0ec8730]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:07:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f38d2019-b694-44ea-92ac-a572fcc3cabd tempest-TestServerVolumeAttachmentScenario-976284454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c70ef632-088b-4ecc-83b3-14a03594722e {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:21 devstack sudo[107107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c70ef632-088b-4ecc-83b3-14a03594722e Jul 30 17:07:21 devstack sudo[107107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:21 devstack sudo[107107]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f38d2019-b694-44ea-92ac-a572fcc3cabd tempest-TestServerVolumeAttachmentScenario-976284454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c70ef632-088b-4ecc-83b3-14a03594722e" returned: 0 in 0.355s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f38d2019-b694-44ea-92ac-a572fcc3cabd tempest-TestServerVolumeAttachmentScenario-976284454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c70ef632-088b-4ecc-83b3-14a03594722e {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:21 devstack sudo[107112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c70ef632-088b-4ecc-83b3-14a03594722e Jul 30 17:07:21 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:21 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f38d2019-b694-44ea-92ac-a572fcc3cabd tempest-TestServerVolumeAttachmentScenario-976284454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c70ef632-088b-4ecc-83b3-14a03594722e" returned: 0 in 0.241s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:21 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f38d2019-b694-44ea-92ac-a572fcc3cabd tempest-TestServerVolumeAttachmentScenario-976284454 None] Lock "cinder-quobyte-c70ef632-088b-4ecc-83b3-14a03594722e" released by "delete_volume" :: held 0.631s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:07:22 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-f38d2019-b694-44ea-92ac-a572fcc3cabd tempest-TestServerVolumeAttachmentScenario-976284454 None] Created reservations ['c9501fca-0f16-4c7e-9ce2-e5f5949194ce', 'fa52da77-2202-461d-a170-3e72b3533bbf', '66bc802f-757a-427a-9df7-99b88858d6c5', 'f0d9f4e6-8ace-4526-a261-a881b9d10cda'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:07:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f38d2019-b694-44ea-92ac-a572fcc3cabd tempest-TestServerVolumeAttachmentScenario-976284454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:07:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f38d2019-b694-44ea-92ac-a572fcc3cabd tempest-TestServerVolumeAttachmentScenario-976284454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:07:22 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f38d2019-b694-44ea-92ac-a572fcc3cabd tempest-TestServerVolumeAttachmentScenario-976284454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:07:22 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f38d2019-b694-44ea-92ac-a572fcc3cabd tempest-TestServerVolumeAttachmentScenario-976284454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:07:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f38d2019-b694-44ea-92ac-a572fcc3cabd tempest-TestServerVolumeAttachmentScenario-976284454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:07:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f38d2019-b694-44ea-92ac-a572fcc3cabd tempest-TestServerVolumeAttachmentScenario-976284454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:22 devstack sudo[107116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:07:22 devstack sudo[107116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:22 devstack sudo[107116]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f38d2019-b694-44ea-92ac-a572fcc3cabd tempest-TestServerVolumeAttachmentScenario-976284454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.239s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:22 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-f38d2019-b694-44ea-92ac-a572fcc3cabd tempest-TestServerVolumeAttachmentScenario-976284454 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:07:22 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-f38d2019-b694-44ea-92ac-a572fcc3cabd tempest-TestServerVolumeAttachmentScenario-976284454 None] Deleted volume successfully. Jul 30 17:07:22 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f38d2019-b694-44ea-92ac-a572fcc3cabd tempest-TestServerVolumeAttachmentScenario-976284454 None] Lock "cinder-c70ef632-088b-4ecc-83b3-14a03594722e-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:07:22 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-8cb909f1-201f-4a0c-b05a-ccd6cf00799f tempest-TestServerVolumeAttachmentScenario-976284454 None] Acquiring lock "cinder-d758c84a-992d-483d-a50f-98353f771e66-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:07:22 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-8cb909f1-201f-4a0c-b05a-ccd6cf00799f tempest-TestServerVolumeAttachmentScenario-976284454 None] Lock "cinder-d758c84a-992d-483d-a50f-98353f771e66-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:07:22 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-8cb909f1-201f-4a0c-b05a-ccd6cf00799f tempest-TestServerVolumeAttachmentScenario-976284454 None] Acquiring lock "cinder-quobyte-d758c84a-992d-483d-a50f-98353f771e66" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:07:22 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-8cb909f1-201f-4a0c-b05a-ccd6cf00799f tempest-TestServerVolumeAttachmentScenario-976284454 None] Lock "cinder-quobyte-d758c84a-992d-483d-a50f-98353f771e66" acquired by "delete_volume" :: waited 0.015s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:07:22 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[033b2fcb-6e12-4c19-bc2c-5229f6b7df47]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:07:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8cb909f1-201f-4a0c-b05a-ccd6cf00799f tempest-TestServerVolumeAttachmentScenario-976284454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d758c84a-992d-483d-a50f-98353f771e66 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:22 devstack sudo[107120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d758c84a-992d-483d-a50f-98353f771e66 Jul 30 17:07:22 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:22 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8cb909f1-201f-4a0c-b05a-ccd6cf00799f tempest-TestServerVolumeAttachmentScenario-976284454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d758c84a-992d-483d-a50f-98353f771e66" returned: 0 in 0.365s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8cb909f1-201f-4a0c-b05a-ccd6cf00799f tempest-TestServerVolumeAttachmentScenario-976284454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d758c84a-992d-483d-a50f-98353f771e66 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:22 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d758c84a-992d-483d-a50f-98353f771e66 Jul 30 17:07:22 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:23 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8cb909f1-201f-4a0c-b05a-ccd6cf00799f tempest-TestServerVolumeAttachmentScenario-976284454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-d758c84a-992d-483d-a50f-98353f771e66" returned: 0 in 0.255s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:23 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-8cb909f1-201f-4a0c-b05a-ccd6cf00799f tempest-TestServerVolumeAttachmentScenario-976284454 None] Lock "cinder-quobyte-d758c84a-992d-483d-a50f-98353f771e66" released by "delete_volume" :: held 0.655s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:07:23 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-8cb909f1-201f-4a0c-b05a-ccd6cf00799f tempest-TestServerVolumeAttachmentScenario-976284454 None] Created reservations ['76bf5ab4-897e-46cd-ba10-370a48b303c3', '0c6d2321-5694-438a-ae02-6707399853bc', 'e79d7de4-bda8-42d8-89a1-e8cf264b7989', '8ecb5582-f007-4bae-8560-94c46904869c'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:07:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8cb909f1-201f-4a0c-b05a-ccd6cf00799f tempest-TestServerVolumeAttachmentScenario-976284454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:07:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8cb909f1-201f-4a0c-b05a-ccd6cf00799f tempest-TestServerVolumeAttachmentScenario-976284454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:07:23 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-8cb909f1-201f-4a0c-b05a-ccd6cf00799f tempest-TestServerVolumeAttachmentScenario-976284454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:07:23 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-8cb909f1-201f-4a0c-b05a-ccd6cf00799f tempest-TestServerVolumeAttachmentScenario-976284454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:07:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8cb909f1-201f-4a0c-b05a-ccd6cf00799f tempest-TestServerVolumeAttachmentScenario-976284454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:07:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8cb909f1-201f-4a0c-b05a-ccd6cf00799f tempest-TestServerVolumeAttachmentScenario-976284454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:23 devstack sudo[107128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:07:23 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:23 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8cb909f1-201f-4a0c-b05a-ccd6cf00799f tempest-TestServerVolumeAttachmentScenario-976284454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.242s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:23 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-8cb909f1-201f-4a0c-b05a-ccd6cf00799f tempest-TestServerVolumeAttachmentScenario-976284454 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:07:23 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-8cb909f1-201f-4a0c-b05a-ccd6cf00799f tempest-TestServerVolumeAttachmentScenario-976284454 None] Deleted volume successfully. Jul 30 17:07:23 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-8cb909f1-201f-4a0c-b05a-ccd6cf00799f tempest-TestServerVolumeAttachmentScenario-976284454 None] Lock "cinder-d758c84a-992d-483d-a50f-98353f771e66-delete_volume" released by "delete_volume" :: held 1.099s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:07:33 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-fabeeb6d-ebd3-44b2-862e-d56d23eb41b1 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:07:33 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fabeeb6d-ebd3-44b2-862e-d56d23eb41b1 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Flow 'volume_create_manager' (a90f4425-4de0-4d6b-8aae-2ca330507a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:07:33 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fabeeb6d-ebd3-44b2-862e-d56d23eb41b1 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6561cd72-80fe-4b5b-bf8c-20916693d74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:33 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fabeeb6d-ebd3-44b2-862e-d56d23eb41b1 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6561cd72-80fe-4b5b-bf8c-20916693d74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:07:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1912877779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc13bcb6-a51e-44ef-a723-16622db85a2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98eac9e471ae4b4cbb93b235389c9e26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:07:33Z,use_quota=True,user_id='7b6f6e35c3394a858ec1cc5d6e14d167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:33 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fabeeb6d-ebd3-44b2-862e-d56d23eb41b1 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (329c9b85-e7df-4acf-8bec-23bffc2c3686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:33 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fabeeb6d-ebd3-44b2-862e-d56d23eb41b1 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (329c9b85-e7df-4acf-8bec-23bffc2c3686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:33 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fabeeb6d-ebd3-44b2-862e-d56d23eb41b1 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (029eef3f-6099-4821-81ae-5b9c6e5c5eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:33 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fabeeb6d-ebd3-44b2-862e-d56d23eb41b1 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (029eef3f-6099-4821-81ae-5b9c6e5c5eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc13bcb6-a51e-44ef-a723-16622db85a2f', 'volume_name': 'volume-cc13bcb6-a51e-44ef-a723-16622db85a2f', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:33 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fabeeb6d-ebd3-44b2-862e-d56d23eb41b1 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (782b0b22-c0fe-44ea-b5aa-db7c7c8e82fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:33 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fabeeb6d-ebd3-44b2-862e-d56d23eb41b1 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (782b0b22-c0fe-44ea-b5aa-db7c7c8e82fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:33 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fabeeb6d-ebd3-44b2-862e-d56d23eb41b1 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (971aaabe-bf62-4dbb-a970-5a507a5155fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:33 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-fabeeb6d-ebd3-44b2-862e-d56d23eb41b1 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Volume cc13bcb6-a51e-44ef-a723-16622db85a2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc13bcb6-a51e-44ef-a723-16622db85a2f', 'volume_size': 1} Jul 30 17:07:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-fabeeb6d-ebd3-44b2-862e-d56d23eb41b1 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:07:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-fabeeb6d-ebd3-44b2-862e-d56d23eb41b1 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:07:33 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-fabeeb6d-ebd3-44b2-862e-d56d23eb41b1 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:07:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1912877779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc13bcb6-a51e-44ef-a723-16622db85a2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98eac9e471ae4b4cbb93b235389c9e26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:07:33Z,use_quota=True,user_id='7b6f6e35c3394a858ec1cc5d6e14d167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:07:33 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-fabeeb6d-ebd3-44b2-862e-d56d23eb41b1 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Creating volume cc13bcb6-a51e-44ef-a723-16622db85a2f {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:07:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-fabeeb6d-ebd3-44b2-862e-d56d23eb41b1 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:07:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-fabeeb6d-ebd3-44b2-862e-d56d23eb41b1 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:07:33 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-fabeeb6d-ebd3-44b2-862e-d56d23eb41b1 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:07:33 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-fabeeb6d-ebd3-44b2-862e-d56d23eb41b1 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:07:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-fabeeb6d-ebd3-44b2-862e-d56d23eb41b1 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:07:33 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-fabeeb6d-ebd3-44b2-862e-d56d23eb41b1 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:07:33 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-fabeeb6d-ebd3-44b2-862e-d56d23eb41b1 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:07:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fabeeb6d-ebd3-44b2-862e-d56d23eb41b1 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-cc13bcb6-a51e-44ef-a723-16622db85a2f 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:33 devstack sudo[107139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-cc13bcb6-a51e-44ef-a723-16622db85a2f 1073741824 Jul 30 17:07:33 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:33 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fabeeb6d-ebd3-44b2-862e-d56d23eb41b1 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-cc13bcb6-a51e-44ef-a723-16622db85a2f 1073741824" returned: 0 in 0.405s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fabeeb6d-ebd3-44b2-862e-d56d23eb41b1 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-cc13bcb6-a51e-44ef-a723-16622db85a2f {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:33 devstack sudo[107145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-cc13bcb6-a51e-44ef-a723-16622db85a2f Jul 30 17:07:33 devstack sudo[107145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:33 devstack sudo[107145]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fabeeb6d-ebd3-44b2-862e-d56d23eb41b1 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-cc13bcb6-a51e-44ef-a723-16622db85a2f" returned: 0 in 0.232s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:33 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-fabeeb6d-ebd3-44b2-862e-d56d23eb41b1 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:07:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-fabeeb6d-ebd3-44b2-862e-d56d23eb41b1 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.680s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:07:33 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fabeeb6d-ebd3-44b2-862e-d56d23eb41b1 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (971aaabe-bf62-4dbb-a970-5a507a5155fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc13bcb6-a51e-44ef-a723-16622db85a2f', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:33 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fabeeb6d-ebd3-44b2-862e-d56d23eb41b1 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e1d8a1c-432d-4b27-abb3-e7733c80138e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:33 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-fabeeb6d-ebd3-44b2-862e-d56d23eb41b1 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Volume volume-cc13bcb6-a51e-44ef-a723-16622db85a2f (cc13bcb6-a51e-44ef-a723-16622db85a2f): created successfully Jul 30 17:07:33 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fabeeb6d-ebd3-44b2-862e-d56d23eb41b1 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e1d8a1c-432d-4b27-abb3-e7733c80138e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:33 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fabeeb6d-ebd3-44b2-862e-d56d23eb41b1 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Flow 'volume_create_manager' (a90f4425-4de0-4d6b-8aae-2ca330507a12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:07:33 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-fabeeb6d-ebd3-44b2-862e-d56d23eb41b1 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Created volume successfully. Jul 30 17:07:34 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cfce889-e39b-46a4-a9f9-298e53aa345a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:07:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1cfce889-e39b-46a4-a9f9-298e53aa345a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Flow 'volume_create_manager' (77608afb-3104-41a2-ac52-9b47fdecd575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:07:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1cfce889-e39b-46a4-a9f9-298e53aa345a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9140a8f-7465-45e2-8f58-a6e2bf5f8226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1cfce889-e39b-46a4-a9f9-298e53aa345a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9140a8f-7465-45e2-8f58-a6e2bf5f8226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-102664336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=866b9d6a-5695-41be-8f90-e751ce6ea289,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98eac9e471ae4b4cbb93b235389c9e26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:07:35Z,use_quota=True,user_id='7b6f6e35c3394a858ec1cc5d6e14d167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1cfce889-e39b-46a4-a9f9-298e53aa345a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8167dba6-7d67-43bc-a8ab-f24cd823b792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1cfce889-e39b-46a4-a9f9-298e53aa345a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8167dba6-7d67-43bc-a8ab-f24cd823b792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1cfce889-e39b-46a4-a9f9-298e53aa345a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c721c88-ffb7-48c3-83cb-3ce4ccb89191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1cfce889-e39b-46a4-a9f9-298e53aa345a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c721c88-ffb7-48c3-83cb-3ce4ccb89191) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '866b9d6a-5695-41be-8f90-e751ce6ea289', 'volume_name': 'volume-866b9d6a-5695-41be-8f90-e751ce6ea289', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1cfce889-e39b-46a4-a9f9-298e53aa345a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36618659-82fa-4cd2-a65f-fadc936ca0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1cfce889-e39b-46a4-a9f9-298e53aa345a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36618659-82fa-4cd2-a65f-fadc936ca0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1cfce889-e39b-46a4-a9f9-298e53aa345a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d05da89-5500-4f03-a89a-956610e76a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:34 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-1cfce889-e39b-46a4-a9f9-298e53aa345a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Volume 866b9d6a-5695-41be-8f90-e751ce6ea289: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-866b9d6a-5695-41be-8f90-e751ce6ea289', 'volume_size': 1} Jul 30 17:07:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1cfce889-e39b-46a4-a9f9-298e53aa345a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:07:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1cfce889-e39b-46a4-a9f9-298e53aa345a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:07:34 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-1cfce889-e39b-46a4-a9f9-298e53aa345a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-102664336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=866b9d6a-5695-41be-8f90-e751ce6ea289,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98eac9e471ae4b4cbb93b235389c9e26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:07:35Z,use_quota=True,user_id='7b6f6e35c3394a858ec1cc5d6e14d167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:07:34 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-1cfce889-e39b-46a4-a9f9-298e53aa345a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Creating volume 866b9d6a-5695-41be-8f90-e751ce6ea289 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:07:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1cfce889-e39b-46a4-a9f9-298e53aa345a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:07:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1cfce889-e39b-46a4-a9f9-298e53aa345a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:07:34 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-1cfce889-e39b-46a4-a9f9-298e53aa345a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:07:34 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-1cfce889-e39b-46a4-a9f9-298e53aa345a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:07:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1cfce889-e39b-46a4-a9f9-298e53aa345a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:07:34 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-1cfce889-e39b-46a4-a9f9-298e53aa345a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:07:34 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-1cfce889-e39b-46a4-a9f9-298e53aa345a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:07:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1cfce889-e39b-46a4-a9f9-298e53aa345a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-866b9d6a-5695-41be-8f90-e751ce6ea289 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:34 devstack sudo[107148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-866b9d6a-5695-41be-8f90-e751ce6ea289 1073741824 Jul 30 17:07:34 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:34 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed9feb12-9346-41e0-b1d3-d9fd4129e75a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:07:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ed9feb12-9346-41e0-b1d3-d9fd4129e75a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Flow 'volume_create_manager' (11e9259f-0c09-4e39-bc60-fcb71c1edf76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:07:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ed9feb12-9346-41e0-b1d3-d9fd4129e75a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be93c3dc-0772-45b5-a81c-bdc458e616ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ed9feb12-9346-41e0-b1d3-d9fd4129e75a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be93c3dc-0772-45b5-a81c-bdc458e616ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:07:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1244247674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba0899c8-52be-477e-b718-6671ba3fb544,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98eac9e471ae4b4cbb93b235389c9e26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:07:35Z,use_quota=True,user_id='7b6f6e35c3394a858ec1cc5d6e14d167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ed9feb12-9346-41e0-b1d3-d9fd4129e75a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77fc80c7-69c4-466e-ae06-198575e829c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ed9feb12-9346-41e0-b1d3-d9fd4129e75a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77fc80c7-69c4-466e-ae06-198575e829c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ed9feb12-9346-41e0-b1d3-d9fd4129e75a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e13bfde5-eddc-4f7b-8e3e-4b21b5812530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ed9feb12-9346-41e0-b1d3-d9fd4129e75a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e13bfde5-eddc-4f7b-8e3e-4b21b5812530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba0899c8-52be-477e-b718-6671ba3fb544', 'volume_name': 'volume-ba0899c8-52be-477e-b718-6671ba3fb544', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ed9feb12-9346-41e0-b1d3-d9fd4129e75a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e928df4-ae95-4969-aae8-ca3b42b20360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ed9feb12-9346-41e0-b1d3-d9fd4129e75a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e928df4-ae95-4969-aae8-ca3b42b20360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ed9feb12-9346-41e0-b1d3-d9fd4129e75a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df7de3ae-2af7-477c-bc8a-7a9463fd76a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:35 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-ed9feb12-9346-41e0-b1d3-d9fd4129e75a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Volume ba0899c8-52be-477e-b718-6671ba3fb544: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba0899c8-52be-477e-b718-6671ba3fb544', 'volume_size': 1} Jul 30 17:07:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ed9feb12-9346-41e0-b1d3-d9fd4129e75a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:07:35 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1cfce889-e39b-46a4-a9f9-298e53aa345a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-866b9d6a-5695-41be-8f90-e751ce6ea289 1073741824" returned: 0 in 0.503s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1cfce889-e39b-46a4-a9f9-298e53aa345a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-866b9d6a-5695-41be-8f90-e751ce6ea289 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:35 devstack sudo[107154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-866b9d6a-5695-41be-8f90-e751ce6ea289 Jul 30 17:07:35 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:35 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-398dc2ee-458c-4d64-9fee-2891c5ae4c6a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:07:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-398dc2ee-458c-4d64-9fee-2891c5ae4c6a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Flow 'volume_create_manager' (c2ceb786-125c-4d73-bbf1-6440e7387649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:07:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-398dc2ee-458c-4d64-9fee-2891c5ae4c6a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b21a68-588e-4166-b774-099bcedf0b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-398dc2ee-458c-4d64-9fee-2891c5ae4c6a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b21a68-588e-4166-b774-099bcedf0b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:07:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1563426465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e2ef153-03f8-4927-8e2d-2b7541464710,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98eac9e471ae4b4cbb93b235389c9e26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:07:35Z,use_quota=True,user_id='7b6f6e35c3394a858ec1cc5d6e14d167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-398dc2ee-458c-4d64-9fee-2891c5ae4c6a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd7d8038-74d7-4b82-b23d-3551bbdf9820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-398dc2ee-458c-4d64-9fee-2891c5ae4c6a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd7d8038-74d7-4b82-b23d-3551bbdf9820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-398dc2ee-458c-4d64-9fee-2891c5ae4c6a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (228bcda7-71cc-49ab-b464-065dd3b15232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-398dc2ee-458c-4d64-9fee-2891c5ae4c6a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (228bcda7-71cc-49ab-b464-065dd3b15232) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e2ef153-03f8-4927-8e2d-2b7541464710', 'volume_name': 'volume-2e2ef153-03f8-4927-8e2d-2b7541464710', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-398dc2ee-458c-4d64-9fee-2891c5ae4c6a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c81fabd-fc93-41bf-b380-873fb5d755f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-398dc2ee-458c-4d64-9fee-2891c5ae4c6a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c81fabd-fc93-41bf-b380-873fb5d755f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-398dc2ee-458c-4d64-9fee-2891c5ae4c6a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a02f98c3-89a1-4777-bb88-dd8804ed2bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:35 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-398dc2ee-458c-4d64-9fee-2891c5ae4c6a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Volume 2e2ef153-03f8-4927-8e2d-2b7541464710: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e2ef153-03f8-4927-8e2d-2b7541464710', 'volume_size': 1} Jul 30 17:07:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-398dc2ee-458c-4d64-9fee-2891c5ae4c6a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:07:35 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1cfce889-e39b-46a4-a9f9-298e53aa345a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-866b9d6a-5695-41be-8f90-e751ce6ea289" returned: 0 in 0.276s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:35 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-1cfce889-e39b-46a4-a9f9-298e53aa345a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:07:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1cfce889-e39b-46a4-a9f9-298e53aa345a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:07:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ed9feb12-9346-41e0-b1d3-d9fd4129e75a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.464s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:07:35 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ed9feb12-9346-41e0-b1d3-d9fd4129e75a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:07:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1244247674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba0899c8-52be-477e-b718-6671ba3fb544,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98eac9e471ae4b4cbb93b235389c9e26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:07:35Z,use_quota=True,user_id='7b6f6e35c3394a858ec1cc5d6e14d167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:07:35 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-ed9feb12-9346-41e0-b1d3-d9fd4129e75a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Creating volume ba0899c8-52be-477e-b718-6671ba3fb544 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:07:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ed9feb12-9346-41e0-b1d3-d9fd4129e75a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:07:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ed9feb12-9346-41e0-b1d3-d9fd4129e75a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:07:35 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ed9feb12-9346-41e0-b1d3-d9fd4129e75a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:07:35 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ed9feb12-9346-41e0-b1d3-d9fd4129e75a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:07:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ed9feb12-9346-41e0-b1d3-d9fd4129e75a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:07:35 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ed9feb12-9346-41e0-b1d3-d9fd4129e75a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:07:35 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-ed9feb12-9346-41e0-b1d3-d9fd4129e75a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:07:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ed9feb12-9346-41e0-b1d3-d9fd4129e75a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba0899c8-52be-477e-b718-6671ba3fb544 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:35 devstack sudo[107157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba0899c8-52be-477e-b718-6671ba3fb544 1073741824 Jul 30 17:07:35 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1cfce889-e39b-46a4-a9f9-298e53aa345a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d05da89-5500-4f03-a89a-956610e76a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-866b9d6a-5695-41be-8f90-e751ce6ea289', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1cfce889-e39b-46a4-a9f9-298e53aa345a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48102acb-39ae-4e20-9dd1-35216a51803c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:35 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-1cfce889-e39b-46a4-a9f9-298e53aa345a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Volume volume-866b9d6a-5695-41be-8f90-e751ce6ea289 (866b9d6a-5695-41be-8f90-e751ce6ea289): created successfully Jul 30 17:07:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1cfce889-e39b-46a4-a9f9-298e53aa345a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48102acb-39ae-4e20-9dd1-35216a51803c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1cfce889-e39b-46a4-a9f9-298e53aa345a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Flow 'volume_create_manager' (77608afb-3104-41a2-ac52-9b47fdecd575) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:07:35 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-1cfce889-e39b-46a4-a9f9-298e53aa345a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Created volume successfully. Jul 30 17:07:35 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b042353-776f-4841-a152-2a2e404565a9 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:07:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1b042353-776f-4841-a152-2a2e404565a9 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Flow 'volume_create_manager' (9096844e-e69b-400d-9434-75ca2c0b727d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:07:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1b042353-776f-4841-a152-2a2e404565a9 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4b85870-3fd0-4426-8770-950439b530c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1b042353-776f-4841-a152-2a2e404565a9 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4b85870-3fd0-4426-8770-950439b530c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:07:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1636941581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8c65a11-6fe2-4fce-89c7-b9b7b5597aa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98eac9e471ae4b4cbb93b235389c9e26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:07:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:07:36Z,use_quota=True,user_id='7b6f6e35c3394a858ec1cc5d6e14d167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1b042353-776f-4841-a152-2a2e404565a9 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28670980-83ed-467e-b0a9-9d13037efd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1b042353-776f-4841-a152-2a2e404565a9 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28670980-83ed-467e-b0a9-9d13037efd69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1b042353-776f-4841-a152-2a2e404565a9 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a37d9a5b-1bcf-4b62-92b7-621b8b0f2274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1b042353-776f-4841-a152-2a2e404565a9 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a37d9a5b-1bcf-4b62-92b7-621b8b0f2274) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8c65a11-6fe2-4fce-89c7-b9b7b5597aa6', 'volume_name': 'volume-c8c65a11-6fe2-4fce-89c7-b9b7b5597aa6', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1b042353-776f-4841-a152-2a2e404565a9 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5985db2-dab5-43c7-ac9f-0720df268a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1b042353-776f-4841-a152-2a2e404565a9 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5985db2-dab5-43c7-ac9f-0720df268a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1b042353-776f-4841-a152-2a2e404565a9 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aeb9323-cdde-4f05-b25a-ae5a1e13ba2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:35 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-1b042353-776f-4841-a152-2a2e404565a9 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Volume c8c65a11-6fe2-4fce-89c7-b9b7b5597aa6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8c65a11-6fe2-4fce-89c7-b9b7b5597aa6', 'volume_size': 1} Jul 30 17:07:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1b042353-776f-4841-a152-2a2e404565a9 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:07:35 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ed9feb12-9346-41e0-b1d3-d9fd4129e75a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba0899c8-52be-477e-b718-6671ba3fb544 1073741824" returned: 0 in 0.451s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ed9feb12-9346-41e0-b1d3-d9fd4129e75a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba0899c8-52be-477e-b718-6671ba3fb544 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:35 devstack sudo[107163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba0899c8-52be-477e-b718-6671ba3fb544 Jul 30 17:07:35 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:36 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ed9feb12-9346-41e0-b1d3-d9fd4129e75a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba0899c8-52be-477e-b718-6671ba3fb544" returned: 0 in 0.295s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:36 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ed9feb12-9346-41e0-b1d3-d9fd4129e75a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:07:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ed9feb12-9346-41e0-b1d3-d9fd4129e75a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:07:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-398dc2ee-458c-4d64-9fee-2891c5ae4c6a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.885s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:07:36 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-398dc2ee-458c-4d64-9fee-2891c5ae4c6a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:07:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1563426465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e2ef153-03f8-4927-8e2d-2b7541464710,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98eac9e471ae4b4cbb93b235389c9e26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:07:35Z,use_quota=True,user_id='7b6f6e35c3394a858ec1cc5d6e14d167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:07:36 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-398dc2ee-458c-4d64-9fee-2891c5ae4c6a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Creating volume 2e2ef153-03f8-4927-8e2d-2b7541464710 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:07:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-398dc2ee-458c-4d64-9fee-2891c5ae4c6a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:07:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-398dc2ee-458c-4d64-9fee-2891c5ae4c6a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:07:36 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-398dc2ee-458c-4d64-9fee-2891c5ae4c6a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:07:36 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-398dc2ee-458c-4d64-9fee-2891c5ae4c6a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:07:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-398dc2ee-458c-4d64-9fee-2891c5ae4c6a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:07:36 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-398dc2ee-458c-4d64-9fee-2891c5ae4c6a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:07:36 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-398dc2ee-458c-4d64-9fee-2891c5ae4c6a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:07:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-398dc2ee-458c-4d64-9fee-2891c5ae4c6a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2e2ef153-03f8-4927-8e2d-2b7541464710 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:36 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2e2ef153-03f8-4927-8e2d-2b7541464710 1073741824 Jul 30 17:07:36 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:36 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ed9feb12-9346-41e0-b1d3-d9fd4129e75a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df7de3ae-2af7-477c-bc8a-7a9463fd76a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba0899c8-52be-477e-b718-6671ba3fb544', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:36 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ed9feb12-9346-41e0-b1d3-d9fd4129e75a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4111e0fa-a104-4d2c-9f0d-33ecb6ffecb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:36 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-ed9feb12-9346-41e0-b1d3-d9fd4129e75a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Volume volume-ba0899c8-52be-477e-b718-6671ba3fb544 (ba0899c8-52be-477e-b718-6671ba3fb544): created successfully Jul 30 17:07:36 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ed9feb12-9346-41e0-b1d3-d9fd4129e75a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4111e0fa-a104-4d2c-9f0d-33ecb6ffecb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:36 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ed9feb12-9346-41e0-b1d3-d9fd4129e75a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Flow 'volume_create_manager' (11e9259f-0c09-4e39-bc60-fcb71c1edf76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:07:36 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a7f49a1-60b3-4e25-8ac0-e811004554b6 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:07:36 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2a7f49a1-60b3-4e25-8ac0-e811004554b6 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Flow 'volume_create_manager' (5c1ba417-ea8d-4db4-892d-a5779c13e96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:07:36 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2a7f49a1-60b3-4e25-8ac0-e811004554b6 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (503fe492-0bbb-4225-b981-7fda7b05f93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:36 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-ed9feb12-9346-41e0-b1d3-d9fd4129e75a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Created volume successfully. Jul 30 17:07:36 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2a7f49a1-60b3-4e25-8ac0-e811004554b6 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (503fe492-0bbb-4225-b981-7fda7b05f93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-218104289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=946ecf4c-ffef-469f-a352-145580280942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98eac9e471ae4b4cbb93b235389c9e26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:07:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:07:36Z,use_quota=True,user_id='7b6f6e35c3394a858ec1cc5d6e14d167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:36 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2a7f49a1-60b3-4e25-8ac0-e811004554b6 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cc228bc-f565-4447-91fc-82a6bc7bc900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:36 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2a7f49a1-60b3-4e25-8ac0-e811004554b6 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cc228bc-f565-4447-91fc-82a6bc7bc900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:36 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2a7f49a1-60b3-4e25-8ac0-e811004554b6 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f437c31-f56b-4606-b7f9-b976892d793d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:36 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2a7f49a1-60b3-4e25-8ac0-e811004554b6 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f437c31-f56b-4606-b7f9-b976892d793d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '946ecf4c-ffef-469f-a352-145580280942', 'volume_name': 'volume-946ecf4c-ffef-469f-a352-145580280942', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:36 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2a7f49a1-60b3-4e25-8ac0-e811004554b6 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48f3c0f2-0934-4fc6-acf2-58ee1915aae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:36 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2a7f49a1-60b3-4e25-8ac0-e811004554b6 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48f3c0f2-0934-4fc6-acf2-58ee1915aae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:36 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2a7f49a1-60b3-4e25-8ac0-e811004554b6 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c794654f-b8e0-45b7-b988-151ffcaebfb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:36 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-2a7f49a1-60b3-4e25-8ac0-e811004554b6 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Volume 946ecf4c-ffef-469f-a352-145580280942: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-946ecf4c-ffef-469f-a352-145580280942', 'volume_size': 1} Jul 30 17:07:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2a7f49a1-60b3-4e25-8ac0-e811004554b6 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:07:36 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-398dc2ee-458c-4d64-9fee-2891c5ae4c6a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2e2ef153-03f8-4927-8e2d-2b7541464710 1073741824" returned: 0 in 0.422s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-398dc2ee-458c-4d64-9fee-2891c5ae4c6a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2e2ef153-03f8-4927-8e2d-2b7541464710 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:36 devstack sudo[107171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2e2ef153-03f8-4927-8e2d-2b7541464710 Jul 30 17:07:36 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:36 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-398dc2ee-458c-4d64-9fee-2891c5ae4c6a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2e2ef153-03f8-4927-8e2d-2b7541464710" returned: 0 in 0.244s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:36 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-398dc2ee-458c-4d64-9fee-2891c5ae4c6a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:07:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-398dc2ee-458c-4d64-9fee-2891c5ae4c6a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:07:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1b042353-776f-4841-a152-2a2e404565a9 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.201s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:07:36 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-1b042353-776f-4841-a152-2a2e404565a9 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:07:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1636941581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8c65a11-6fe2-4fce-89c7-b9b7b5597aa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98eac9e471ae4b4cbb93b235389c9e26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:07:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:07:36Z,use_quota=True,user_id='7b6f6e35c3394a858ec1cc5d6e14d167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:07:36 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-1b042353-776f-4841-a152-2a2e404565a9 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Creating volume c8c65a11-6fe2-4fce-89c7-b9b7b5597aa6 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:07:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1b042353-776f-4841-a152-2a2e404565a9 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:07:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1b042353-776f-4841-a152-2a2e404565a9 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:07:36 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-1b042353-776f-4841-a152-2a2e404565a9 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:07:36 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-1b042353-776f-4841-a152-2a2e404565a9 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:07:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1b042353-776f-4841-a152-2a2e404565a9 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:07:36 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-1b042353-776f-4841-a152-2a2e404565a9 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:07:36 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-1b042353-776f-4841-a152-2a2e404565a9 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:07:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1b042353-776f-4841-a152-2a2e404565a9 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c8c65a11-6fe2-4fce-89c7-b9b7b5597aa6 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:37 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-398dc2ee-458c-4d64-9fee-2891c5ae4c6a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a02f98c3-89a1-4777-bb88-dd8804ed2bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e2ef153-03f8-4927-8e2d-2b7541464710', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:37 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-398dc2ee-458c-4d64-9fee-2891c5ae4c6a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6e439c1-bdb3-40c5-8b05-9c6a1910b7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:37 devstack sudo[107174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c8c65a11-6fe2-4fce-89c7-b9b7b5597aa6 1073741824 Jul 30 17:07:37 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:37 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-398dc2ee-458c-4d64-9fee-2891c5ae4c6a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Volume volume-2e2ef153-03f8-4927-8e2d-2b7541464710 (2e2ef153-03f8-4927-8e2d-2b7541464710): created successfully Jul 30 17:07:37 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-398dc2ee-458c-4d64-9fee-2891c5ae4c6a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6e439c1-bdb3-40c5-8b05-9c6a1910b7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:37 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-398dc2ee-458c-4d64-9fee-2891c5ae4c6a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Flow 'volume_create_manager' (c2ceb786-125c-4d73-bbf1-6440e7387649) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:07:37 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-398dc2ee-458c-4d64-9fee-2891c5ae4c6a tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Created volume successfully. Jul 30 17:07:37 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1b042353-776f-4841-a152-2a2e404565a9 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c8c65a11-6fe2-4fce-89c7-b9b7b5597aa6 1073741824" returned: 0 in 0.461s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1b042353-776f-4841-a152-2a2e404565a9 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c8c65a11-6fe2-4fce-89c7-b9b7b5597aa6 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:37 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c8c65a11-6fe2-4fce-89c7-b9b7b5597aa6 Jul 30 17:07:37 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:37 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1b042353-776f-4841-a152-2a2e404565a9 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c8c65a11-6fe2-4fce-89c7-b9b7b5597aa6" returned: 0 in 0.257s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:37 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-1b042353-776f-4841-a152-2a2e404565a9 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:07:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1b042353-776f-4841-a152-2a2e404565a9 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:07:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2a7f49a1-60b3-4e25-8ac0-e811004554b6 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.316s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:07:37 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-2a7f49a1-60b3-4e25-8ac0-e811004554b6 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-218104289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=946ecf4c-ffef-469f-a352-145580280942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98eac9e471ae4b4cbb93b235389c9e26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:07:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:07:36Z,use_quota=True,user_id='7b6f6e35c3394a858ec1cc5d6e14d167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:07:37 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-2a7f49a1-60b3-4e25-8ac0-e811004554b6 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Creating volume 946ecf4c-ffef-469f-a352-145580280942 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:07:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2a7f49a1-60b3-4e25-8ac0-e811004554b6 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:07:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2a7f49a1-60b3-4e25-8ac0-e811004554b6 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:07:37 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-2a7f49a1-60b3-4e25-8ac0-e811004554b6 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:07:37 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-2a7f49a1-60b3-4e25-8ac0-e811004554b6 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:07:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2a7f49a1-60b3-4e25-8ac0-e811004554b6 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:07:37 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-2a7f49a1-60b3-4e25-8ac0-e811004554b6 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:07:37 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-2a7f49a1-60b3-4e25-8ac0-e811004554b6 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:07:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2a7f49a1-60b3-4e25-8ac0-e811004554b6 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-946ecf4c-ffef-469f-a352-145580280942 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:37 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1b042353-776f-4841-a152-2a2e404565a9 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aeb9323-cdde-4f05-b25a-ae5a1e13ba2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8c65a11-6fe2-4fce-89c7-b9b7b5597aa6', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:37 devstack sudo[107183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-946ecf4c-ffef-469f-a352-145580280942 1073741824 Jul 30 17:07:37 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:37 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1b042353-776f-4841-a152-2a2e404565a9 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bbef3e5-56a3-43d0-b6b3-ef5ce1ce9862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:37 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-1b042353-776f-4841-a152-2a2e404565a9 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Volume volume-c8c65a11-6fe2-4fce-89c7-b9b7b5597aa6 (c8c65a11-6fe2-4fce-89c7-b9b7b5597aa6): created successfully Jul 30 17:07:37 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1b042353-776f-4841-a152-2a2e404565a9 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bbef3e5-56a3-43d0-b6b3-ef5ce1ce9862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:37 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1b042353-776f-4841-a152-2a2e404565a9 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Flow 'volume_create_manager' (9096844e-e69b-400d-9434-75ca2c0b727d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:07:37 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-1b042353-776f-4841-a152-2a2e404565a9 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Created volume successfully. Jul 30 17:07:38 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2a7f49a1-60b3-4e25-8ac0-e811004554b6 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-946ecf4c-ffef-469f-a352-145580280942 1073741824" returned: 0 in 0.442s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2a7f49a1-60b3-4e25-8ac0-e811004554b6 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-946ecf4c-ffef-469f-a352-145580280942 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:38 devstack sudo[107189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-946ecf4c-ffef-469f-a352-145580280942 Jul 30 17:07:38 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:38 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2a7f49a1-60b3-4e25-8ac0-e811004554b6 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-946ecf4c-ffef-469f-a352-145580280942" returned: 0 in 0.249s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:38 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-2a7f49a1-60b3-4e25-8ac0-e811004554b6 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:07:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2a7f49a1-60b3-4e25-8ac0-e811004554b6 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:07:38 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2a7f49a1-60b3-4e25-8ac0-e811004554b6 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c794654f-b8e0-45b7-b988-151ffcaebfb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-946ecf4c-ffef-469f-a352-145580280942', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:38 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2a7f49a1-60b3-4e25-8ac0-e811004554b6 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb12b6f5-36e7-4813-8560-bce0110b8b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:38 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-2a7f49a1-60b3-4e25-8ac0-e811004554b6 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Volume volume-946ecf4c-ffef-469f-a352-145580280942 (946ecf4c-ffef-469f-a352-145580280942): created successfully Jul 30 17:07:38 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2a7f49a1-60b3-4e25-8ac0-e811004554b6 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb12b6f5-36e7-4813-8560-bce0110b8b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:38 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2a7f49a1-60b3-4e25-8ac0-e811004554b6 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Flow 'volume_create_manager' (5c1ba417-ea8d-4db4-892d-a5779c13e96a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:07:38 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-2a7f49a1-60b3-4e25-8ac0-e811004554b6 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Created volume successfully. Jul 30 17:07:39 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-2ded7318-59d3-43cf-bc99-41d4c853deb6 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Acquiring lock "cinder-946ecf4c-ffef-469f-a352-145580280942-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:07:39 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-2ded7318-59d3-43cf-bc99-41d4c853deb6 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "cinder-946ecf4c-ffef-469f-a352-145580280942-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:07:39 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-2ded7318-59d3-43cf-bc99-41d4c853deb6 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Acquiring lock "cinder-quobyte-946ecf4c-ffef-469f-a352-145580280942" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:07:39 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-2ded7318-59d3-43cf-bc99-41d4c853deb6 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "cinder-quobyte-946ecf4c-ffef-469f-a352-145580280942" acquired by "delete_volume" :: waited 0.015s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:07:39 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ef6ca9-a1bd-4e1a-8eb4-7e7ca608a658]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:07:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2ded7318-59d3-43cf-bc99-41d4c853deb6 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-946ecf4c-ffef-469f-a352-145580280942 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:39 devstack sudo[107192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-946ecf4c-ffef-469f-a352-145580280942 Jul 30 17:07:39 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:40 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2ded7318-59d3-43cf-bc99-41d4c853deb6 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-946ecf4c-ffef-469f-a352-145580280942" returned: 0 in 0.360s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2ded7318-59d3-43cf-bc99-41d4c853deb6 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-946ecf4c-ffef-469f-a352-145580280942 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:40 devstack sudo[107197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-946ecf4c-ffef-469f-a352-145580280942 Jul 30 17:07:40 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:40 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2ded7318-59d3-43cf-bc99-41d4c853deb6 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-946ecf4c-ffef-469f-a352-145580280942" returned: 0 in 0.250s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:40 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-2ded7318-59d3-43cf-bc99-41d4c853deb6 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "cinder-quobyte-946ecf4c-ffef-469f-a352-145580280942" released by "delete_volume" :: held 0.649s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:07:40 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-2ded7318-59d3-43cf-bc99-41d4c853deb6 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Created reservations ['eb4ac04f-d7a3-43b3-b083-6d4d688c3918', 'e92cd77f-e2f8-4b78-92dd-836b441d4dee', 'c38ce8a4-c114-46bd-92cc-4342ddb951a5', '4da7eee0-1781-42c6-83d2-f6f6db555b1e'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:07:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2ded7318-59d3-43cf-bc99-41d4c853deb6 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:07:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2ded7318-59d3-43cf-bc99-41d4c853deb6 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:07:40 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-2ded7318-59d3-43cf-bc99-41d4c853deb6 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:07:40 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-2ded7318-59d3-43cf-bc99-41d4c853deb6 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:07:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2ded7318-59d3-43cf-bc99-41d4c853deb6 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:07:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2ded7318-59d3-43cf-bc99-41d4c853deb6 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:40 devstack sudo[107200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:07:40 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:40 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2ded7318-59d3-43cf-bc99-41d4c853deb6 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.244s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:40 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-2ded7318-59d3-43cf-bc99-41d4c853deb6 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:07:40 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-2ded7318-59d3-43cf-bc99-41d4c853deb6 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Deleted volume successfully. Jul 30 17:07:40 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-2ded7318-59d3-43cf-bc99-41d4c853deb6 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "cinder-946ecf4c-ffef-469f-a352-145580280942-delete_volume" released by "delete_volume" :: held 1.091s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:07:40 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-714cc8ce-d515-4d31-82f6-5dbbbffc7ca7 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Acquiring lock "cinder-c8c65a11-6fe2-4fce-89c7-b9b7b5597aa6-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:07:40 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-714cc8ce-d515-4d31-82f6-5dbbbffc7ca7 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "cinder-c8c65a11-6fe2-4fce-89c7-b9b7b5597aa6-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:07:40 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-714cc8ce-d515-4d31-82f6-5dbbbffc7ca7 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Acquiring lock "cinder-quobyte-c8c65a11-6fe2-4fce-89c7-b9b7b5597aa6" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:07:40 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-714cc8ce-d515-4d31-82f6-5dbbbffc7ca7 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "cinder-quobyte-c8c65a11-6fe2-4fce-89c7-b9b7b5597aa6" acquired by "delete_volume" :: waited 0.015s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:07:40 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1edf99ab-bb24-4d4c-b40a-31df4b4cf2f2]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:07:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-714cc8ce-d515-4d31-82f6-5dbbbffc7ca7 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c8c65a11-6fe2-4fce-89c7-b9b7b5597aa6 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:41 devstack sudo[107203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c8c65a11-6fe2-4fce-89c7-b9b7b5597aa6 Jul 30 17:07:41 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:41 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-714cc8ce-d515-4d31-82f6-5dbbbffc7ca7 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c8c65a11-6fe2-4fce-89c7-b9b7b5597aa6" returned: 0 in 0.357s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-714cc8ce-d515-4d31-82f6-5dbbbffc7ca7 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c8c65a11-6fe2-4fce-89c7-b9b7b5597aa6 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:41 devstack sudo[107208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c8c65a11-6fe2-4fce-89c7-b9b7b5597aa6 Jul 30 17:07:41 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:41 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-714cc8ce-d515-4d31-82f6-5dbbbffc7ca7 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c8c65a11-6fe2-4fce-89c7-b9b7b5597aa6" returned: 0 in 0.239s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:41 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-714cc8ce-d515-4d31-82f6-5dbbbffc7ca7 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "cinder-quobyte-c8c65a11-6fe2-4fce-89c7-b9b7b5597aa6" released by "delete_volume" :: held 0.634s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:07:41 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-714cc8ce-d515-4d31-82f6-5dbbbffc7ca7 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Created reservations ['a153f13a-0ebe-42e7-81bf-06444bb3280b', '439ce60f-81ed-456f-aa42-ce74014a3a9e', '684af737-e64c-44cb-aec1-5af3774953b1', '8aea4a1b-0db7-45f8-9241-f7efabad7966'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:07:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-714cc8ce-d515-4d31-82f6-5dbbbffc7ca7 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:07:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-714cc8ce-d515-4d31-82f6-5dbbbffc7ca7 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:07:41 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-714cc8ce-d515-4d31-82f6-5dbbbffc7ca7 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:07:41 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-714cc8ce-d515-4d31-82f6-5dbbbffc7ca7 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:07:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-714cc8ce-d515-4d31-82f6-5dbbbffc7ca7 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:07:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-714cc8ce-d515-4d31-82f6-5dbbbffc7ca7 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:41 devstack sudo[107211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:07:41 devstack sudo[107211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:41 devstack sudo[107211]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-714cc8ce-d515-4d31-82f6-5dbbbffc7ca7 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.234s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:41 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-714cc8ce-d515-4d31-82f6-5dbbbffc7ca7 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:07:41 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-714cc8ce-d515-4d31-82f6-5dbbbffc7ca7 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Deleted volume successfully. Jul 30 17:07:41 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-714cc8ce-d515-4d31-82f6-5dbbbffc7ca7 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "cinder-c8c65a11-6fe2-4fce-89c7-b9b7b5597aa6-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:07:41 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-59854f58-8eb7-45a1-92b8-e69cc1b4c374 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Acquiring lock "cinder-2e2ef153-03f8-4927-8e2d-2b7541464710-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:07:41 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-59854f58-8eb7-45a1-92b8-e69cc1b4c374 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "cinder-2e2ef153-03f8-4927-8e2d-2b7541464710-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:07:42 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-59854f58-8eb7-45a1-92b8-e69cc1b4c374 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Acquiring lock "cinder-quobyte-2e2ef153-03f8-4927-8e2d-2b7541464710" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:07:42 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-59854f58-8eb7-45a1-92b8-e69cc1b4c374 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "cinder-quobyte-2e2ef153-03f8-4927-8e2d-2b7541464710" acquired by "delete_volume" :: waited 0.020s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:07:42 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a927384e-1d8c-43ac-935c-30422e958404]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:07:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-59854f58-8eb7-45a1-92b8-e69cc1b4c374 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2e2ef153-03f8-4927-8e2d-2b7541464710 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:42 devstack sudo[107214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2e2ef153-03f8-4927-8e2d-2b7541464710 Jul 30 17:07:42 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:42 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-59854f58-8eb7-45a1-92b8-e69cc1b4c374 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2e2ef153-03f8-4927-8e2d-2b7541464710" returned: 0 in 0.364s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-59854f58-8eb7-45a1-92b8-e69cc1b4c374 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2e2ef153-03f8-4927-8e2d-2b7541464710 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:42 devstack sudo[107220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2e2ef153-03f8-4927-8e2d-2b7541464710 Jul 30 17:07:42 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:42 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-59854f58-8eb7-45a1-92b8-e69cc1b4c374 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2e2ef153-03f8-4927-8e2d-2b7541464710" returned: 0 in 0.261s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:42 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-59854f58-8eb7-45a1-92b8-e69cc1b4c374 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "cinder-quobyte-2e2ef153-03f8-4927-8e2d-2b7541464710" released by "delete_volume" :: held 0.667s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:07:42 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-59854f58-8eb7-45a1-92b8-e69cc1b4c374 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Created reservations ['8a50f462-2eae-40c8-bd05-a9d2fc248d04', '1cbfac64-36a8-4e44-9da6-6416379ad7fb', 'b48b2f4f-5b7e-4780-8737-3ab3a2f3725a', '13b1376d-a6a7-4de2-ae9e-826372949437'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:07:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-59854f58-8eb7-45a1-92b8-e69cc1b4c374 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:07:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-59854f58-8eb7-45a1-92b8-e69cc1b4c374 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:07:42 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-59854f58-8eb7-45a1-92b8-e69cc1b4c374 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:07:42 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-59854f58-8eb7-45a1-92b8-e69cc1b4c374 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:07:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-59854f58-8eb7-45a1-92b8-e69cc1b4c374 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:07:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-59854f58-8eb7-45a1-92b8-e69cc1b4c374 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:42 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:07:42 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:43 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-59854f58-8eb7-45a1-92b8-e69cc1b4c374 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.250s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:43 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-59854f58-8eb7-45a1-92b8-e69cc1b4c374 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:07:43 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-59854f58-8eb7-45a1-92b8-e69cc1b4c374 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Deleted volume successfully. Jul 30 17:07:43 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-59854f58-8eb7-45a1-92b8-e69cc1b4c374 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "cinder-2e2ef153-03f8-4927-8e2d-2b7541464710-delete_volume" released by "delete_volume" :: held 1.115s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:07:43 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ddd69d19-e9ce-4492-b455-deeb8237ccfd tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Acquiring lock "cinder-ba0899c8-52be-477e-b718-6671ba3fb544-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:07:43 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ddd69d19-e9ce-4492-b455-deeb8237ccfd tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "cinder-ba0899c8-52be-477e-b718-6671ba3fb544-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:07:43 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ddd69d19-e9ce-4492-b455-deeb8237ccfd tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Acquiring lock "cinder-quobyte-ba0899c8-52be-477e-b718-6671ba3fb544" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:07:43 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ddd69d19-e9ce-4492-b455-deeb8237ccfd tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "cinder-quobyte-ba0899c8-52be-477e-b718-6671ba3fb544" acquired by "delete_volume" :: waited 0.014s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:07:43 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[40bd6a71-e6cf-418d-9b40-800f912e6f18]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:07:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ddd69d19-e9ce-4492-b455-deeb8237ccfd tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba0899c8-52be-477e-b718-6671ba3fb544 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:43 devstack sudo[107226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba0899c8-52be-477e-b718-6671ba3fb544 Jul 30 17:07:43 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:43 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ddd69d19-e9ce-4492-b455-deeb8237ccfd tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba0899c8-52be-477e-b718-6671ba3fb544" returned: 0 in 0.344s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ddd69d19-e9ce-4492-b455-deeb8237ccfd tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba0899c8-52be-477e-b718-6671ba3fb544 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:43 devstack sudo[107231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba0899c8-52be-477e-b718-6671ba3fb544 Jul 30 17:07:43 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:43 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ddd69d19-e9ce-4492-b455-deeb8237ccfd tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ba0899c8-52be-477e-b718-6671ba3fb544" returned: 0 in 0.241s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:43 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ddd69d19-e9ce-4492-b455-deeb8237ccfd tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "cinder-quobyte-ba0899c8-52be-477e-b718-6671ba3fb544" released by "delete_volume" :: held 0.620s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:07:43 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-ddd69d19-e9ce-4492-b455-deeb8237ccfd tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Created reservations ['ef44f738-b840-482d-b2ce-1dbfecee1f37', 'c2ed8cc1-3450-493b-b218-c244d4f76a98', 'a25c5df7-da2f-4979-a4bc-a1d5ebb70e14', '63da0799-129c-4739-969a-aafa0b1297fe'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:07:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ddd69d19-e9ce-4492-b455-deeb8237ccfd tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:07:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ddd69d19-e9ce-4492-b455-deeb8237ccfd tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:07:43 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ddd69d19-e9ce-4492-b455-deeb8237ccfd tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:07:43 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ddd69d19-e9ce-4492-b455-deeb8237ccfd tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:07:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ddd69d19-e9ce-4492-b455-deeb8237ccfd tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:07:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ddd69d19-e9ce-4492-b455-deeb8237ccfd tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:43 devstack sudo[107234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:07:43 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:44 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ddd69d19-e9ce-4492-b455-deeb8237ccfd tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.243s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:44 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-ddd69d19-e9ce-4492-b455-deeb8237ccfd tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:07:44 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-ddd69d19-e9ce-4492-b455-deeb8237ccfd tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Deleted volume successfully. Jul 30 17:07:44 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ddd69d19-e9ce-4492-b455-deeb8237ccfd tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "cinder-ba0899c8-52be-477e-b718-6671ba3fb544-delete_volume" released by "delete_volume" :: held 1.050s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:07:44 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-8826bcd1-fc55-4eb3-a386-c8ed95a57670 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Acquiring lock "cinder-866b9d6a-5695-41be-8f90-e751ce6ea289-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:07:44 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-8826bcd1-fc55-4eb3-a386-c8ed95a57670 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "cinder-866b9d6a-5695-41be-8f90-e751ce6ea289-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:07:44 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-8826bcd1-fc55-4eb3-a386-c8ed95a57670 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Acquiring lock "cinder-quobyte-866b9d6a-5695-41be-8f90-e751ce6ea289" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:07:44 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-8826bcd1-fc55-4eb3-a386-c8ed95a57670 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "cinder-quobyte-866b9d6a-5695-41be-8f90-e751ce6ea289" acquired by "delete_volume" :: waited 0.019s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:07:44 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f738ae-0aaa-4827-a226-eddbde0c66f1]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:07:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8826bcd1-fc55-4eb3-a386-c8ed95a57670 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-866b9d6a-5695-41be-8f90-e751ce6ea289 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:44 devstack sudo[107237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-866b9d6a-5695-41be-8f90-e751ce6ea289 Jul 30 17:07:44 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:44 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8826bcd1-fc55-4eb3-a386-c8ed95a57670 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-866b9d6a-5695-41be-8f90-e751ce6ea289" returned: 0 in 0.345s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8826bcd1-fc55-4eb3-a386-c8ed95a57670 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-866b9d6a-5695-41be-8f90-e751ce6ea289 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:44 devstack sudo[107242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-866b9d6a-5695-41be-8f90-e751ce6ea289 Jul 30 17:07:44 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:44 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8826bcd1-fc55-4eb3-a386-c8ed95a57670 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-866b9d6a-5695-41be-8f90-e751ce6ea289" returned: 0 in 0.241s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:44 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-8826bcd1-fc55-4eb3-a386-c8ed95a57670 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "cinder-quobyte-866b9d6a-5695-41be-8f90-e751ce6ea289" released by "delete_volume" :: held 0.623s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:07:45 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-8826bcd1-fc55-4eb3-a386-c8ed95a57670 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Created reservations ['e39d52ce-e3d2-4f39-b631-c42220e94b09', '104447b7-ff0b-437b-86d4-c0772ed7a7b3', '409d8b43-1237-4c57-b0cb-e249bf12a4ce', '7ee73aad-0627-4924-8366-a9bc3bd39cb9'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:07:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8826bcd1-fc55-4eb3-a386-c8ed95a57670 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:07:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8826bcd1-fc55-4eb3-a386-c8ed95a57670 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:07:45 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-8826bcd1-fc55-4eb3-a386-c8ed95a57670 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:07:45 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-8826bcd1-fc55-4eb3-a386-c8ed95a57670 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:07:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8826bcd1-fc55-4eb3-a386-c8ed95a57670 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:07:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8826bcd1-fc55-4eb3-a386-c8ed95a57670 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:45 devstack sudo[107245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:07:45 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:45 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8826bcd1-fc55-4eb3-a386-c8ed95a57670 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.240s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:45 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-8826bcd1-fc55-4eb3-a386-c8ed95a57670 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:07:45 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-8826bcd1-fc55-4eb3-a386-c8ed95a57670 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Deleted volume successfully. Jul 30 17:07:45 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-8826bcd1-fc55-4eb3-a386-c8ed95a57670 tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "cinder-866b9d6a-5695-41be-8f90-e751ce6ea289-delete_volume" released by "delete_volume" :: held 1.058s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:07:45 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-5bbea62b-4e66-441a-a727-1f1a9fb9798f tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Acquiring lock "cinder-cc13bcb6-a51e-44ef-a723-16622db85a2f-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:07:45 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-5bbea62b-4e66-441a-a727-1f1a9fb9798f tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "cinder-cc13bcb6-a51e-44ef-a723-16622db85a2f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:07:45 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-5bbea62b-4e66-441a-a727-1f1a9fb9798f tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Acquiring lock "cinder-quobyte-cc13bcb6-a51e-44ef-a723-16622db85a2f" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:07:45 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-5bbea62b-4e66-441a-a727-1f1a9fb9798f tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "cinder-quobyte-cc13bcb6-a51e-44ef-a723-16622db85a2f" acquired by "delete_volume" :: waited 0.013s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:07:45 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[6874e039-c634-4ee2-9d5b-6fc2af8f5191]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:07:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5bbea62b-4e66-441a-a727-1f1a9fb9798f tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-cc13bcb6-a51e-44ef-a723-16622db85a2f {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:45 devstack sudo[107248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-cc13bcb6-a51e-44ef-a723-16622db85a2f Jul 30 17:07:45 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:45 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5bbea62b-4e66-441a-a727-1f1a9fb9798f tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-cc13bcb6-a51e-44ef-a723-16622db85a2f" returned: 0 in 0.344s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5bbea62b-4e66-441a-a727-1f1a9fb9798f tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-cc13bcb6-a51e-44ef-a723-16622db85a2f {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:45 devstack sudo[107253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-cc13bcb6-a51e-44ef-a723-16622db85a2f Jul 30 17:07:45 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:46 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5bbea62b-4e66-441a-a727-1f1a9fb9798f tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-cc13bcb6-a51e-44ef-a723-16622db85a2f" returned: 0 in 0.236s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:46 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-5bbea62b-4e66-441a-a727-1f1a9fb9798f tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "cinder-quobyte-cc13bcb6-a51e-44ef-a723-16622db85a2f" released by "delete_volume" :: held 0.615s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:07:46 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-5bbea62b-4e66-441a-a727-1f1a9fb9798f tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Created reservations ['e8b6eff4-e41e-4f1b-9956-65515b938741', 'ee5bae1d-82fe-42df-88d9-6693083dc3ac', 'e219d33e-6e01-4fe2-9342-9ba30c631634', '1b86f17f-2861-4d8b-bd8e-17fe3008d985'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:07:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5bbea62b-4e66-441a-a727-1f1a9fb9798f tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:07:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5bbea62b-4e66-441a-a727-1f1a9fb9798f tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:07:46 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-5bbea62b-4e66-441a-a727-1f1a9fb9798f tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:07:46 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-5bbea62b-4e66-441a-a727-1f1a9fb9798f tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:07:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5bbea62b-4e66-441a-a727-1f1a9fb9798f tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:07:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5bbea62b-4e66-441a-a727-1f1a9fb9798f tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:46 devstack sudo[107256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:07:46 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:46 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5bbea62b-4e66-441a-a727-1f1a9fb9798f tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.243s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:46 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-5bbea62b-4e66-441a-a727-1f1a9fb9798f tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:07:46 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-5bbea62b-4e66-441a-a727-1f1a9fb9798f tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Deleted volume successfully. Jul 30 17:07:46 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-5bbea62b-4e66-441a-a727-1f1a9fb9798f tempest-CreateVolumesFromSourceVolumeTest-1657399418 None] Lock "cinder-cc13bcb6-a51e-44ef-a723-16622db85a2f-delete_volume" released by "delete_volume" :: held 1.045s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:07:49 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b7daaaf-35d1-40ae-951c-40bd9072e291 tempest-ProjectReaderTests-745022491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:07:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8b7daaaf-35d1-40ae-951c-40bd9072e291 tempest-ProjectReaderTests-745022491 None] Flow 'volume_create_manager' (dfd5c6f0-2e92-49a0-ac16-91b0e9a19fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:07:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8b7daaaf-35d1-40ae-951c-40bd9072e291 tempest-ProjectReaderTests-745022491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05b578a1-cff0-46ad-b18b-4849b9ea2b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8b7daaaf-35d1-40ae-951c-40bd9072e291 tempest-ProjectReaderTests-745022491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05b578a1-cff0-46ad-b18b-4849b9ea2b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-161607298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f1350cd-013b-4c37-8788-5407806b3ac4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21e6ba74091c4d2ba656af7c148514b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:07:50Z,use_quota=True,user_id='360522e27ad4471faae5c2747b88b70e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8b7daaaf-35d1-40ae-951c-40bd9072e291 tempest-ProjectReaderTests-745022491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98025506-0343-41ef-b9cc-10fd88edc305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8b7daaaf-35d1-40ae-951c-40bd9072e291 tempest-ProjectReaderTests-745022491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98025506-0343-41ef-b9cc-10fd88edc305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8b7daaaf-35d1-40ae-951c-40bd9072e291 tempest-ProjectReaderTests-745022491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcf4af46-a7a0-40b6-a3c8-4b2445c5e3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8b7daaaf-35d1-40ae-951c-40bd9072e291 tempest-ProjectReaderTests-745022491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcf4af46-a7a0-40b6-a3c8-4b2445c5e3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f1350cd-013b-4c37-8788-5407806b3ac4', 'volume_name': 'volume-5f1350cd-013b-4c37-8788-5407806b3ac4', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8b7daaaf-35d1-40ae-951c-40bd9072e291 tempest-ProjectReaderTests-745022491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f54ca0fe-4294-4018-b2e9-4232d5f2e8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8b7daaaf-35d1-40ae-951c-40bd9072e291 tempest-ProjectReaderTests-745022491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f54ca0fe-4294-4018-b2e9-4232d5f2e8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8b7daaaf-35d1-40ae-951c-40bd9072e291 tempest-ProjectReaderTests-745022491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51aed4e3-87f5-4046-af3c-8eaf302502bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:49 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-8b7daaaf-35d1-40ae-951c-40bd9072e291 tempest-ProjectReaderTests-745022491 None] Volume 5f1350cd-013b-4c37-8788-5407806b3ac4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f1350cd-013b-4c37-8788-5407806b3ac4', 'volume_size': 1} Jul 30 17:07:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8b7daaaf-35d1-40ae-951c-40bd9072e291 tempest-ProjectReaderTests-745022491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:07:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8b7daaaf-35d1-40ae-951c-40bd9072e291 tempest-ProjectReaderTests-745022491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:07:49 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-8b7daaaf-35d1-40ae-951c-40bd9072e291 tempest-ProjectReaderTests-745022491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-161607298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f1350cd-013b-4c37-8788-5407806b3ac4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21e6ba74091c4d2ba656af7c148514b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:07:50Z,use_quota=True,user_id='360522e27ad4471faae5c2747b88b70e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:07:49 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-8b7daaaf-35d1-40ae-951c-40bd9072e291 tempest-ProjectReaderTests-745022491 None] Creating volume 5f1350cd-013b-4c37-8788-5407806b3ac4 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:07:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8b7daaaf-35d1-40ae-951c-40bd9072e291 tempest-ProjectReaderTests-745022491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:07:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8b7daaaf-35d1-40ae-951c-40bd9072e291 tempest-ProjectReaderTests-745022491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:07:49 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-8b7daaaf-35d1-40ae-951c-40bd9072e291 tempest-ProjectReaderTests-745022491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:07:49 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-8b7daaaf-35d1-40ae-951c-40bd9072e291 tempest-ProjectReaderTests-745022491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:07:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8b7daaaf-35d1-40ae-951c-40bd9072e291 tempest-ProjectReaderTests-745022491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:07:49 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-8b7daaaf-35d1-40ae-951c-40bd9072e291 tempest-ProjectReaderTests-745022491 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:07:49 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-8b7daaaf-35d1-40ae-951c-40bd9072e291 tempest-ProjectReaderTests-745022491 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:07:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8b7daaaf-35d1-40ae-951c-40bd9072e291 tempest-ProjectReaderTests-745022491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5f1350cd-013b-4c37-8788-5407806b3ac4 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:49 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5f1350cd-013b-4c37-8788-5407806b3ac4 1073741824 Jul 30 17:07:49 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:50 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8b7daaaf-35d1-40ae-951c-40bd9072e291 tempest-ProjectReaderTests-745022491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5f1350cd-013b-4c37-8788-5407806b3ac4 1073741824" returned: 0 in 0.420s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8b7daaaf-35d1-40ae-951c-40bd9072e291 tempest-ProjectReaderTests-745022491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5f1350cd-013b-4c37-8788-5407806b3ac4 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:50 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5f1350cd-013b-4c37-8788-5407806b3ac4 Jul 30 17:07:50 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:50 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8b7daaaf-35d1-40ae-951c-40bd9072e291 tempest-ProjectReaderTests-745022491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5f1350cd-013b-4c37-8788-5407806b3ac4" returned: 0 in 0.256s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:50 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-8b7daaaf-35d1-40ae-951c-40bd9072e291 tempest-ProjectReaderTests-745022491 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:07:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8b7daaaf-35d1-40ae-951c-40bd9072e291 tempest-ProjectReaderTests-745022491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:07:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8b7daaaf-35d1-40ae-951c-40bd9072e291 tempest-ProjectReaderTests-745022491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51aed4e3-87f5-4046-af3c-8eaf302502bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f1350cd-013b-4c37-8788-5407806b3ac4', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8b7daaaf-35d1-40ae-951c-40bd9072e291 tempest-ProjectReaderTests-745022491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3119a083-e38d-4f6d-92a6-6477d635aa9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:50 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-8b7daaaf-35d1-40ae-951c-40bd9072e291 tempest-ProjectReaderTests-745022491 None] Volume volume-5f1350cd-013b-4c37-8788-5407806b3ac4 (5f1350cd-013b-4c37-8788-5407806b3ac4): created successfully Jul 30 17:07:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8b7daaaf-35d1-40ae-951c-40bd9072e291 tempest-ProjectReaderTests-745022491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3119a083-e38d-4f6d-92a6-6477d635aa9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8b7daaaf-35d1-40ae-951c-40bd9072e291 tempest-ProjectReaderTests-745022491 None] Flow 'volume_create_manager' (dfd5c6f0-2e92-49a0-ac16-91b0e9a19fe1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:07:50 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-8b7daaaf-35d1-40ae-951c-40bd9072e291 tempest-ProjectReaderTests-745022491 None] Created volume successfully. Jul 30 17:07:50 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-067e3ef9-cfab-489e-9651-434d63e4f68b tempest-ProjectReaderTests-745022491 None] Acquiring lock "cinder-5f1350cd-013b-4c37-8788-5407806b3ac4-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:07:51 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-067e3ef9-cfab-489e-9651-434d63e4f68b tempest-ProjectReaderTests-745022491 None] Lock "cinder-5f1350cd-013b-4c37-8788-5407806b3ac4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:07:51 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-067e3ef9-cfab-489e-9651-434d63e4f68b tempest-ProjectReaderTests-745022491 None] Acquiring lock "cinder-quobyte-5f1350cd-013b-4c37-8788-5407806b3ac4" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:07:51 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-067e3ef9-cfab-489e-9651-434d63e4f68b tempest-ProjectReaderTests-745022491 None] Lock "cinder-quobyte-5f1350cd-013b-4c37-8788-5407806b3ac4" acquired by "delete_volume" :: waited 0.019s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:07:51 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c443b3-d179-4808-ae02-ef9abb9c9e1f]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:07:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-067e3ef9-cfab-489e-9651-434d63e4f68b tempest-ProjectReaderTests-745022491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5f1350cd-013b-4c37-8788-5407806b3ac4 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:51 devstack sudo[107274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5f1350cd-013b-4c37-8788-5407806b3ac4 Jul 30 17:07:51 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:51 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-067e3ef9-cfab-489e-9651-434d63e4f68b tempest-ProjectReaderTests-745022491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5f1350cd-013b-4c37-8788-5407806b3ac4" returned: 0 in 0.353s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-067e3ef9-cfab-489e-9651-434d63e4f68b tempest-ProjectReaderTests-745022491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5f1350cd-013b-4c37-8788-5407806b3ac4 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:51 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5f1350cd-013b-4c37-8788-5407806b3ac4 Jul 30 17:07:51 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:51 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-067e3ef9-cfab-489e-9651-434d63e4f68b tempest-ProjectReaderTests-745022491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5f1350cd-013b-4c37-8788-5407806b3ac4" returned: 0 in 0.253s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:51 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-067e3ef9-cfab-489e-9651-434d63e4f68b tempest-ProjectReaderTests-745022491 None] Lock "cinder-quobyte-5f1350cd-013b-4c37-8788-5407806b3ac4" released by "delete_volume" :: held 0.651s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:07:51 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-067e3ef9-cfab-489e-9651-434d63e4f68b tempest-ProjectReaderTests-745022491 None] Created reservations ['f3544d76-566b-4826-9c2c-44a6fc33a973', '457abc1c-3442-4047-909a-41bc9dbcf0f5', '4e264168-f3e6-4817-9470-efd5bd2a0c3b', '2896d00c-ddd2-4011-8ea1-fc1d890234f4'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:07:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-067e3ef9-cfab-489e-9651-434d63e4f68b tempest-ProjectReaderTests-745022491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:07:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-067e3ef9-cfab-489e-9651-434d63e4f68b tempest-ProjectReaderTests-745022491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:07:51 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-067e3ef9-cfab-489e-9651-434d63e4f68b tempest-ProjectReaderTests-745022491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:07:51 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-067e3ef9-cfab-489e-9651-434d63e4f68b tempest-ProjectReaderTests-745022491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:07:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-067e3ef9-cfab-489e-9651-434d63e4f68b tempest-ProjectReaderTests-745022491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:07:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-067e3ef9-cfab-489e-9651-434d63e4f68b tempest-ProjectReaderTests-745022491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:51 devstack sudo[107282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:07:51 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:52 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-067e3ef9-cfab-489e-9651-434d63e4f68b tempest-ProjectReaderTests-745022491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.270s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:52 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-067e3ef9-cfab-489e-9651-434d63e4f68b tempest-ProjectReaderTests-745022491 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:07:52 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-067e3ef9-cfab-489e-9651-434d63e4f68b tempest-ProjectReaderTests-745022491 None] Deleted volume successfully. Jul 30 17:07:52 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-067e3ef9-cfab-489e-9651-434d63e4f68b tempest-ProjectReaderTests-745022491 None] Lock "cinder-5f1350cd-013b-4c37-8788-5407806b3ac4-delete_volume" released by "delete_volume" :: held 1.115s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:07:52 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-c03cfd80-bc1f-4e53-9837-da3b23ee39e1 tempest-ProjectReaderTests-745022491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:07:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c03cfd80-bc1f-4e53-9837-da3b23ee39e1 tempest-ProjectReaderTests-745022491 None] Flow 'volume_create_manager' (c0c711dd-3438-442b-9c57-5e9297c4536a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:07:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c03cfd80-bc1f-4e53-9837-da3b23ee39e1 tempest-ProjectReaderTests-745022491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b287b2c5-041e-4011-9c46-ef2dc8538f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c03cfd80-bc1f-4e53-9837-da3b23ee39e1 tempest-ProjectReaderTests-745022491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b287b2c5-041e-4011-9c46-ef2dc8538f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-89420686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbac73bf-35eb-4812-b671-bb06410225ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21e6ba74091c4d2ba656af7c148514b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:07:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:07:53Z,use_quota=True,user_id='360522e27ad4471faae5c2747b88b70e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c03cfd80-bc1f-4e53-9837-da3b23ee39e1 tempest-ProjectReaderTests-745022491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57be49ac-b343-4e3f-bed5-12733ab1aa04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c03cfd80-bc1f-4e53-9837-da3b23ee39e1 tempest-ProjectReaderTests-745022491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57be49ac-b343-4e3f-bed5-12733ab1aa04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c03cfd80-bc1f-4e53-9837-da3b23ee39e1 tempest-ProjectReaderTests-745022491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60cb6995-9120-4f50-aea9-70ff121cd79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c03cfd80-bc1f-4e53-9837-da3b23ee39e1 tempest-ProjectReaderTests-745022491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60cb6995-9120-4f50-aea9-70ff121cd79e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbac73bf-35eb-4812-b671-bb06410225ac', 'volume_name': 'volume-fbac73bf-35eb-4812-b671-bb06410225ac', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c03cfd80-bc1f-4e53-9837-da3b23ee39e1 tempest-ProjectReaderTests-745022491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c09fcf4-7a77-4869-9f5a-479c936000b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c03cfd80-bc1f-4e53-9837-da3b23ee39e1 tempest-ProjectReaderTests-745022491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c09fcf4-7a77-4869-9f5a-479c936000b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c03cfd80-bc1f-4e53-9837-da3b23ee39e1 tempest-ProjectReaderTests-745022491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b82d7058-314f-4d25-8eb6-8da0992d96a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:52 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-c03cfd80-bc1f-4e53-9837-da3b23ee39e1 tempest-ProjectReaderTests-745022491 None] Volume fbac73bf-35eb-4812-b671-bb06410225ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbac73bf-35eb-4812-b671-bb06410225ac', 'volume_size': 1} Jul 30 17:07:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c03cfd80-bc1f-4e53-9837-da3b23ee39e1 tempest-ProjectReaderTests-745022491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:07:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c03cfd80-bc1f-4e53-9837-da3b23ee39e1 tempest-ProjectReaderTests-745022491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:07:52 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-c03cfd80-bc1f-4e53-9837-da3b23ee39e1 tempest-ProjectReaderTests-745022491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-89420686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbac73bf-35eb-4812-b671-bb06410225ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21e6ba74091c4d2ba656af7c148514b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:07:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:07:53Z,use_quota=True,user_id='360522e27ad4471faae5c2747b88b70e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:07:52 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-c03cfd80-bc1f-4e53-9837-da3b23ee39e1 tempest-ProjectReaderTests-745022491 None] Creating volume fbac73bf-35eb-4812-b671-bb06410225ac {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:07:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c03cfd80-bc1f-4e53-9837-da3b23ee39e1 tempest-ProjectReaderTests-745022491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:07:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c03cfd80-bc1f-4e53-9837-da3b23ee39e1 tempest-ProjectReaderTests-745022491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:07:52 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-c03cfd80-bc1f-4e53-9837-da3b23ee39e1 tempest-ProjectReaderTests-745022491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:07:52 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-c03cfd80-bc1f-4e53-9837-da3b23ee39e1 tempest-ProjectReaderTests-745022491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:07:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c03cfd80-bc1f-4e53-9837-da3b23ee39e1 tempest-ProjectReaderTests-745022491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:07:52 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-c03cfd80-bc1f-4e53-9837-da3b23ee39e1 tempest-ProjectReaderTests-745022491 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:07:52 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-c03cfd80-bc1f-4e53-9837-da3b23ee39e1 tempest-ProjectReaderTests-745022491 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:07:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c03cfd80-bc1f-4e53-9837-da3b23ee39e1 tempest-ProjectReaderTests-745022491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fbac73bf-35eb-4812-b671-bb06410225ac 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:52 devstack sudo[107320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fbac73bf-35eb-4812-b671-bb06410225ac 1073741824 Jul 30 17:07:52 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:53 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c03cfd80-bc1f-4e53-9837-da3b23ee39e1 tempest-ProjectReaderTests-745022491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fbac73bf-35eb-4812-b671-bb06410225ac 1073741824" returned: 0 in 0.429s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c03cfd80-bc1f-4e53-9837-da3b23ee39e1 tempest-ProjectReaderTests-745022491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fbac73bf-35eb-4812-b671-bb06410225ac {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:53 devstack sudo[107328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fbac73bf-35eb-4812-b671-bb06410225ac Jul 30 17:07:53 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:53 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c03cfd80-bc1f-4e53-9837-da3b23ee39e1 tempest-ProjectReaderTests-745022491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fbac73bf-35eb-4812-b671-bb06410225ac" returned: 0 in 0.252s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:53 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-c03cfd80-bc1f-4e53-9837-da3b23ee39e1 tempest-ProjectReaderTests-745022491 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:07:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c03cfd80-bc1f-4e53-9837-da3b23ee39e1 tempest-ProjectReaderTests-745022491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:07:53 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c03cfd80-bc1f-4e53-9837-da3b23ee39e1 tempest-ProjectReaderTests-745022491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b82d7058-314f-4d25-8eb6-8da0992d96a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbac73bf-35eb-4812-b671-bb06410225ac', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:53 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c03cfd80-bc1f-4e53-9837-da3b23ee39e1 tempest-ProjectReaderTests-745022491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64a505cf-aa1a-42b6-9162-1463ab103191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:53 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-c03cfd80-bc1f-4e53-9837-da3b23ee39e1 tempest-ProjectReaderTests-745022491 None] Volume volume-fbac73bf-35eb-4812-b671-bb06410225ac (fbac73bf-35eb-4812-b671-bb06410225ac): created successfully Jul 30 17:07:53 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c03cfd80-bc1f-4e53-9837-da3b23ee39e1 tempest-ProjectReaderTests-745022491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64a505cf-aa1a-42b6-9162-1463ab103191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:53 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-c03cfd80-bc1f-4e53-9837-da3b23ee39e1 tempest-ProjectReaderTests-745022491 None] Flow 'volume_create_manager' (c0c711dd-3438-442b-9c57-5e9297c4536a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:07:53 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-c03cfd80-bc1f-4e53-9837-da3b23ee39e1 tempest-ProjectReaderTests-745022491 None] Created volume successfully. Jul 30 17:07:53 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f500f8a5-814f-4be7-8338-f8b930616dab tempest-ProjectReaderTests-745022491 None] Acquiring lock "cinder-fbac73bf-35eb-4812-b671-bb06410225ac-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:07:53 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f500f8a5-814f-4be7-8338-f8b930616dab tempest-ProjectReaderTests-745022491 None] Lock "cinder-fbac73bf-35eb-4812-b671-bb06410225ac-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:07:53 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f500f8a5-814f-4be7-8338-f8b930616dab tempest-ProjectReaderTests-745022491 None] Acquiring lock "cinder-quobyte-fbac73bf-35eb-4812-b671-bb06410225ac" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:07:53 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f500f8a5-814f-4be7-8338-f8b930616dab tempest-ProjectReaderTests-745022491 None] Lock "cinder-quobyte-fbac73bf-35eb-4812-b671-bb06410225ac" acquired by "delete_volume" :: waited 0.016s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:07:53 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1af7f49-d00d-4156-b175-2e5af3a42d72]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:07:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f500f8a5-814f-4be7-8338-f8b930616dab tempest-ProjectReaderTests-745022491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fbac73bf-35eb-4812-b671-bb06410225ac {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:53 devstack sudo[107331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fbac73bf-35eb-4812-b671-bb06410225ac Jul 30 17:07:53 devstack sudo[107331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:54 devstack sudo[107331]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f500f8a5-814f-4be7-8338-f8b930616dab tempest-ProjectReaderTests-745022491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fbac73bf-35eb-4812-b671-bb06410225ac" returned: 0 in 0.356s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f500f8a5-814f-4be7-8338-f8b930616dab tempest-ProjectReaderTests-745022491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fbac73bf-35eb-4812-b671-bb06410225ac {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:54 devstack sudo[107336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fbac73bf-35eb-4812-b671-bb06410225ac Jul 30 17:07:54 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:54 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f500f8a5-814f-4be7-8338-f8b930616dab tempest-ProjectReaderTests-745022491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fbac73bf-35eb-4812-b671-bb06410225ac" returned: 0 in 0.238s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:54 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f500f8a5-814f-4be7-8338-f8b930616dab tempest-ProjectReaderTests-745022491 None] Lock "cinder-quobyte-fbac73bf-35eb-4812-b671-bb06410225ac" released by "delete_volume" :: held 0.631s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:07:54 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-f500f8a5-814f-4be7-8338-f8b930616dab tempest-ProjectReaderTests-745022491 None] Created reservations ['1d505e33-65db-4335-b4b0-1089c41e797d', 'aaaa7de5-b36a-45cc-9746-0791df349925', 'a5e78e78-b181-412f-b97b-d9377c87115c', '87fb440a-b7d0-4fe0-8b02-4b501594934d'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:07:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f500f8a5-814f-4be7-8338-f8b930616dab tempest-ProjectReaderTests-745022491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:07:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f500f8a5-814f-4be7-8338-f8b930616dab tempest-ProjectReaderTests-745022491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:07:54 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f500f8a5-814f-4be7-8338-f8b930616dab tempest-ProjectReaderTests-745022491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:07:54 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f500f8a5-814f-4be7-8338-f8b930616dab tempest-ProjectReaderTests-745022491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:07:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f500f8a5-814f-4be7-8338-f8b930616dab tempest-ProjectReaderTests-745022491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:07:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f500f8a5-814f-4be7-8338-f8b930616dab tempest-ProjectReaderTests-745022491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:54 devstack sudo[107339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:07:54 devstack sudo[107339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:54 devstack sudo[107339]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f500f8a5-814f-4be7-8338-f8b930616dab tempest-ProjectReaderTests-745022491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.242s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:54 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-f500f8a5-814f-4be7-8338-f8b930616dab tempest-ProjectReaderTests-745022491 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:07:54 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-f500f8a5-814f-4be7-8338-f8b930616dab tempest-ProjectReaderTests-745022491 None] Deleted volume successfully. Jul 30 17:07:54 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f500f8a5-814f-4be7-8338-f8b930616dab tempest-ProjectReaderTests-745022491 None] Lock "cinder-fbac73bf-35eb-4812-b671-bb06410225ac-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:07:55 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7bb437d-9eb1-4527-9377-4f05da84f066 tempest-ProjectReaderTests-745022491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:07:55 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b7bb437d-9eb1-4527-9377-4f05da84f066 tempest-ProjectReaderTests-745022491 None] Flow 'volume_create_manager' (73ba3aba-be69-4520-a2a5-ed55fb226361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:07:55 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b7bb437d-9eb1-4527-9377-4f05da84f066 tempest-ProjectReaderTests-745022491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42a67432-b11d-4b9c-9297-52e7bf369e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:55 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b7bb437d-9eb1-4527-9377-4f05da84f066 tempest-ProjectReaderTests-745022491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42a67432-b11d-4b9c-9297-52e7bf369e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1164084261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaa54ad6-b1a7-4d36-bf27-e5ed184557e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21e6ba74091c4d2ba656af7c148514b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:07:55Z,use_quota=True,user_id='360522e27ad4471faae5c2747b88b70e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:55 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b7bb437d-9eb1-4527-9377-4f05da84f066 tempest-ProjectReaderTests-745022491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1e8747c-90b2-4759-9e25-5d2cd34588a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:55 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b7bb437d-9eb1-4527-9377-4f05da84f066 tempest-ProjectReaderTests-745022491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1e8747c-90b2-4759-9e25-5d2cd34588a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:55 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b7bb437d-9eb1-4527-9377-4f05da84f066 tempest-ProjectReaderTests-745022491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (842c2eda-5c89-40e6-b83f-96018a82cf19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:55 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b7bb437d-9eb1-4527-9377-4f05da84f066 tempest-ProjectReaderTests-745022491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (842c2eda-5c89-40e6-b83f-96018a82cf19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aaa54ad6-b1a7-4d36-bf27-e5ed184557e2', 'volume_name': 'volume-aaa54ad6-b1a7-4d36-bf27-e5ed184557e2', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:55 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b7bb437d-9eb1-4527-9377-4f05da84f066 tempest-ProjectReaderTests-745022491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7a73b0d-2231-4fca-bcee-d0a346f48f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:55 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b7bb437d-9eb1-4527-9377-4f05da84f066 tempest-ProjectReaderTests-745022491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7a73b0d-2231-4fca-bcee-d0a346f48f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:55 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b7bb437d-9eb1-4527-9377-4f05da84f066 tempest-ProjectReaderTests-745022491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45a2c52e-6c4d-4f32-b0c1-0bf6e6a68a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:55 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-b7bb437d-9eb1-4527-9377-4f05da84f066 tempest-ProjectReaderTests-745022491 None] Volume aaa54ad6-b1a7-4d36-bf27-e5ed184557e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aaa54ad6-b1a7-4d36-bf27-e5ed184557e2', 'volume_size': 1} Jul 30 17:07:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b7bb437d-9eb1-4527-9377-4f05da84f066 tempest-ProjectReaderTests-745022491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:07:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b7bb437d-9eb1-4527-9377-4f05da84f066 tempest-ProjectReaderTests-745022491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:07:55 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b7bb437d-9eb1-4527-9377-4f05da84f066 tempest-ProjectReaderTests-745022491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1164084261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaa54ad6-b1a7-4d36-bf27-e5ed184557e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21e6ba74091c4d2ba656af7c148514b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:07:55Z,use_quota=True,user_id='360522e27ad4471faae5c2747b88b70e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:07:55 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-b7bb437d-9eb1-4527-9377-4f05da84f066 tempest-ProjectReaderTests-745022491 None] Creating volume aaa54ad6-b1a7-4d36-bf27-e5ed184557e2 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:07:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b7bb437d-9eb1-4527-9377-4f05da84f066 tempest-ProjectReaderTests-745022491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:07:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b7bb437d-9eb1-4527-9377-4f05da84f066 tempest-ProjectReaderTests-745022491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:07:55 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b7bb437d-9eb1-4527-9377-4f05da84f066 tempest-ProjectReaderTests-745022491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:07:55 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b7bb437d-9eb1-4527-9377-4f05da84f066 tempest-ProjectReaderTests-745022491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:07:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b7bb437d-9eb1-4527-9377-4f05da84f066 tempest-ProjectReaderTests-745022491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:07:55 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b7bb437d-9eb1-4527-9377-4f05da84f066 tempest-ProjectReaderTests-745022491 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:07:55 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-b7bb437d-9eb1-4527-9377-4f05da84f066 tempest-ProjectReaderTests-745022491 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:07:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b7bb437d-9eb1-4527-9377-4f05da84f066 tempest-ProjectReaderTests-745022491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-aaa54ad6-b1a7-4d36-bf27-e5ed184557e2 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:55 devstack sudo[107342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-aaa54ad6-b1a7-4d36-bf27-e5ed184557e2 1073741824 Jul 30 17:07:55 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:55 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b7bb437d-9eb1-4527-9377-4f05da84f066 tempest-ProjectReaderTests-745022491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-aaa54ad6-b1a7-4d36-bf27-e5ed184557e2 1073741824" returned: 0 in 0.426s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b7bb437d-9eb1-4527-9377-4f05da84f066 tempest-ProjectReaderTests-745022491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-aaa54ad6-b1a7-4d36-bf27-e5ed184557e2 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:55 devstack sudo[107347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-aaa54ad6-b1a7-4d36-bf27-e5ed184557e2 Jul 30 17:07:55 devstack sudo[107347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:55 devstack sudo[107347]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b7bb437d-9eb1-4527-9377-4f05da84f066 tempest-ProjectReaderTests-745022491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-aaa54ad6-b1a7-4d36-bf27-e5ed184557e2" returned: 0 in 0.251s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:55 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b7bb437d-9eb1-4527-9377-4f05da84f066 tempest-ProjectReaderTests-745022491 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:07:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b7bb437d-9eb1-4527-9377-4f05da84f066 tempest-ProjectReaderTests-745022491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:07:56 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b7bb437d-9eb1-4527-9377-4f05da84f066 tempest-ProjectReaderTests-745022491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45a2c52e-6c4d-4f32-b0c1-0bf6e6a68a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aaa54ad6-b1a7-4d36-bf27-e5ed184557e2', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:56 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b7bb437d-9eb1-4527-9377-4f05da84f066 tempest-ProjectReaderTests-745022491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab4831d8-c499-4cd6-90ab-e01c4c9e5296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:56 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-b7bb437d-9eb1-4527-9377-4f05da84f066 tempest-ProjectReaderTests-745022491 None] Volume volume-aaa54ad6-b1a7-4d36-bf27-e5ed184557e2 (aaa54ad6-b1a7-4d36-bf27-e5ed184557e2): created successfully Jul 30 17:07:56 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b7bb437d-9eb1-4527-9377-4f05da84f066 tempest-ProjectReaderTests-745022491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab4831d8-c499-4cd6-90ab-e01c4c9e5296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:56 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b7bb437d-9eb1-4527-9377-4f05da84f066 tempest-ProjectReaderTests-745022491 None] Flow 'volume_create_manager' (73ba3aba-be69-4520-a2a5-ed55fb226361) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:07:56 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-b7bb437d-9eb1-4527-9377-4f05da84f066 tempest-ProjectReaderTests-745022491 None] Created volume successfully. Jul 30 17:07:56 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-2cdfc016-146a-4c3a-a80f-27629275da79 tempest-ProjectReaderTests-745022491 None] Acquiring lock "cinder-aaa54ad6-b1a7-4d36-bf27-e5ed184557e2-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:07:56 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-2cdfc016-146a-4c3a-a80f-27629275da79 tempest-ProjectReaderTests-745022491 None] Lock "cinder-aaa54ad6-b1a7-4d36-bf27-e5ed184557e2-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:07:56 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-2cdfc016-146a-4c3a-a80f-27629275da79 tempest-ProjectReaderTests-745022491 None] Acquiring lock "cinder-quobyte-aaa54ad6-b1a7-4d36-bf27-e5ed184557e2" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:07:56 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-2cdfc016-146a-4c3a-a80f-27629275da79 tempest-ProjectReaderTests-745022491 None] Lock "cinder-quobyte-aaa54ad6-b1a7-4d36-bf27-e5ed184557e2" acquired by "delete_volume" :: waited 0.021s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:07:56 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c37031-3f16-4c19-bdf9-eda87fc3f205]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:07:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2cdfc016-146a-4c3a-a80f-27629275da79 tempest-ProjectReaderTests-745022491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-aaa54ad6-b1a7-4d36-bf27-e5ed184557e2 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:56 devstack sudo[107350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-aaa54ad6-b1a7-4d36-bf27-e5ed184557e2 Jul 30 17:07:56 devstack sudo[107350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:56 devstack sudo[107350]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2cdfc016-146a-4c3a-a80f-27629275da79 tempest-ProjectReaderTests-745022491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-aaa54ad6-b1a7-4d36-bf27-e5ed184557e2" returned: 0 in 0.365s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2cdfc016-146a-4c3a-a80f-27629275da79 tempest-ProjectReaderTests-745022491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-aaa54ad6-b1a7-4d36-bf27-e5ed184557e2 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:56 devstack sudo[107355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-aaa54ad6-b1a7-4d36-bf27-e5ed184557e2 Jul 30 17:07:56 devstack sudo[107355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:56 devstack sudo[107355]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2cdfc016-146a-4c3a-a80f-27629275da79 tempest-ProjectReaderTests-745022491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-aaa54ad6-b1a7-4d36-bf27-e5ed184557e2" returned: 0 in 0.247s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:56 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-2cdfc016-146a-4c3a-a80f-27629275da79 tempest-ProjectReaderTests-745022491 None] Lock "cinder-quobyte-aaa54ad6-b1a7-4d36-bf27-e5ed184557e2" released by "delete_volume" :: held 0.649s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:07:57 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-2cdfc016-146a-4c3a-a80f-27629275da79 tempest-ProjectReaderTests-745022491 None] Created reservations ['b25af7e5-76f9-4768-8bf8-c5e80b8ac03c', 'ca627be1-fb29-46bb-9ab6-c31e0138593f', 'fd2baa95-2e25-4b41-a654-12f964f4c16f', 'b8cf30d8-fc8c-4b5c-8ca5-d1d7d7a5094e'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:07:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2cdfc016-146a-4c3a-a80f-27629275da79 tempest-ProjectReaderTests-745022491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:07:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2cdfc016-146a-4c3a-a80f-27629275da79 tempest-ProjectReaderTests-745022491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:07:57 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-2cdfc016-146a-4c3a-a80f-27629275da79 tempest-ProjectReaderTests-745022491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:07:57 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-2cdfc016-146a-4c3a-a80f-27629275da79 tempest-ProjectReaderTests-745022491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:07:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2cdfc016-146a-4c3a-a80f-27629275da79 tempest-ProjectReaderTests-745022491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:07:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2cdfc016-146a-4c3a-a80f-27629275da79 tempest-ProjectReaderTests-745022491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:57 devstack sudo[107358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:07:57 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:57 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2cdfc016-146a-4c3a-a80f-27629275da79 tempest-ProjectReaderTests-745022491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.241s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:57 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-2cdfc016-146a-4c3a-a80f-27629275da79 tempest-ProjectReaderTests-745022491 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:07:57 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-2cdfc016-146a-4c3a-a80f-27629275da79 tempest-ProjectReaderTests-745022491 None] Deleted volume successfully. Jul 30 17:07:57 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-2cdfc016-146a-4c3a-a80f-27629275da79 tempest-ProjectReaderTests-745022491 None] Lock "cinder-aaa54ad6-b1a7-4d36-bf27-e5ed184557e2-delete_volume" released by "delete_volume" :: held 1.109s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:07:57 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-d96d24b6-8af8-4992-ab5c-a31e4b775748 tempest-ProjectReaderTests-745022491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:07:57 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d96d24b6-8af8-4992-ab5c-a31e4b775748 tempest-ProjectReaderTests-745022491 None] Flow 'volume_create_manager' (5d195258-df15-4975-97fa-422feed0bada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:07:57 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d96d24b6-8af8-4992-ab5c-a31e4b775748 tempest-ProjectReaderTests-745022491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (528baeeb-8e9a-45a6-ac07-580875129b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:57 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d96d24b6-8af8-4992-ab5c-a31e4b775748 tempest-ProjectReaderTests-745022491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (528baeeb-8e9a-45a6-ac07-580875129b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:07:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-496341402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd2448c3-dfc3-4d39-b628-1c2096b99cac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21e6ba74091c4d2ba656af7c148514b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:07:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:07:58Z,use_quota=True,user_id='360522e27ad4471faae5c2747b88b70e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:57 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d96d24b6-8af8-4992-ab5c-a31e4b775748 tempest-ProjectReaderTests-745022491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daaf104f-8a21-4bae-b5ea-66d57e1cc7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:57 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d96d24b6-8af8-4992-ab5c-a31e4b775748 tempest-ProjectReaderTests-745022491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daaf104f-8a21-4bae-b5ea-66d57e1cc7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:57 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d96d24b6-8af8-4992-ab5c-a31e4b775748 tempest-ProjectReaderTests-745022491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a248090-d464-44ee-8376-73980e611c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:57 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d96d24b6-8af8-4992-ab5c-a31e4b775748 tempest-ProjectReaderTests-745022491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a248090-d464-44ee-8376-73980e611c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd2448c3-dfc3-4d39-b628-1c2096b99cac', 'volume_name': 'volume-dd2448c3-dfc3-4d39-b628-1c2096b99cac', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:57 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d96d24b6-8af8-4992-ab5c-a31e4b775748 tempest-ProjectReaderTests-745022491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34ac15d4-3e4d-4cbc-8df4-03a6f617299c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:57 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d96d24b6-8af8-4992-ab5c-a31e4b775748 tempest-ProjectReaderTests-745022491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34ac15d4-3e4d-4cbc-8df4-03a6f617299c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:57 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d96d24b6-8af8-4992-ab5c-a31e4b775748 tempest-ProjectReaderTests-745022491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (083b911e-ed7c-409d-8621-afd09a5f188f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:57 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-d96d24b6-8af8-4992-ab5c-a31e4b775748 tempest-ProjectReaderTests-745022491 None] Volume dd2448c3-dfc3-4d39-b628-1c2096b99cac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd2448c3-dfc3-4d39-b628-1c2096b99cac', 'volume_size': 1} Jul 30 17:07:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d96d24b6-8af8-4992-ab5c-a31e4b775748 tempest-ProjectReaderTests-745022491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:07:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d96d24b6-8af8-4992-ab5c-a31e4b775748 tempest-ProjectReaderTests-745022491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:07:57 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d96d24b6-8af8-4992-ab5c-a31e4b775748 tempest-ProjectReaderTests-745022491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:07:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-496341402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd2448c3-dfc3-4d39-b628-1c2096b99cac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21e6ba74091c4d2ba656af7c148514b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:07:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:07:58Z,use_quota=True,user_id='360522e27ad4471faae5c2747b88b70e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:07:57 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-d96d24b6-8af8-4992-ab5c-a31e4b775748 tempest-ProjectReaderTests-745022491 None] Creating volume dd2448c3-dfc3-4d39-b628-1c2096b99cac {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:07:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d96d24b6-8af8-4992-ab5c-a31e4b775748 tempest-ProjectReaderTests-745022491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:07:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d96d24b6-8af8-4992-ab5c-a31e4b775748 tempest-ProjectReaderTests-745022491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:07:57 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d96d24b6-8af8-4992-ab5c-a31e4b775748 tempest-ProjectReaderTests-745022491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:07:57 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d96d24b6-8af8-4992-ab5c-a31e4b775748 tempest-ProjectReaderTests-745022491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:07:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d96d24b6-8af8-4992-ab5c-a31e4b775748 tempest-ProjectReaderTests-745022491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:07:57 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d96d24b6-8af8-4992-ab5c-a31e4b775748 tempest-ProjectReaderTests-745022491 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:07:57 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-d96d24b6-8af8-4992-ab5c-a31e4b775748 tempest-ProjectReaderTests-745022491 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:07:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d96d24b6-8af8-4992-ab5c-a31e4b775748 tempest-ProjectReaderTests-745022491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-dd2448c3-dfc3-4d39-b628-1c2096b99cac 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:57 devstack sudo[107361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-dd2448c3-dfc3-4d39-b628-1c2096b99cac 1073741824 Jul 30 17:07:57 devstack sudo[107361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:58 devstack sudo[107361]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d96d24b6-8af8-4992-ab5c-a31e4b775748 tempest-ProjectReaderTests-745022491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-dd2448c3-dfc3-4d39-b628-1c2096b99cac 1073741824" returned: 0 in 0.410s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d96d24b6-8af8-4992-ab5c-a31e4b775748 tempest-ProjectReaderTests-745022491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-dd2448c3-dfc3-4d39-b628-1c2096b99cac {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:58 devstack sudo[107367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-dd2448c3-dfc3-4d39-b628-1c2096b99cac Jul 30 17:07:58 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:58 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d96d24b6-8af8-4992-ab5c-a31e4b775748 tempest-ProjectReaderTests-745022491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-dd2448c3-dfc3-4d39-b628-1c2096b99cac" returned: 0 in 0.240s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:58 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d96d24b6-8af8-4992-ab5c-a31e4b775748 tempest-ProjectReaderTests-745022491 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:07:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d96d24b6-8af8-4992-ab5c-a31e4b775748 tempest-ProjectReaderTests-745022491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:07:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d96d24b6-8af8-4992-ab5c-a31e4b775748 tempest-ProjectReaderTests-745022491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (083b911e-ed7c-409d-8621-afd09a5f188f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd2448c3-dfc3-4d39-b628-1c2096b99cac', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d96d24b6-8af8-4992-ab5c-a31e4b775748 tempest-ProjectReaderTests-745022491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62a764a7-b3af-4aa7-b927-1bbd97d74440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:07:58 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-d96d24b6-8af8-4992-ab5c-a31e4b775748 tempest-ProjectReaderTests-745022491 None] Volume volume-dd2448c3-dfc3-4d39-b628-1c2096b99cac (dd2448c3-dfc3-4d39-b628-1c2096b99cac): created successfully Jul 30 17:07:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d96d24b6-8af8-4992-ab5c-a31e4b775748 tempest-ProjectReaderTests-745022491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62a764a7-b3af-4aa7-b927-1bbd97d74440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:07:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d96d24b6-8af8-4992-ab5c-a31e4b775748 tempest-ProjectReaderTests-745022491 None] Flow 'volume_create_manager' (5d195258-df15-4975-97fa-422feed0bada) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:07:58 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-d96d24b6-8af8-4992-ab5c-a31e4b775748 tempest-ProjectReaderTests-745022491 None] Created volume successfully. Jul 30 17:07:58 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-15a20977-d502-43f6-b706-e8b2441ac1ea tempest-ProjectReaderTests-745022491 None] Acquiring lock "cinder-dd2448c3-dfc3-4d39-b628-1c2096b99cac-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:07:58 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-15a20977-d502-43f6-b706-e8b2441ac1ea tempest-ProjectReaderTests-745022491 None] Lock "cinder-dd2448c3-dfc3-4d39-b628-1c2096b99cac-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:07:58 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-15a20977-d502-43f6-b706-e8b2441ac1ea tempest-ProjectReaderTests-745022491 None] Acquiring lock "cinder-quobyte-dd2448c3-dfc3-4d39-b628-1c2096b99cac" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:07:58 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-15a20977-d502-43f6-b706-e8b2441ac1ea tempest-ProjectReaderTests-745022491 None] Lock "cinder-quobyte-dd2448c3-dfc3-4d39-b628-1c2096b99cac" acquired by "delete_volume" :: waited 0.017s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:07:58 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2c2a8f-d716-4fe4-bddf-43ab00702983]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:07:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-15a20977-d502-43f6-b706-e8b2441ac1ea tempest-ProjectReaderTests-745022491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-dd2448c3-dfc3-4d39-b628-1c2096b99cac {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:59 devstack sudo[107370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-dd2448c3-dfc3-4d39-b628-1c2096b99cac Jul 30 17:07:59 devstack sudo[107370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:59 devstack sudo[107370]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-15a20977-d502-43f6-b706-e8b2441ac1ea tempest-ProjectReaderTests-745022491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-dd2448c3-dfc3-4d39-b628-1c2096b99cac" returned: 0 in 0.345s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-15a20977-d502-43f6-b706-e8b2441ac1ea tempest-ProjectReaderTests-745022491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-dd2448c3-dfc3-4d39-b628-1c2096b99cac {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:59 devstack sudo[107375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-dd2448c3-dfc3-4d39-b628-1c2096b99cac Jul 30 17:07:59 devstack sudo[107375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:59 devstack sudo[107375]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-15a20977-d502-43f6-b706-e8b2441ac1ea tempest-ProjectReaderTests-745022491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-dd2448c3-dfc3-4d39-b628-1c2096b99cac" returned: 0 in 0.235s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:59 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-15a20977-d502-43f6-b706-e8b2441ac1ea tempest-ProjectReaderTests-745022491 None] Lock "cinder-quobyte-dd2448c3-dfc3-4d39-b628-1c2096b99cac" released by "delete_volume" :: held 0.618s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:07:59 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-15a20977-d502-43f6-b706-e8b2441ac1ea tempest-ProjectReaderTests-745022491 None] Created reservations ['925d629b-f55f-4f8d-a2a2-61efb0c108fc', 'f71df102-f7cf-490c-b1ac-406cbaa0bc67', '4aa99ce9-d5eb-4e23-be35-fdb52ab6bc14', 'b2c9d7f8-ff91-4323-a13d-97e46c537caa'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:07:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-15a20977-d502-43f6-b706-e8b2441ac1ea tempest-ProjectReaderTests-745022491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:07:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-15a20977-d502-43f6-b706-e8b2441ac1ea tempest-ProjectReaderTests-745022491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:07:59 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-15a20977-d502-43f6-b706-e8b2441ac1ea tempest-ProjectReaderTests-745022491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:07:59 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-15a20977-d502-43f6-b706-e8b2441ac1ea tempest-ProjectReaderTests-745022491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:07:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-15a20977-d502-43f6-b706-e8b2441ac1ea tempest-ProjectReaderTests-745022491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:07:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-15a20977-d502-43f6-b706-e8b2441ac1ea tempest-ProjectReaderTests-745022491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:07:59 devstack sudo[107378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:07:59 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:07:59 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root Jul 30 17:07:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-15a20977-d502-43f6-b706-e8b2441ac1ea tempest-ProjectReaderTests-745022491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.264s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:07:59 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-15a20977-d502-43f6-b706-e8b2441ac1ea tempest-ProjectReaderTests-745022491 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:07:59 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-15a20977-d502-43f6-b706-e8b2441ac1ea tempest-ProjectReaderTests-745022491 None] Deleted volume successfully. Jul 30 17:07:59 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-15a20977-d502-43f6-b706-e8b2441ac1ea tempest-ProjectReaderTests-745022491 None] Lock "cinder-dd2448c3-dfc3-4d39-b628-1c2096b99cac-delete_volume" released by "delete_volume" :: held 1.086s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:08:09 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:SELECT=97,cinder:UPDATE=118,cinder:INSERT=29,cinder:DELETE=13 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:08:09 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:SELECT=94,cinder:UPDATE=141,cinder:INSERT=29,cinder:DELETE=9 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:08:12 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-a540ecc5-4ce3-4c16-b916-f72113a982e7 tempest-VolumeDependencyTests-500709084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:08:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a540ecc5-4ce3-4c16-b916-f72113a982e7 tempest-VolumeDependencyTests-500709084 None] Flow 'volume_create_manager' (4efcba4c-0af9-4f5b-a88b-272e652e8098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:08:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a540ecc5-4ce3-4c16-b916-f72113a982e7 tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e822d74-fbc2-4bef-97d8-508c6b230323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a540ecc5-4ce3-4c16-b916-f72113a982e7 tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e822d74-fbc2-4bef-97d8-508c6b230323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:08:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1237579741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fef4ded4-31f8-458e-83a4-2afaa037f927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75be733264504175956c041c2312fa52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:08:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:08:12Z,use_quota=True,user_id='9ee0dab1317a4cfeafb4f6b50ca81a57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a540ecc5-4ce3-4c16-b916-f72113a982e7 tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42f55632-af65-42a5-bb88-834f13c82959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a540ecc5-4ce3-4c16-b916-f72113a982e7 tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42f55632-af65-42a5-bb88-834f13c82959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a540ecc5-4ce3-4c16-b916-f72113a982e7 tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b0874f6-5717-46f6-bb88-68adbf8b1a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a540ecc5-4ce3-4c16-b916-f72113a982e7 tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b0874f6-5717-46f6-bb88-68adbf8b1a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fef4ded4-31f8-458e-83a4-2afaa037f927', 'volume_name': 'volume-fef4ded4-31f8-458e-83a4-2afaa037f927', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a540ecc5-4ce3-4c16-b916-f72113a982e7 tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cab8a59f-eceb-474e-b5eb-f1c30e01610f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a540ecc5-4ce3-4c16-b916-f72113a982e7 tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cab8a59f-eceb-474e-b5eb-f1c30e01610f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a540ecc5-4ce3-4c16-b916-f72113a982e7 tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b586e82-902d-4681-8ec1-2b3e7adc9a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:12 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-a540ecc5-4ce3-4c16-b916-f72113a982e7 tempest-VolumeDependencyTests-500709084 None] Volume fef4ded4-31f8-458e-83a4-2afaa037f927: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fef4ded4-31f8-458e-83a4-2afaa037f927', 'volume_size': 1} Jul 30 17:08:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a540ecc5-4ce3-4c16-b916-f72113a982e7 tempest-VolumeDependencyTests-500709084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a540ecc5-4ce3-4c16-b916-f72113a982e7 tempest-VolumeDependencyTests-500709084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a540ecc5-4ce3-4c16-b916-f72113a982e7 tempest-VolumeDependencyTests-500709084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:08:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1237579741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fef4ded4-31f8-458e-83a4-2afaa037f927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75be733264504175956c041c2312fa52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:08:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:08:12Z,use_quota=True,user_id='9ee0dab1317a4cfeafb4f6b50ca81a57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:08:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-a540ecc5-4ce3-4c16-b916-f72113a982e7 tempest-VolumeDependencyTests-500709084 None] Creating volume fef4ded4-31f8-458e-83a4-2afaa037f927 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:08:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a540ecc5-4ce3-4c16-b916-f72113a982e7 tempest-VolumeDependencyTests-500709084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a540ecc5-4ce3-4c16-b916-f72113a982e7 tempest-VolumeDependencyTests-500709084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a540ecc5-4ce3-4c16-b916-f72113a982e7 tempest-VolumeDependencyTests-500709084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:08:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a540ecc5-4ce3-4c16-b916-f72113a982e7 tempest-VolumeDependencyTests-500709084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:08:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a540ecc5-4ce3-4c16-b916-f72113a982e7 tempest-VolumeDependencyTests-500709084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a540ecc5-4ce3-4c16-b916-f72113a982e7 tempest-VolumeDependencyTests-500709084 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:08:12 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-a540ecc5-4ce3-4c16-b916-f72113a982e7 tempest-VolumeDependencyTests-500709084 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:08:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a540ecc5-4ce3-4c16-b916-f72113a982e7 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef4ded4-31f8-458e-83a4-2afaa037f927 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:12 devstack cinder-volume[88591]: DEBUG oslo_service.periodic_task [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 17:08:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:08:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:08:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:12 devstack sudo[107422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef4ded4-31f8-458e-83a4-2afaa037f927 1073741824 Jul 30 17:08:12 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:12 devstack sudo[107424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:08:12 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3cdeb09-7c07-4aac-8aee-4c28e488fbc8 tempest-CreateVolumesFromImageTest-1150243246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:08:12 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d3cdeb09-7c07-4aac-8aee-4c28e488fbc8 tempest-CreateVolumesFromImageTest-1150243246 None] Flow 'volume_create_manager' (03671b4c-c48e-4de7-984d-53599afc3c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:08:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d3cdeb09-7c07-4aac-8aee-4c28e488fbc8 tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7031f7b3-cb46-4d76-a9d9-b0af3271c541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d3cdeb09-7c07-4aac-8aee-4c28e488fbc8 tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7031f7b3-cb46-4d76-a9d9-b0af3271c541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:08:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1854225688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69ac7a9a-32a0-44f6-beb7-9d76787802b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4e5abb1c4d14a9389fa10c990f934eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:08:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:08:12Z,use_quota=True,user_id='9e2d3c45749d400fa0bbec9e6824d257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d3cdeb09-7c07-4aac-8aee-4c28e488fbc8 tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdce8e57-d69b-41a5-b251-a438b3d2b94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d3cdeb09-7c07-4aac-8aee-4c28e488fbc8 tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdce8e57-d69b-41a5-b251-a438b3d2b94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d3cdeb09-7c07-4aac-8aee-4c28e488fbc8 tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96ab89ef-dcac-4a15-a200-e573807b5e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d3cdeb09-7c07-4aac-8aee-4c28e488fbc8 tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96ab89ef-dcac-4a15-a200-e573807b5e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69ac7a9a-32a0-44f6-beb7-9d76787802b0', 'volume_name': 'volume-69ac7a9a-32a0-44f6-beb7-9d76787802b0', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d3cdeb09-7c07-4aac-8aee-4c28e488fbc8 tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1547d8d-7d60-4a95-ad8d-22ee0207ddbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d3cdeb09-7c07-4aac-8aee-4c28e488fbc8 tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1547d8d-7d60-4a95-ad8d-22ee0207ddbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d3cdeb09-7c07-4aac-8aee-4c28e488fbc8 tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18474c2a-57e1-4eaa-9382-cfa49ed75371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:12 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-d3cdeb09-7c07-4aac-8aee-4c28e488fbc8 tempest-CreateVolumesFromImageTest-1150243246 None] Volume 69ac7a9a-32a0-44f6-beb7-9d76787802b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69ac7a9a-32a0-44f6-beb7-9d76787802b0', 'volume_size': 1} Jul 30 17:08:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d3cdeb09-7c07-4aac-8aee-4c28e488fbc8 tempest-CreateVolumesFromImageTest-1150243246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:13 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-45a2daaa-ae9b-48eb-982a-60a723a89529 tempest-CreateVolumesFromImageTest-1150243246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:08:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-45a2daaa-ae9b-48eb-982a-60a723a89529 tempest-CreateVolumesFromImageTest-1150243246 None] Flow 'volume_create_manager' (8d76e57e-3fdc-44ef-a82c-b79b386698fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:08:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-45a2daaa-ae9b-48eb-982a-60a723a89529 tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6659a5bf-033c-4fb5-a1db-8d6f69ea416f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-45a2daaa-ae9b-48eb-982a-60a723a89529 tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6659a5bf-033c-4fb5-a1db-8d6f69ea416f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:08:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1066250172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1104d7c1-906d-4435-9a66-9c123f69af4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4e5abb1c4d14a9389fa10c990f934eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:08:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:08:13Z,use_quota=True,user_id='9e2d3c45749d400fa0bbec9e6824d257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-45a2daaa-ae9b-48eb-982a-60a723a89529 tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71909d13-f39c-4dd7-b4d0-11d1bc11bec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-45a2daaa-ae9b-48eb-982a-60a723a89529 tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71909d13-f39c-4dd7-b4d0-11d1bc11bec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-45a2daaa-ae9b-48eb-982a-60a723a89529 tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce04b03c-f576-477b-953b-082d9630eda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-45a2daaa-ae9b-48eb-982a-60a723a89529 tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce04b03c-f576-477b-953b-082d9630eda7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1104d7c1-906d-4435-9a66-9c123f69af4b', 'volume_name': 'volume-1104d7c1-906d-4435-9a66-9c123f69af4b', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-45a2daaa-ae9b-48eb-982a-60a723a89529 tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8829d103-3456-4e68-b303-a1c7171ecafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-45a2daaa-ae9b-48eb-982a-60a723a89529 tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8829d103-3456-4e68-b303-a1c7171ecafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-45a2daaa-ae9b-48eb-982a-60a723a89529 tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (955bfb97-bfe8-41d7-96d3-12dacae8f222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:13 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-45a2daaa-ae9b-48eb-982a-60a723a89529 tempest-CreateVolumesFromImageTest-1150243246 None] Volume 1104d7c1-906d-4435-9a66-9c123f69af4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1104d7c1-906d-4435-9a66-9c123f69af4b', 'volume_size': 1} Jul 30 17:08:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-45a2daaa-ae9b-48eb-982a-60a723a89529 tempest-CreateVolumesFromImageTest-1150243246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:13 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.514s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:13 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:08:13 devstack cinder-volume[88591]: DEBUG oslo_service.periodic_task [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running periodic task VolumeManager._thread_info {{(pid=88591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 17:08:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] thread count: 28 {{(pid=88591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 17:08:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] thread info: [<_MainThread(MainThread, started 140677178003584)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 17:08:13 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a540ecc5-4ce3-4c16-b916-f72113a982e7 tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef4ded4-31f8-458e-83a4-2afaa037f927 1073741824" returned: 0 in 0.686s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a540ecc5-4ce3-4c16-b916-f72113a982e7 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef4ded4-31f8-458e-83a4-2afaa037f927 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:13 devstack sudo[107431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef4ded4-31f8-458e-83a4-2afaa037f927 Jul 30 17:08:13 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:13 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc8a2377-5e66-454b-81f6-63d5802daaef tempest-CreateVolumesFromImageTest-1150243246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:08:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bc8a2377-5e66-454b-81f6-63d5802daaef tempest-CreateVolumesFromImageTest-1150243246 None] Flow 'volume_create_manager' (eefb29cf-2e6c-4f5b-887b-8b5b7fde7bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:08:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bc8a2377-5e66-454b-81f6-63d5802daaef tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2b80257-8d0e-4c68-b96a-8b6d98c61cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bc8a2377-5e66-454b-81f6-63d5802daaef tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2b80257-8d0e-4c68-b96a-8b6d98c61cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-383997704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6ab38fb-e7a8-42d6-bfa6-2248242aacef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4e5abb1c4d14a9389fa10c990f934eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:08:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:08:13Z,use_quota=True,user_id='9e2d3c45749d400fa0bbec9e6824d257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bc8a2377-5e66-454b-81f6-63d5802daaef tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1c929cd-c09f-4354-a2df-415912933547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bc8a2377-5e66-454b-81f6-63d5802daaef tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1c929cd-c09f-4354-a2df-415912933547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bc8a2377-5e66-454b-81f6-63d5802daaef tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7af88b2-740e-41c3-a685-a33aeb3d48de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bc8a2377-5e66-454b-81f6-63d5802daaef tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7af88b2-740e-41c3-a685-a33aeb3d48de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6ab38fb-e7a8-42d6-bfa6-2248242aacef', 'volume_name': 'volume-f6ab38fb-e7a8-42d6-bfa6-2248242aacef', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bc8a2377-5e66-454b-81f6-63d5802daaef tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d810999-0256-417a-a074-5ccedfb45112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bc8a2377-5e66-454b-81f6-63d5802daaef tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d810999-0256-417a-a074-5ccedfb45112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bc8a2377-5e66-454b-81f6-63d5802daaef tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09e9bb4f-d940-4555-b5f2-c9200aca78bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:13 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-bc8a2377-5e66-454b-81f6-63d5802daaef tempest-CreateVolumesFromImageTest-1150243246 None] Volume f6ab38fb-e7a8-42d6-bfa6-2248242aacef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6ab38fb-e7a8-42d6-bfa6-2248242aacef', 'volume_size': 1} Jul 30 17:08:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-bc8a2377-5e66-454b-81f6-63d5802daaef tempest-CreateVolumesFromImageTest-1150243246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:13 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a540ecc5-4ce3-4c16-b916-f72113a982e7 tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef4ded4-31f8-458e-83a4-2afaa037f927" returned: 0 in 0.337s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:13 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a540ecc5-4ce3-4c16-b916-f72113a982e7 tempest-VolumeDependencyTests-500709084 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:08:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a540ecc5-4ce3-4c16-b916-f72113a982e7 tempest-VolumeDependencyTests-500709084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d3cdeb09-7c07-4aac-8aee-4c28e488fbc8 tempest-CreateVolumesFromImageTest-1150243246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.815s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:13 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d3cdeb09-7c07-4aac-8aee-4c28e488fbc8 tempest-CreateVolumesFromImageTest-1150243246 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:08:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1854225688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69ac7a9a-32a0-44f6-beb7-9d76787802b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4e5abb1c4d14a9389fa10c990f934eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:08:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:08:12Z,use_quota=True,user_id='9e2d3c45749d400fa0bbec9e6824d257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:08:13 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-d3cdeb09-7c07-4aac-8aee-4c28e488fbc8 tempest-CreateVolumesFromImageTest-1150243246 None] Creating volume 69ac7a9a-32a0-44f6-beb7-9d76787802b0 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:08:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d3cdeb09-7c07-4aac-8aee-4c28e488fbc8 tempest-CreateVolumesFromImageTest-1150243246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d3cdeb09-7c07-4aac-8aee-4c28e488fbc8 tempest-CreateVolumesFromImageTest-1150243246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:13 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d3cdeb09-7c07-4aac-8aee-4c28e488fbc8 tempest-CreateVolumesFromImageTest-1150243246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:08:13 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d3cdeb09-7c07-4aac-8aee-4c28e488fbc8 tempest-CreateVolumesFromImageTest-1150243246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:08:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d3cdeb09-7c07-4aac-8aee-4c28e488fbc8 tempest-CreateVolumesFromImageTest-1150243246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:13 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d3cdeb09-7c07-4aac-8aee-4c28e488fbc8 tempest-CreateVolumesFromImageTest-1150243246 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:08:13 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-d3cdeb09-7c07-4aac-8aee-4c28e488fbc8 tempest-CreateVolumesFromImageTest-1150243246 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:08:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d3cdeb09-7c07-4aac-8aee-4c28e488fbc8 tempest-CreateVolumesFromImageTest-1150243246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-69ac7a9a-32a0-44f6-beb7-9d76787802b0 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a540ecc5-4ce3-4c16-b916-f72113a982e7 tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b586e82-902d-4681-8ec1-2b3e7adc9a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fef4ded4-31f8-458e-83a4-2afaa037f927', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:13 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-69ac7a9a-32a0-44f6-beb7-9d76787802b0 1073741824 Jul 30 17:08:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a540ecc5-4ce3-4c16-b916-f72113a982e7 tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10d4d7c1-6d5a-4ff7-91e6-ff7af74eddda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:13 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:13 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-a540ecc5-4ce3-4c16-b916-f72113a982e7 tempest-VolumeDependencyTests-500709084 None] Volume volume-fef4ded4-31f8-458e-83a4-2afaa037f927 (fef4ded4-31f8-458e-83a4-2afaa037f927): created successfully Jul 30 17:08:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a540ecc5-4ce3-4c16-b916-f72113a982e7 tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10d4d7c1-6d5a-4ff7-91e6-ff7af74eddda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a540ecc5-4ce3-4c16-b916-f72113a982e7 tempest-VolumeDependencyTests-500709084 None] Flow 'volume_create_manager' (4efcba4c-0af9-4f5b-a88b-272e652e8098) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:08:13 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-a540ecc5-4ce3-4c16-b916-f72113a982e7 tempest-VolumeDependencyTests-500709084 None] Created volume successfully. Jul 30 17:08:14 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-78d98825-fa74-40e0-92e4-ac9e9d29cc81 tempest-CreateVolumesFromImageTest-1150243246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:08:14 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-78d98825-fa74-40e0-92e4-ac9e9d29cc81 tempest-CreateVolumesFromImageTest-1150243246 None] Flow 'volume_create_manager' (a85df26d-ae71-4cc4-9d76-52f69019b4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:08:14 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-78d98825-fa74-40e0-92e4-ac9e9d29cc81 tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4b741f1-6ac4-492e-9002-708aed5c15ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:14 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-78d98825-fa74-40e0-92e4-ac9e9d29cc81 tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4b741f1-6ac4-492e-9002-708aed5c15ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:08:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1342787641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c995ab8-4733-4fad-b334-90ec3fccf94b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4e5abb1c4d14a9389fa10c990f934eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:08:14Z,use_quota=True,user_id='9e2d3c45749d400fa0bbec9e6824d257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:14 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-78d98825-fa74-40e0-92e4-ac9e9d29cc81 tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fff1ff17-00e4-44d1-a476-4661d52e71b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:14 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-78d98825-fa74-40e0-92e4-ac9e9d29cc81 tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fff1ff17-00e4-44d1-a476-4661d52e71b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:14 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-78d98825-fa74-40e0-92e4-ac9e9d29cc81 tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0481eee-3647-4730-ba27-fe0ca9f94a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:14 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-78d98825-fa74-40e0-92e4-ac9e9d29cc81 tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0481eee-3647-4730-ba27-fe0ca9f94a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c995ab8-4733-4fad-b334-90ec3fccf94b', 'volume_name': 'volume-7c995ab8-4733-4fad-b334-90ec3fccf94b', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:14 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-78d98825-fa74-40e0-92e4-ac9e9d29cc81 tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85b50086-a3b3-4ef4-95c4-f2176c63e444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:14 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-78d98825-fa74-40e0-92e4-ac9e9d29cc81 tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85b50086-a3b3-4ef4-95c4-f2176c63e444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:14 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-78d98825-fa74-40e0-92e4-ac9e9d29cc81 tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bb95139-495b-4e20-b4c6-632deb7bcd86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:14 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-78d98825-fa74-40e0-92e4-ac9e9d29cc81 tempest-CreateVolumesFromImageTest-1150243246 None] Volume 7c995ab8-4733-4fad-b334-90ec3fccf94b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c995ab8-4733-4fad-b334-90ec3fccf94b', 'volume_size': 1} Jul 30 17:08:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-78d98825-fa74-40e0-92e4-ac9e9d29cc81 tempest-CreateVolumesFromImageTest-1150243246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:14 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d3cdeb09-7c07-4aac-8aee-4c28e488fbc8 tempest-CreateVolumesFromImageTest-1150243246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-69ac7a9a-32a0-44f6-beb7-9d76787802b0 1073741824" returned: 0 in 0.687s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d3cdeb09-7c07-4aac-8aee-4c28e488fbc8 tempest-CreateVolumesFromImageTest-1150243246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-69ac7a9a-32a0-44f6-beb7-9d76787802b0 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:14 devstack sudo[107440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-69ac7a9a-32a0-44f6-beb7-9d76787802b0 Jul 30 17:08:14 devstack sudo[107440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:14 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-45472597-dfa1-44f7-b51c-63c827a68c31 tempest-CreateVolumesFromImageTest-1150243246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:08:14 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-45472597-dfa1-44f7-b51c-63c827a68c31 tempest-CreateVolumesFromImageTest-1150243246 None] Flow 'volume_create_manager' (5739c0ec-9afe-4a8e-8b00-f9032d3e3f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:08:14 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-45472597-dfa1-44f7-b51c-63c827a68c31 tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c606b6a-53b6-4a71-a97e-01415fabe345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:14 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-45472597-dfa1-44f7-b51c-63c827a68c31 tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c606b6a-53b6-4a71-a97e-01415fabe345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:08:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1689617758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beedf04a-d029-4e08-9e63-4e36466e006a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4e5abb1c4d14a9389fa10c990f934eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:08:15Z,use_quota=True,user_id='9e2d3c45749d400fa0bbec9e6824d257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:14 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-45472597-dfa1-44f7-b51c-63c827a68c31 tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39831a1d-d968-4885-8fc9-31671925ed84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:14 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-45472597-dfa1-44f7-b51c-63c827a68c31 tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39831a1d-d968-4885-8fc9-31671925ed84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:14 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-45472597-dfa1-44f7-b51c-63c827a68c31 tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c14ae3a-f9cf-4f2b-8718-a2fbf54d4bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:14 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-45472597-dfa1-44f7-b51c-63c827a68c31 tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c14ae3a-f9cf-4f2b-8718-a2fbf54d4bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'beedf04a-d029-4e08-9e63-4e36466e006a', 'volume_name': 'volume-beedf04a-d029-4e08-9e63-4e36466e006a', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:14 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-45472597-dfa1-44f7-b51c-63c827a68c31 tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fa2b292-323c-4fb9-b0aa-a6023f4242b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:14 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-45472597-dfa1-44f7-b51c-63c827a68c31 tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fa2b292-323c-4fb9-b0aa-a6023f4242b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:14 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-45472597-dfa1-44f7-b51c-63c827a68c31 tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86f75b27-1013-47bc-8379-14b2d175fbb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:14 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-45472597-dfa1-44f7-b51c-63c827a68c31 tempest-CreateVolumesFromImageTest-1150243246 None] Volume beedf04a-d029-4e08-9e63-4e36466e006a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-beedf04a-d029-4e08-9e63-4e36466e006a', 'volume_size': 1} Jul 30 17:08:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-45472597-dfa1-44f7-b51c-63c827a68c31 tempest-CreateVolumesFromImageTest-1150243246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3962b1b3-65ec-4744-ad6b-215036ebe5f2 tempest-VolumeDependencyTests-500709084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:14 devstack sudo[107440]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d3cdeb09-7c07-4aac-8aee-4c28e488fbc8 tempest-CreateVolumesFromImageTest-1150243246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-69ac7a9a-32a0-44f6-beb7-9d76787802b0" returned: 0 in 0.404s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:14 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d3cdeb09-7c07-4aac-8aee-4c28e488fbc8 tempest-CreateVolumesFromImageTest-1150243246 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:08:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d3cdeb09-7c07-4aac-8aee-4c28e488fbc8 tempest-CreateVolumesFromImageTest-1150243246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-45a2daaa-ae9b-48eb-982a-60a723a89529 tempest-CreateVolumesFromImageTest-1150243246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.818s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:14 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-45a2daaa-ae9b-48eb-982a-60a723a89529 tempest-CreateVolumesFromImageTest-1150243246 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:08:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1066250172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1104d7c1-906d-4435-9a66-9c123f69af4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4e5abb1c4d14a9389fa10c990f934eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:08:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:08:13Z,use_quota=True,user_id='9e2d3c45749d400fa0bbec9e6824d257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:08:14 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-45a2daaa-ae9b-48eb-982a-60a723a89529 tempest-CreateVolumesFromImageTest-1150243246 None] Creating volume 1104d7c1-906d-4435-9a66-9c123f69af4b {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:08:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-45a2daaa-ae9b-48eb-982a-60a723a89529 tempest-CreateVolumesFromImageTest-1150243246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-45a2daaa-ae9b-48eb-982a-60a723a89529 tempest-CreateVolumesFromImageTest-1150243246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:14 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-45a2daaa-ae9b-48eb-982a-60a723a89529 tempest-CreateVolumesFromImageTest-1150243246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:08:14 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-45a2daaa-ae9b-48eb-982a-60a723a89529 tempest-CreateVolumesFromImageTest-1150243246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:08:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-45a2daaa-ae9b-48eb-982a-60a723a89529 tempest-CreateVolumesFromImageTest-1150243246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:14 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-45a2daaa-ae9b-48eb-982a-60a723a89529 tempest-CreateVolumesFromImageTest-1150243246 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:08:14 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-45a2daaa-ae9b-48eb-982a-60a723a89529 tempest-CreateVolumesFromImageTest-1150243246 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:08:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-45a2daaa-ae9b-48eb-982a-60a723a89529 tempest-CreateVolumesFromImageTest-1150243246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1104d7c1-906d-4435-9a66-9c123f69af4b 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:14 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d3cdeb09-7c07-4aac-8aee-4c28e488fbc8 tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18474c2a-57e1-4eaa-9382-cfa49ed75371) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69ac7a9a-32a0-44f6-beb7-9d76787802b0', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:14 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d3cdeb09-7c07-4aac-8aee-4c28e488fbc8 tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf7eb136-00d7-4f3d-965a-1f6223d2c5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:14 devstack sudo[107443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1104d7c1-906d-4435-9a66-9c123f69af4b 1073741824 Jul 30 17:08:15 devstack sudo[107443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:15 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-d3cdeb09-7c07-4aac-8aee-4c28e488fbc8 tempest-CreateVolumesFromImageTest-1150243246 None] Volume volume-69ac7a9a-32a0-44f6-beb7-9d76787802b0 (69ac7a9a-32a0-44f6-beb7-9d76787802b0): created successfully Jul 30 17:08:15 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d3cdeb09-7c07-4aac-8aee-4c28e488fbc8 tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf7eb136-00d7-4f3d-965a-1f6223d2c5a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:15 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d3cdeb09-7c07-4aac-8aee-4c28e488fbc8 tempest-CreateVolumesFromImageTest-1150243246 None] Flow 'volume_create_manager' (03671b4c-c48e-4de7-984d-53599afc3c81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:08:15 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-d3cdeb09-7c07-4aac-8aee-4c28e488fbc8 tempest-CreateVolumesFromImageTest-1150243246 None] Created volume successfully. Jul 30 17:08:15 devstack sudo[107443]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-45a2daaa-ae9b-48eb-982a-60a723a89529 tempest-CreateVolumesFromImageTest-1150243246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1104d7c1-906d-4435-9a66-9c123f69af4b 1073741824" returned: 0 in 0.555s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-45a2daaa-ae9b-48eb-982a-60a723a89529 tempest-CreateVolumesFromImageTest-1150243246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1104d7c1-906d-4435-9a66-9c123f69af4b {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:15 devstack sudo[107449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1104d7c1-906d-4435-9a66-9c123f69af4b Jul 30 17:08:15 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:15 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-45a2daaa-ae9b-48eb-982a-60a723a89529 tempest-CreateVolumesFromImageTest-1150243246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1104d7c1-906d-4435-9a66-9c123f69af4b" returned: 0 in 0.296s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:15 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-45a2daaa-ae9b-48eb-982a-60a723a89529 tempest-CreateVolumesFromImageTest-1150243246 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:08:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-45a2daaa-ae9b-48eb-982a-60a723a89529 tempest-CreateVolumesFromImageTest-1150243246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-bc8a2377-5e66-454b-81f6-63d5802daaef tempest-CreateVolumesFromImageTest-1150243246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.192s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:15 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-bc8a2377-5e66-454b-81f6-63d5802daaef tempest-CreateVolumesFromImageTest-1150243246 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-383997704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6ab38fb-e7a8-42d6-bfa6-2248242aacef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4e5abb1c4d14a9389fa10c990f934eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:08:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:08:13Z,use_quota=True,user_id='9e2d3c45749d400fa0bbec9e6824d257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:08:15 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-bc8a2377-5e66-454b-81f6-63d5802daaef tempest-CreateVolumesFromImageTest-1150243246 None] Creating volume f6ab38fb-e7a8-42d6-bfa6-2248242aacef {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:08:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-bc8a2377-5e66-454b-81f6-63d5802daaef tempest-CreateVolumesFromImageTest-1150243246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-bc8a2377-5e66-454b-81f6-63d5802daaef tempest-CreateVolumesFromImageTest-1150243246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:15 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-bc8a2377-5e66-454b-81f6-63d5802daaef tempest-CreateVolumesFromImageTest-1150243246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:08:15 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-bc8a2377-5e66-454b-81f6-63d5802daaef tempest-CreateVolumesFromImageTest-1150243246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:08:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-bc8a2377-5e66-454b-81f6-63d5802daaef tempest-CreateVolumesFromImageTest-1150243246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:15 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-bc8a2377-5e66-454b-81f6-63d5802daaef tempest-CreateVolumesFromImageTest-1150243246 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:08:15 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-bc8a2377-5e66-454b-81f6-63d5802daaef tempest-CreateVolumesFromImageTest-1150243246 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:08:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bc8a2377-5e66-454b-81f6-63d5802daaef tempest-CreateVolumesFromImageTest-1150243246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f6ab38fb-e7a8-42d6-bfa6-2248242aacef 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:15 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-45a2daaa-ae9b-48eb-982a-60a723a89529 tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (955bfb97-bfe8-41d7-96d3-12dacae8f222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1104d7c1-906d-4435-9a66-9c123f69af4b', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:15 devstack sudo[107452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f6ab38fb-e7a8-42d6-bfa6-2248242aacef 1073741824 Jul 30 17:08:15 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:15 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-45a2daaa-ae9b-48eb-982a-60a723a89529 tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ab0524a-ac53-4f6f-9d9b-852677f4c464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:15 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-45a2daaa-ae9b-48eb-982a-60a723a89529 tempest-CreateVolumesFromImageTest-1150243246 None] Volume volume-1104d7c1-906d-4435-9a66-9c123f69af4b (1104d7c1-906d-4435-9a66-9c123f69af4b): created successfully Jul 30 17:08:15 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-45a2daaa-ae9b-48eb-982a-60a723a89529 tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ab0524a-ac53-4f6f-9d9b-852677f4c464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:15 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-45a2daaa-ae9b-48eb-982a-60a723a89529 tempest-CreateVolumesFromImageTest-1150243246 None] Flow 'volume_create_manager' (8d76e57e-3fdc-44ef-a82c-b79b386698fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:08:15 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-45a2daaa-ae9b-48eb-982a-60a723a89529 tempest-CreateVolumesFromImageTest-1150243246 None] Created volume successfully. Jul 30 17:08:16 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:08:16 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] Flow 'volume_create_manager' (885cfd2c-3ccf-45d8-806e-81209f372b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:08:16 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9dfd955-f78c-4b7a-bfcd-487a39e1566e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:16 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9dfd955-f78c-4b7a-bfcd-487a39e1566e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:08:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a04709f-1150-4cc2-979c-ae5edda637f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f61df38a914ec2a6713104b0278991',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:08:16Z,use_quota=True,user_id='e4eedb818424482c9370625aced56a0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:16 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (176159d2-2e9f-4e74-8119-baa0007cbd10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:16 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (176159d2-2e9f-4e74-8119-baa0007cbd10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:16 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d3029a3-74c8-46f8-ae1a-40d5f5884d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:16 devstack cinder-volume[88591]: DEBUG cinder.image.glance [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] Creating Keystone auth plugin from conf {{(pid=88591) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 30 17:08:16 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:16 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bc8a2377-5e66-454b-81f6-63d5802daaef tempest-CreateVolumesFromImageTest-1150243246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f6ab38fb-e7a8-42d6-bfa6-2248242aacef 1073741824" returned: 0 in 0.575s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:16 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d3029a3-74c8-46f8-ae1a-40d5f5884d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3a04709f-1150-4cc2-979c-ae5edda637f5', 'volume_name': 'volume-3a04709f-1150-4cc2-979c-ae5edda637f5', 'volume_size': 1, 'image_id': '4c8023d6-6654-4cee-b1ac-ceb12f149d52', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4c8023d6-6654-4cee-b1ac-ceb12f149d52', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '137e3cb8d975bd19c36eebab1dae2d42', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '58f61df38a914ec2a6713104b0278991', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ab4e13db3bb3f652ec39d3b8b538d21f3b0fb9635bfca6dfe00c847f230f0fe33ce4770e6527427c2353291ba7887d3d79814b608720543eee894d1b04d539a2', 'id': '4c8023d6-6654-4cee-b1ac-ceb12f149d52', 'created_at': datetime.datetime(2026, 7, 30, 15, 8, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 15, 8, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c8023d6-6654-4cee-b1ac-ceb12f149d52/file', 'properties': {}}, 'image_service': }' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:16 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f23ca3d-575a-4197-8e37-4c882cebddca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:16 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f23ca3d-575a-4197-8e37-4c882cebddca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:16 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3b3b529-ed45-4e31-8b6f-eb0779af0eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:16 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] Volume 3a04709f-1150-4cc2-979c-ae5edda637f5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3a04709f-1150-4cc2-979c-ae5edda637f5', 'volume_size': 1, 'image_id': '4c8023d6-6654-4cee-b1ac-ceb12f149d52', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4c8023d6-6654-4cee-b1ac-ceb12f149d52', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '137e3cb8d975bd19c36eebab1dae2d42', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '58f61df38a914ec2a6713104b0278991', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ab4e13db3bb3f652ec39d3b8b538d21f3b0fb9635bfca6dfe00c847f230f0fe33ce4770e6527427c2353291ba7887d3d79814b608720543eee894d1b04d539a2', 'id': '4c8023d6-6654-4cee-b1ac-ceb12f149d52', 'created_at': datetime.datetime(2026, 7, 30, 15, 8, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 15, 8, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c8023d6-6654-4cee-b1ac-ceb12f149d52/file', 'properties': {}}, 'image_service': } Jul 30 17:08:16 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] Trying to clone 3a04709f-1150-4cc2-979c-ae5edda637f5 from image 4c8023d6-6654-4cee-b1ac-ceb12f149d52 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4c8023d6-6654-4cee-b1ac-ceb12f149d52', 'metadata': {}}]). {{(pid=88591) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 30 17:08:16 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bc8a2377-5e66-454b-81f6-63d5802daaef tempest-CreateVolumesFromImageTest-1150243246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f6ab38fb-e7a8-42d6-bfa6-2248242aacef {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:16 devstack sudo[107458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f6ab38fb-e7a8-42d6-bfa6-2248242aacef Jul 30 17:08:16 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:16 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4c8023d6-6654-4cee-b1ac-ceb12f149d52_8jhkojj4devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88591) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 30 17:08:16 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] Image download 0.00 MB at 0.00 MB/s Jul 30 17:08:16 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea46901-7211-4fa3-9190-356e55fea344]: (4, 'raw') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:08:16 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4c8023d6-6654-4cee-b1ac-ceb12f149d52_8jhkojj4devstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:16 devstack sudo[107460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4c8023d6-6654-4cee-b1ac-ceb12f149d52_8jhkojj4devstack@QuobyteHD Jul 30 17:08:16 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:16 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:16 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bc8a2377-5e66-454b-81f6-63d5802daaef tempest-CreateVolumesFromImageTest-1150243246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f6ab38fb-e7a8-42d6-bfa6-2248242aacef" returned: 0 in 0.295s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:16 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-bc8a2377-5e66-454b-81f6-63d5802daaef tempest-CreateVolumesFromImageTest-1150243246 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:08:16 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-bc8a2377-5e66-454b-81f6-63d5802daaef tempest-CreateVolumesFromImageTest-1150243246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:16 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-78d98825-fa74-40e0-92e4-ac9e9d29cc81 tempest-CreateVolumesFromImageTest-1150243246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.586s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:16 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-78d98825-fa74-40e0-92e4-ac9e9d29cc81 tempest-CreateVolumesFromImageTest-1150243246 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:08:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1342787641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c995ab8-4733-4fad-b334-90ec3fccf94b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4e5abb1c4d14a9389fa10c990f934eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:08:14Z,use_quota=True,user_id='9e2d3c45749d400fa0bbec9e6824d257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:08:16 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-78d98825-fa74-40e0-92e4-ac9e9d29cc81 tempest-CreateVolumesFromImageTest-1150243246 None] Creating volume 7c995ab8-4733-4fad-b334-90ec3fccf94b {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:08:16 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-78d98825-fa74-40e0-92e4-ac9e9d29cc81 tempest-CreateVolumesFromImageTest-1150243246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:16 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-78d98825-fa74-40e0-92e4-ac9e9d29cc81 tempest-CreateVolumesFromImageTest-1150243246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:16 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-78d98825-fa74-40e0-92e4-ac9e9d29cc81 tempest-CreateVolumesFromImageTest-1150243246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:08:16 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-78d98825-fa74-40e0-92e4-ac9e9d29cc81 tempest-CreateVolumesFromImageTest-1150243246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:08:16 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-78d98825-fa74-40e0-92e4-ac9e9d29cc81 tempest-CreateVolumesFromImageTest-1150243246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:16 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-78d98825-fa74-40e0-92e4-ac9e9d29cc81 tempest-CreateVolumesFromImageTest-1150243246 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:08:16 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-78d98825-fa74-40e0-92e4-ac9e9d29cc81 tempest-CreateVolumesFromImageTest-1150243246 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:08:16 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-78d98825-fa74-40e0-92e4-ac9e9d29cc81 tempest-CreateVolumesFromImageTest-1150243246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-7c995ab8-4733-4fad-b334-90ec3fccf94b 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:16 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bc8a2377-5e66-454b-81f6-63d5802daaef tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09e9bb4f-d940-4555-b5f2-c9200aca78bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6ab38fb-e7a8-42d6-bfa6-2248242aacef', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:16 devstack sudo[107463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-7c995ab8-4733-4fad-b334-90ec3fccf94b 1073741824 Jul 30 17:08:16 devstack sudo[107463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:16 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bc8a2377-5e66-454b-81f6-63d5802daaef tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5892d73a-af03-49be-9f71-74da5914b331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:16 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-bc8a2377-5e66-454b-81f6-63d5802daaef tempest-CreateVolumesFromImageTest-1150243246 None] Volume volume-f6ab38fb-e7a8-42d6-bfa6-2248242aacef (f6ab38fb-e7a8-42d6-bfa6-2248242aacef): created successfully Jul 30 17:08:16 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bc8a2377-5e66-454b-81f6-63d5802daaef tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5892d73a-af03-49be-9f71-74da5914b331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:16 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bc8a2377-5e66-454b-81f6-63d5802daaef tempest-CreateVolumesFromImageTest-1150243246 None] Flow 'volume_create_manager' (eefb29cf-2e6c-4f5b-887b-8b5b7fde7bb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:08:16 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-bc8a2377-5e66-454b-81f6-63d5802daaef tempest-CreateVolumesFromImageTest-1150243246 None] Created volume successfully. Jul 30 17:08:17 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4c8023d6-6654-4cee-b1ac-ceb12f149d52_8jhkojj4devstack@QuobyteHD" returned: 0 in 0.502s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4c8023d6-6654-4cee-b1ac-ceb12f149d52_8jhkojj4devstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:17 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:08:17 devstack sudo[107469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4c8023d6-6654-4cee-b1ac-ceb12f149d52_8jhkojj4devstack@QuobyteHD Jul 30 17:08:17 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:17 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Flow 'volume_create_manager' (516f3d01-dcd5-43a6-b2d4-cde3820bcff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:08:17 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36737365-1c64-4b89-aafb-5a21e16b1d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:17 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36737365-1c64-4b89-aafb-5a21e16b1d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fe38d45-aa91-48de-9dca-8ba9b1efa668,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1dd9b585664431bb7bb37c711b54a5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:08:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:08:17Z,use_quota=True,user_id='98bed34f2e0540858c14d6048cb06400',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1324257f-2b2d-4631-bedf-53425748d588),volume_type_id=1324257f-2b2d-4631-bedf-53425748d588)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:17 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd7fa32b-267c-49f5-b37b-203664384a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:17 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd7fa32b-267c-49f5-b37b-203664384a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:17 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6076276e-85e9-4538-9dec-57091f3de496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:17 devstack cinder-volume[88591]: DEBUG cinder.image.glance [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Creating Keystone auth plugin from conf {{(pid=88591) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 30 17:08:17 devstack sudo[107463]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-78d98825-fa74-40e0-92e4-ac9e9d29cc81 tempest-CreateVolumesFromImageTest-1150243246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-7c995ab8-4733-4fad-b334-90ec3fccf94b 1073741824" returned: 0 in 0.548s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-78d98825-fa74-40e0-92e4-ac9e9d29cc81 tempest-CreateVolumesFromImageTest-1150243246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-7c995ab8-4733-4fad-b334-90ec3fccf94b {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:17 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-7c995ab8-4733-4fad-b334-90ec3fccf94b Jul 30 17:08:17 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:17 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4c8023d6-6654-4cee-b1ac-ceb12f149d52_8jhkojj4devstack@QuobyteHD" returned: 1 in 0.405s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4c8023d6-6654-4cee-b1ac-ceb12f149d52_8jhkojj4devstack@QuobyteHD' failed. Not Retrying. {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 17:08:17 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] Temporary image 4c8023d6-6654-4cee-b1ac-ceb12f149d52 is fetched for user e4eedb818424482c9370625aced56a0a. {{(pid=88591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 30 17:08:17 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6076276e-85e9-4538-9dec-57091f3de496) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0fe38d45-aa91-48de-9dca-8ba9b1efa668', 'volume_name': 'volume-0fe38d45-aa91-48de-9dca-8ba9b1efa668', 'volume_size': 1, 'image_id': '435c9708-bf16-4c4a-b476-4896ceecdca9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/435c9708-bf16-4c4a-b476-4896ceecdca9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a20d1da091f7b48713e28ae47a114f96', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b1dd9b585664431bb7bb37c711b54a5f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a35d85ead63f97941a9ae098282d47bd68b16a0101b7c2cc86976042c5284cdbb8d6e1c5f74ad654d91e2199da063c56bf1d7d09f00f074190bd7a32c3659f92', 'id': '435c9708-bf16-4c4a-b476-4896ceecdca9', 'created_at': datetime.datetime(2026, 7, 30, 15, 8, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 15, 8, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/435c9708-bf16-4c4a-b476-4896ceecdca9/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:17 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a610fd20-7fc4-4379-b39d-3be4a5b3a730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:17 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a610fd20-7fc4-4379-b39d-3be4a5b3a730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:17 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fca67384-77d8-4d04-8f30-3f829bdefb1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:17 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Volume 0fe38d45-aa91-48de-9dca-8ba9b1efa668: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0fe38d45-aa91-48de-9dca-8ba9b1efa668', 'volume_size': 1, 'image_id': '435c9708-bf16-4c4a-b476-4896ceecdca9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/435c9708-bf16-4c4a-b476-4896ceecdca9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a20d1da091f7b48713e28ae47a114f96', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b1dd9b585664431bb7bb37c711b54a5f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a35d85ead63f97941a9ae098282d47bd68b16a0101b7c2cc86976042c5284cdbb8d6e1c5f74ad654d91e2199da063c56bf1d7d09f00f074190bd7a32c3659f92', 'id': '435c9708-bf16-4c4a-b476-4896ceecdca9', 'created_at': datetime.datetime(2026, 7, 30, 15, 8, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 15, 8, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/435c9708-bf16-4c4a-b476-4896ceecdca9/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 30 17:08:17 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Trying to clone 0fe38d45-aa91-48de-9dca-8ba9b1efa668 from image 435c9708-bf16-4c4a-b476-4896ceecdca9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/435c9708-bf16-4c4a-b476-4896ceecdca9', 'metadata': {}}]). {{(pid=88591) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 30 17:08:17 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[25571ca6-c09d-42e1-a323-0c82574f1fb8]: (4, 'raw') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:08:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4c8023d6-6654-4cee-b1ac-ceb12f149d52_8jhkojj4devstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:17 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-78d98825-fa74-40e0-92e4-ac9e9d29cc81 tempest-CreateVolumesFromImageTest-1150243246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-7c995ab8-4733-4fad-b334-90ec3fccf94b" returned: 0 in 0.268s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:17 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-78d98825-fa74-40e0-92e4-ac9e9d29cc81 tempest-CreateVolumesFromImageTest-1150243246 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:08:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-78d98825-fa74-40e0-92e4-ac9e9d29cc81 tempest-CreateVolumesFromImageTest-1150243246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-45472597-dfa1-44f7-b51c-63c827a68c31 tempest-CreateVolumesFromImageTest-1150243246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.897s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:17 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-45472597-dfa1-44f7-b51c-63c827a68c31 tempest-CreateVolumesFromImageTest-1150243246 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:08:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1689617758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beedf04a-d029-4e08-9e63-4e36466e006a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4e5abb1c4d14a9389fa10c990f934eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:08:15Z,use_quota=True,user_id='9e2d3c45749d400fa0bbec9e6824d257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:08:17 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-45472597-dfa1-44f7-b51c-63c827a68c31 tempest-CreateVolumesFromImageTest-1150243246 None] Creating volume beedf04a-d029-4e08-9e63-4e36466e006a {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:08:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-45472597-dfa1-44f7-b51c-63c827a68c31 tempest-CreateVolumesFromImageTest-1150243246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-45472597-dfa1-44f7-b51c-63c827a68c31 tempest-CreateVolumesFromImageTest-1150243246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:17 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-45472597-dfa1-44f7-b51c-63c827a68c31 tempest-CreateVolumesFromImageTest-1150243246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:08:17 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-45472597-dfa1-44f7-b51c-63c827a68c31 tempest-CreateVolumesFromImageTest-1150243246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:08:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-45472597-dfa1-44f7-b51c-63c827a68c31 tempest-CreateVolumesFromImageTest-1150243246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:17 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-45472597-dfa1-44f7-b51c-63c827a68c31 tempest-CreateVolumesFromImageTest-1150243246 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:08:17 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-45472597-dfa1-44f7-b51c-63c827a68c31 tempest-CreateVolumesFromImageTest-1150243246 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:08:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-45472597-dfa1-44f7-b51c-63c827a68c31 tempest-CreateVolumesFromImageTest-1150243246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-beedf04a-d029-4e08-9e63-4e36466e006a 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:17 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_435c9708-bf16-4c4a-b476-4896ceecdca9_rl3tfizmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88591) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 30 17:08:17 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Image download 0.00 MB at 0.00 MB/s Jul 30 17:08:17 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-78d98825-fa74-40e0-92e4-ac9e9d29cc81 tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bb95139-495b-4e20-b4c6-632deb7bcd86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c995ab8-4733-4fad-b334-90ec3fccf94b', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:17 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-78d98825-fa74-40e0-92e4-ac9e9d29cc81 tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8de76b5a-4065-4d76-83b3-f114b71ef665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:17 devstack sudo[107480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-beedf04a-d029-4e08-9e63-4e36466e006a 1073741824 Jul 30 17:08:17 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:17 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-78d98825-fa74-40e0-92e4-ac9e9d29cc81 tempest-CreateVolumesFromImageTest-1150243246 None] Volume volume-7c995ab8-4733-4fad-b334-90ec3fccf94b (7c995ab8-4733-4fad-b334-90ec3fccf94b): created successfully Jul 30 17:08:17 devstack sudo[107479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4c8023d6-6654-4cee-b1ac-ceb12f149d52_8jhkojj4devstack@QuobyteHD Jul 30 17:08:17 devstack sudo[107479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:17 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-78d98825-fa74-40e0-92e4-ac9e9d29cc81 tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8de76b5a-4065-4d76-83b3-f114b71ef665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:17 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-78d98825-fa74-40e0-92e4-ac9e9d29cc81 tempest-CreateVolumesFromImageTest-1150243246 None] Flow 'volume_create_manager' (a85df26d-ae71-4cc4-9d76-52f69019b4bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:08:17 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-78d98825-fa74-40e0-92e4-ac9e9d29cc81 tempest-CreateVolumesFromImageTest-1150243246 None] Created volume successfully. Jul 30 17:08:17 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4093bc-e3cc-4589-a1dc-c8d533f3ab37]: (4, 'raw') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:08:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_435c9708-bf16-4c4a-b476-4896ceecdca9_rl3tfizmdevstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:17 devstack sudo[107483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_435c9708-bf16-4c4a-b476-4896ceecdca9_rl3tfizmdevstack@QuobyteHD Jul 30 17:08:17 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:18 devstack sudo[107479]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4c8023d6-6654-4cee-b1ac-ceb12f149d52_8jhkojj4devstack@QuobyteHD" returned: 0 in 0.420s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4c8023d6-6654-4cee-b1ac-ceb12f149d52_8jhkojj4devstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:18 devstack sudo[107490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4c8023d6-6654-4cee-b1ac-ceb12f149d52_8jhkojj4devstack@QuobyteHD Jul 30 17:08:18 devstack sudo[107490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:18 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_435c9708-bf16-4c4a-b476-4896ceecdca9_rl3tfizmdevstack@QuobyteHD" returned: 0 in 0.388s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_435c9708-bf16-4c4a-b476-4896ceecdca9_rl3tfizmdevstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:18 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-45472597-dfa1-44f7-b51c-63c827a68c31 tempest-CreateVolumesFromImageTest-1150243246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-beedf04a-d029-4e08-9e63-4e36466e006a 1073741824" returned: 0 in 0.566s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-45472597-dfa1-44f7-b51c-63c827a68c31 tempest-CreateVolumesFromImageTest-1150243246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-beedf04a-d029-4e08-9e63-4e36466e006a {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:18 devstack sudo[107494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_435c9708-bf16-4c4a-b476-4896ceecdca9_rl3tfizmdevstack@QuobyteHD Jul 30 17:08:18 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:18 devstack sudo[107496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-beedf04a-d029-4e08-9e63-4e36466e006a Jul 30 17:08:18 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:18 devstack sudo[107490]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4c8023d6-6654-4cee-b1ac-ceb12f149d52_8jhkojj4devstack@QuobyteHD" returned: 1 in 0.358s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4c8023d6-6654-4cee-b1ac-ceb12f149d52_8jhkojj4devstack@QuobyteHD' failed. Not Retrying. {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 17:08:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:18 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_435c9708-bf16-4c4a-b476-4896ceecdca9_rl3tfizmdevstack@QuobyteHD" returned: 1 in 0.344s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_435c9708-bf16-4c4a-b476-4896ceecdca9_rl3tfizmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 17:08:18 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Temporary image 435c9708-bf16-4c4a-b476-4896ceecdca9 is fetched for user 98bed34f2e0540858c14d6048cb06400. {{(pid=88591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 30 17:08:18 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-45472597-dfa1-44f7-b51c-63c827a68c31 tempest-CreateVolumesFromImageTest-1150243246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-beedf04a-d029-4e08-9e63-4e36466e006a" returned: 0 in 0.266s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:18 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-45472597-dfa1-44f7-b51c-63c827a68c31 tempest-CreateVolumesFromImageTest-1150243246 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:08:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-45472597-dfa1-44f7-b51c-63c827a68c31 tempest-CreateVolumesFromImageTest-1150243246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3962b1b3-65ec-4744-ad6b-215036ebe5f2 tempest-VolumeDependencyTests-500709084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.658s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:18 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-45472597-dfa1-44f7-b51c-63c827a68c31 tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86f75b27-1013-47bc-8379-14b2d175fbb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beedf04a-d029-4e08-9e63-4e36466e006a', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:18 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-45472597-dfa1-44f7-b51c-63c827a68c31 tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a818092-c043-4e36-a288-9b36421bb73e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:18 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-3962b1b3-65ec-4744-ad6b-215036ebe5f2 tempest-VolumeDependencyTests-500709084 None] Creating offline snapshot bbc6cbe5-cc39-4825-a916-e0c5bf466d4d of volume fef4ded4-31f8-458e-83a4-2afaa037f927 {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:08:18 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-45472597-dfa1-44f7-b51c-63c827a68c31 tempest-CreateVolumesFromImageTest-1150243246 None] Volume volume-beedf04a-d029-4e08-9e63-4e36466e006a (beedf04a-d029-4e08-9e63-4e36466e006a): created successfully Jul 30 17:08:18 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-45472597-dfa1-44f7-b51c-63c827a68c31 tempest-CreateVolumesFromImageTest-1150243246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a818092-c043-4e36-a288-9b36421bb73e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:18 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-45472597-dfa1-44f7-b51c-63c827a68c31 tempest-CreateVolumesFromImageTest-1150243246 None] Flow 'volume_create_manager' (5739c0ec-9afe-4a8e-8b00-f9032d3e3f00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:08:18 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d02f6d-fd96-456d-93e9-7fe1cdd8c0a0]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:08:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3962b1b3-65ec-4744-ad6b-215036ebe5f2 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef4ded4-31f8-458e-83a4-2afaa037f927 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:18 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3f578b-85ce-4c49-82e4-2155402e438d]: (4, 'raw') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:08:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_435c9708-bf16-4c4a-b476-4896ceecdca9_rl3tfizmdevstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:18 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-45472597-dfa1-44f7-b51c-63c827a68c31 tempest-CreateVolumesFromImageTest-1150243246 None] Created volume successfully. Jul 30 17:08:18 devstack sudo[107506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef4ded4-31f8-458e-83a4-2afaa037f927 Jul 30 17:08:18 devstack sudo[107506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:18 devstack sudo[107507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_435c9708-bf16-4c4a-b476-4896ceecdca9_rl3tfizmdevstack@QuobyteHD Jul 30 17:08:18 devstack sudo[107507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:18 devstack sudo[107507]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_435c9708-bf16-4c4a-b476-4896ceecdca9_rl3tfizmdevstack@QuobyteHD" returned: 0 in 0.338s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_435c9708-bf16-4c4a-b476-4896ceecdca9_rl3tfizmdevstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:19 devstack sudo[107506]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3962b1b3-65ec-4744-ad6b-215036ebe5f2 tempest-VolumeDependencyTests-500709084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef4ded4-31f8-458e-83a4-2afaa037f927" returned: 0 in 0.380s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3962b1b3-65ec-4744-ad6b-215036ebe5f2 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef4ded4-31f8-458e-83a4-2afaa037f927,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef4ded4-31f8-458e-83a4-2afaa037f927.bbc6cbe5-cc39-4825-a916-e0c5bf466d4d 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:19 devstack sudo[107516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef4ded4-31f8-458e-83a4-2afaa037f927,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef4ded4-31f8-458e-83a4-2afaa037f927.bbc6cbe5-cc39-4825-a916-e0c5bf466d4d 1G Jul 30 17:08:19 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:19 devstack sudo[107515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_435c9708-bf16-4c4a-b476-4896ceecdca9_rl3tfizmdevstack@QuobyteHD Jul 30 17:08:19 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:19 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-cb8c8881-2867-48d7-bd00-c0bb5031f348 tempest-CreateVolumesFromImageTest-1150243246 None] Acquiring lock "cinder-beedf04a-d029-4e08-9e63-4e36466e006a-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:08:19 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-cb8c8881-2867-48d7-bd00-c0bb5031f348 tempest-CreateVolumesFromImageTest-1150243246 None] Lock "cinder-beedf04a-d029-4e08-9e63-4e36466e006a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:08:19 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-cb8c8881-2867-48d7-bd00-c0bb5031f348 tempest-CreateVolumesFromImageTest-1150243246 None] Acquiring lock "cinder-quobyte-beedf04a-d029-4e08-9e63-4e36466e006a" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:08:19 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-cb8c8881-2867-48d7-bd00-c0bb5031f348 tempest-CreateVolumesFromImageTest-1150243246 None] Lock "cinder-quobyte-beedf04a-d029-4e08-9e63-4e36466e006a" acquired by "delete_volume" :: waited 0.016s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:08:19 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ecfe878-20c3-4c68-a337-0a3b0cb9f54a]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:08:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cb8c8881-2867-48d7-bd00-c0bb5031f348 tempest-CreateVolumesFromImageTest-1150243246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-beedf04a-d029-4e08-9e63-4e36466e006a {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:19 devstack sudo[107519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-beedf04a-d029-4e08-9e63-4e36466e006a Jul 30 17:08:19 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:19 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_435c9708-bf16-4c4a-b476-4896ceecdca9_rl3tfizmdevstack@QuobyteHD" returned: 1 in 0.430s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_435c9708-bf16-4c4a-b476-4896ceecdca9_rl3tfizmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 17:08:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:19 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3962b1b3-65ec-4744-ad6b-215036ebe5f2 tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef4ded4-31f8-458e-83a4-2afaa037f927,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef4ded4-31f8-458e-83a4-2afaa037f927.bbc6cbe5-cc39-4825-a916-e0c5bf466d4d 1G" returned: 0 in 0.495s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3962b1b3-65ec-4744-ad6b-215036ebe5f2 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fef4ded4-31f8-458e-83a4-2afaa037f927 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef4ded4-31f8-458e-83a4-2afaa037f927.bbc6cbe5-cc39-4825-a916-e0c5bf466d4d {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:19 devstack sudo[107527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fef4ded4-31f8-458e-83a4-2afaa037f927 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef4ded4-31f8-458e-83a4-2afaa037f927.bbc6cbe5-cc39-4825-a916-e0c5bf466d4d Jul 30 17:08:19 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:19 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cb8c8881-2867-48d7-bd00-c0bb5031f348 tempest-CreateVolumesFromImageTest-1150243246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-beedf04a-d029-4e08-9e63-4e36466e006a" returned: 0 in 0.368s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cb8c8881-2867-48d7-bd00-c0bb5031f348 tempest-CreateVolumesFromImageTest-1150243246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-beedf04a-d029-4e08-9e63-4e36466e006a {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:19 devstack sudo[107532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-beedf04a-d029-4e08-9e63-4e36466e006a Jul 30 17:08:19 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:19 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3962b1b3-65ec-4744-ad6b-215036ebe5f2 tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fef4ded4-31f8-458e-83a4-2afaa037f927 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef4ded4-31f8-458e-83a4-2afaa037f927.bbc6cbe5-cc39-4825-a916-e0c5bf466d4d" returned: 0 in 0.299s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:19 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-3962b1b3-65ec-4744-ad6b-215036ebe5f2 tempest-VolumeDependencyTests-500709084 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef4ded4-31f8-458e-83a4-2afaa037f927.bbc6cbe5-cc39-4825-a916-e0c5bf466d4d is being set with open permissions: ugo+rw Jul 30 17:08:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3962b1b3-65ec-4744-ad6b-215036ebe5f2 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef4ded4-31f8-458e-83a4-2afaa037f927.bbc6cbe5-cc39-4825-a916-e0c5bf466d4d {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:19 devstack sudo[107537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef4ded4-31f8-458e-83a4-2afaa037f927.bbc6cbe5-cc39-4825-a916-e0c5bf466d4d Jul 30 17:08:19 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:19 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cb8c8881-2867-48d7-bd00-c0bb5031f348 tempest-CreateVolumesFromImageTest-1150243246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-beedf04a-d029-4e08-9e63-4e36466e006a" returned: 0 in 0.242s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:19 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-cb8c8881-2867-48d7-bd00-c0bb5031f348 tempest-CreateVolumesFromImageTest-1150243246 None] Lock "cinder-quobyte-beedf04a-d029-4e08-9e63-4e36466e006a" released by "delete_volume" :: held 0.659s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:08:19 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-cb8c8881-2867-48d7-bd00-c0bb5031f348 tempest-CreateVolumesFromImageTest-1150243246 None] Created reservations ['c5eb49b8-b0ec-4ad9-9cab-e574a8c3e7b3', '197e1e7e-8df0-41a4-9bc1-6defb7c64e80', 'b53ed5a4-e6d1-4d90-addb-70b4153f9ff3', 'eb84a66c-a514-4d39-80ba-1667d59a17a8'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:08:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-cb8c8881-2867-48d7-bd00-c0bb5031f348 tempest-CreateVolumesFromImageTest-1150243246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-cb8c8881-2867-48d7-bd00-c0bb5031f348 tempest-CreateVolumesFromImageTest-1150243246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:20 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-cb8c8881-2867-48d7-bd00-c0bb5031f348 tempest-CreateVolumesFromImageTest-1150243246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:08:20 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-cb8c8881-2867-48d7-bd00-c0bb5031f348 tempest-CreateVolumesFromImageTest-1150243246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:08:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-cb8c8881-2867-48d7-bd00-c0bb5031f348 tempest-CreateVolumesFromImageTest-1150243246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cb8c8881-2867-48d7-bd00-c0bb5031f348 tempest-CreateVolumesFromImageTest-1150243246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:20 devstack sudo[107541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:08:20 devstack sudo[107541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:20 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3962b1b3-65ec-4744-ad6b-215036ebe5f2 tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef4ded4-31f8-458e-83a4-2afaa037f927.bbc6cbe5-cc39-4825-a916-e0c5bf466d4d" returned: 0 in 0.274s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3962b1b3-65ec-4744-ad6b-215036ebe5f2 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef4ded4-31f8-458e-83a4-2afaa037f927.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:20 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef4ded4-31f8-458e-83a4-2afaa037f927.info Jul 30 17:08:20 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:20 devstack sudo[107541]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cb8c8881-2867-48d7-bd00-c0bb5031f348 tempest-CreateVolumesFromImageTest-1150243246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.269s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:20 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-cb8c8881-2867-48d7-bd00-c0bb5031f348 tempest-CreateVolumesFromImageTest-1150243246 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:08:20 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-cb8c8881-2867-48d7-bd00-c0bb5031f348 tempest-CreateVolumesFromImageTest-1150243246 None] Deleted volume successfully. Jul 30 17:08:20 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-cb8c8881-2867-48d7-bd00-c0bb5031f348 tempest-CreateVolumesFromImageTest-1150243246 None] Lock "cinder-beedf04a-d029-4e08-9e63-4e36466e006a-delete_volume" released by "delete_volume" :: held 1.147s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:08:20 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-006bb488-46f6-4a36-8f86-85a30973673a tempest-CreateVolumesFromImageTest-1150243246 None] Acquiring lock "cinder-7c995ab8-4733-4fad-b334-90ec3fccf94b-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:08:20 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:20 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-006bb488-46f6-4a36-8f86-85a30973673a tempest-CreateVolumesFromImageTest-1150243246 None] Lock "cinder-7c995ab8-4733-4fad-b334-90ec3fccf94b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:08:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3962b1b3-65ec-4744-ad6b-215036ebe5f2 tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef4ded4-31f8-458e-83a4-2afaa037f927.info" returned: 0 in 0.307s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:20 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-3962b1b3-65ec-4744-ad6b-215036ebe5f2 tempest-VolumeDependencyTests-500709084 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef4ded4-31f8-458e-83a4-2afaa037f927.info is being set with open permissions: ugo+rw Jul 30 17:08:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3962b1b3-65ec-4744-ad6b-215036ebe5f2 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef4ded4-31f8-458e-83a4-2afaa037f927.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:20 devstack sudo[107547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef4ded4-31f8-458e-83a4-2afaa037f927.info Jul 30 17:08:20 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:20 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-006bb488-46f6-4a36-8f86-85a30973673a tempest-CreateVolumesFromImageTest-1150243246 None] Acquiring lock "cinder-quobyte-7c995ab8-4733-4fad-b334-90ec3fccf94b" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:08:20 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-006bb488-46f6-4a36-8f86-85a30973673a tempest-CreateVolumesFromImageTest-1150243246 None] Lock "cinder-quobyte-7c995ab8-4733-4fad-b334-90ec3fccf94b" acquired by "delete_volume" :: waited 0.018s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:08:20 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d5df73-a308-4022-8fef-5964a99d9019]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:08:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-006bb488-46f6-4a36-8f86-85a30973673a tempest-CreateVolumesFromImageTest-1150243246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-7c995ab8-4733-4fad-b334-90ec3fccf94b {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:20 devstack sudo[107549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-7c995ab8-4733-4fad-b334-90ec3fccf94b Jul 30 17:08:20 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:20 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3962b1b3-65ec-4744-ad6b-215036ebe5f2 tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef4ded4-31f8-458e-83a4-2afaa037f927.info" returned: 0 in 0.251s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3962b1b3-65ec-4744-ad6b-215036ebe5f2 tempest-VolumeDependencyTests-500709084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.138s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.296s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:20 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:08:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a04709f-1150-4cc2-979c-ae5edda637f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f61df38a914ec2a6713104b0278991',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:08:16Z,use_quota=True,user_id='e4eedb818424482c9370625aced56a0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:08:20 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] Creating volume 3a04709f-1150-4cc2-979c-ae5edda637f5 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:08:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:20 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:08:20 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:08:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:20 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:08:20 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:08:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3a04709f-1150-4cc2-979c-ae5edda637f5 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:20 devstack sudo[107552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3a04709f-1150-4cc2-979c-ae5edda637f5 1073741824 Jul 30 17:08:20 devstack sudo[107552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:20 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-3962b1b3-65ec-4744-ad6b-215036ebe5f2 tempest-VolumeDependencyTests-500709084 None] Create snapshot completed successfully Jul 30 17:08:20 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-006bb488-46f6-4a36-8f86-85a30973673a tempest-CreateVolumesFromImageTest-1150243246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-7c995ab8-4733-4fad-b334-90ec3fccf94b" returned: 0 in 0.370s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-006bb488-46f6-4a36-8f86-85a30973673a tempest-CreateVolumesFromImageTest-1150243246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-7c995ab8-4733-4fad-b334-90ec3fccf94b {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:20 devstack sudo[107557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-7c995ab8-4733-4fad-b334-90ec3fccf94b Jul 30 17:08:20 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:21 devstack sudo[107552]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3a04709f-1150-4cc2-979c-ae5edda637f5 1073741824" returned: 0 in 0.434s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:21 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-006bb488-46f6-4a36-8f86-85a30973673a tempest-CreateVolumesFromImageTest-1150243246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-7c995ab8-4733-4fad-b334-90ec3fccf94b" returned: 0 in 0.254s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:21 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-006bb488-46f6-4a36-8f86-85a30973673a tempest-CreateVolumesFromImageTest-1150243246 None] Lock "cinder-quobyte-7c995ab8-4733-4fad-b334-90ec3fccf94b" released by "delete_volume" :: held 0.669s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:08:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3a04709f-1150-4cc2-979c-ae5edda637f5 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:21 devstack sudo[107563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3a04709f-1150-4cc2-979c-ae5edda637f5 Jul 30 17:08:21 devstack sudo[107563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:21 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-006bb488-46f6-4a36-8f86-85a30973673a tempest-CreateVolumesFromImageTest-1150243246 None] Created reservations ['08dc26c9-4b43-48d9-88d7-23b837e6ff3f', 'bf24252d-7abc-4e47-8c7e-53a8129d7824', '67343d56-7be3-42d7-9f4c-ad31d03d08e4', 'd2e307b9-418b-41ed-895b-07ebbf86e83b'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:08:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-006bb488-46f6-4a36-8f86-85a30973673a tempest-CreateVolumesFromImageTest-1150243246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-006bb488-46f6-4a36-8f86-85a30973673a tempest-CreateVolumesFromImageTest-1150243246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:21 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-006bb488-46f6-4a36-8f86-85a30973673a tempest-CreateVolumesFromImageTest-1150243246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:08:21 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-006bb488-46f6-4a36-8f86-85a30973673a tempest-CreateVolumesFromImageTest-1150243246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:08:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-006bb488-46f6-4a36-8f86-85a30973673a tempest-CreateVolumesFromImageTest-1150243246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-006bb488-46f6-4a36-8f86-85a30973673a tempest-CreateVolumesFromImageTest-1150243246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:21 devstack sudo[107565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:08:21 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:21 devstack sudo[107563]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3a04709f-1150-4cc2-979c-ae5edda637f5" returned: 0 in 0.306s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:21 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:08:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.089s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:21 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fe38d45-aa91-48de-9dca-8ba9b1efa668,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1dd9b585664431bb7bb37c711b54a5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:08:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:08:17Z,use_quota=True,user_id='98bed34f2e0540858c14d6048cb06400',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1324257f-2b2d-4631-bedf-53425748d588),volume_type_id=1324257f-2b2d-4631-bedf-53425748d588)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:08:21 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Creating volume 0fe38d45-aa91-48de-9dca-8ba9b1efa668 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:08:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:21 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:08:21 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:08:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:21 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:08:21 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:08:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0fe38d45-aa91-48de-9dca-8ba9b1efa668 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:21 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0fe38d45-aa91-48de-9dca-8ba9b1efa668 1073741824 Jul 30 17:08:21 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:21 devstack cinder-volume[88591]: DEBUG cinder.volume.volume_utils [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] Attempting download of 4c8023d6-6654-4cee-b1ac-ceb12f149d52 ((None, [{'url': 'file:///opt/stack/data/glance/images/4c8023d6-6654-4cee-b1ac-ceb12f149d52', 'metadata': {}}])) to volume 3a04709f-1150-4cc2-979c-ae5edda637f5. {{(pid=88591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 30 17:08:21 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7da73824-6066-4e96-b073-626181857980 tempest-CreateVolumesFromImageTest-1150243246 None] Acquiring lock "cinder-f6ab38fb-e7a8-42d6-bfa6-2248242aacef-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:08:21 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7da73824-6066-4e96-b073-626181857980 tempest-CreateVolumesFromImageTest-1150243246 None] Lock "cinder-f6ab38fb-e7a8-42d6-bfa6-2248242aacef-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:08:21 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:21 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa992e26-25f4-49da-afdf-834d5a936e24]: (4, 'raw') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:08:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4c8023d6-6654-4cee-b1ac-ceb12f149d52_3tn3zv_0 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:21 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7da73824-6066-4e96-b073-626181857980 tempest-CreateVolumesFromImageTest-1150243246 None] Acquiring lock "cinder-quobyte-f6ab38fb-e7a8-42d6-bfa6-2248242aacef" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:08:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-006bb488-46f6-4a36-8f86-85a30973673a tempest-CreateVolumesFromImageTest-1150243246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.405s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:21 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-006bb488-46f6-4a36-8f86-85a30973673a tempest-CreateVolumesFromImageTest-1150243246 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:08:21 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-006bb488-46f6-4a36-8f86-85a30973673a tempest-CreateVolumesFromImageTest-1150243246 None] Deleted volume successfully. Jul 30 17:08:21 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7da73824-6066-4e96-b073-626181857980 tempest-CreateVolumesFromImageTest-1150243246 None] Lock "cinder-quobyte-f6ab38fb-e7a8-42d6-bfa6-2248242aacef" acquired by "delete_volume" :: waited 0.035s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:08:21 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-006bb488-46f6-4a36-8f86-85a30973673a tempest-CreateVolumesFromImageTest-1150243246 None] Lock "cinder-7c995ab8-4733-4fad-b334-90ec3fccf94b-delete_volume" released by "delete_volume" :: held 1.362s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:08:21 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[970e8fc3-c639-4715-a893-a6edccfe7058]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:08:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7da73824-6066-4e96-b073-626181857980 tempest-CreateVolumesFromImageTest-1150243246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f6ab38fb-e7a8-42d6-bfa6-2248242aacef {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:21 devstack sudo[107571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4c8023d6-6654-4cee-b1ac-ceb12f149d52_3tn3zv_0 Jul 30 17:08:21 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:21 devstack sudo[107572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f6ab38fb-e7a8-42d6-bfa6-2248242aacef Jul 30 17:08:21 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:21 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-27381f42-1600-497d-93b8-60513aa744c7 tempest-VolumeDependencyTests-500709084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:08:22 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-27381f42-1600-497d-93b8-60513aa744c7 tempest-VolumeDependencyTests-500709084 None] Flow 'volume_create_manager' (07935666-5999-4932-8c8d-7dfe9c72b872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:08:22 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-27381f42-1600-497d-93b8-60513aa744c7 tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (433ba5f5-f582-4dea-b934-948df0ae0cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:22 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-27381f42-1600-497d-93b8-60513aa744c7 tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (433ba5f5-f582-4dea-b934-948df0ae0cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-678710600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1afe0c3d-9641-4aeb-80a2-9551751f3011,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75be733264504175956c041c2312fa52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:08:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bbc6cbe5-cc39-4825-a916-e0c5bf466d4d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:08:22Z,use_quota=True,user_id='9ee0dab1317a4cfeafb4f6b50ca81a57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:22 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-27381f42-1600-497d-93b8-60513aa744c7 tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4e1792a-cfb2-4d6b-b9f2-0253156ec94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:22 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-27381f42-1600-497d-93b8-60513aa744c7 tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4e1792a-cfb2-4d6b-b9f2-0253156ec94b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:22 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-27381f42-1600-497d-93b8-60513aa744c7 tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7359280-d63b-41a7-84a6-c6655248430a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:22 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-27381f42-1600-497d-93b8-60513aa744c7 tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7359280-d63b-41a7-84a6-c6655248430a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1afe0c3d-9641-4aeb-80a2-9551751f3011', 'volume_name': 'volume-1afe0c3d-9641-4aeb-80a2-9551751f3011', 'volume_size': 1, 'snapshot_id': 'bbc6cbe5-cc39-4825-a916-e0c5bf466d4d'}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:22 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-27381f42-1600-497d-93b8-60513aa744c7 tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db027a2f-3339-4f2b-bcc5-a23008ef1d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:22 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-27381f42-1600-497d-93b8-60513aa744c7 tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db027a2f-3339-4f2b-bcc5-a23008ef1d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:22 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-27381f42-1600-497d-93b8-60513aa744c7 tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea4046fc-af0f-4de0-9fad-2d1db77066ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:22 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-27381f42-1600-497d-93b8-60513aa744c7 tempest-VolumeDependencyTests-500709084 None] Volume 1afe0c3d-9641-4aeb-80a2-9551751f3011: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1afe0c3d-9641-4aeb-80a2-9551751f3011', 'volume_size': 1, 'snapshot_id': 'bbc6cbe5-cc39-4825-a916-e0c5bf466d4d'} Jul 30 17:08:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-27381f42-1600-497d-93b8-60513aa744c7 tempest-VolumeDependencyTests-500709084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:22 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4c8023d6-6654-4cee-b1ac-ceb12f149d52_3tn3zv_0" returned: 0 in 0.452s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4c8023d6-6654-4cee-b1ac-ceb12f149d52_3tn3zv_0 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:22 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0fe38d45-aa91-48de-9dca-8ba9b1efa668 1073741824" returned: 0 in 0.651s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0fe38d45-aa91-48de-9dca-8ba9b1efa668 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:22 devstack sudo[107587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0fe38d45-aa91-48de-9dca-8ba9b1efa668 Jul 30 17:08:22 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:22 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7da73824-6066-4e96-b073-626181857980 tempest-CreateVolumesFromImageTest-1150243246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f6ab38fb-e7a8-42d6-bfa6-2248242aacef" returned: 0 in 0.478s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7da73824-6066-4e96-b073-626181857980 tempest-CreateVolumesFromImageTest-1150243246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f6ab38fb-e7a8-42d6-bfa6-2248242aacef {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:22 devstack sudo[107583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4c8023d6-6654-4cee-b1ac-ceb12f149d52_3tn3zv_0 Jul 30 17:08:22 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:22 devstack sudo[107589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f6ab38fb-e7a8-42d6-bfa6-2248242aacef Jul 30 17:08:22 devstack sudo[107589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:22 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:22 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0fe38d45-aa91-48de-9dca-8ba9b1efa668" returned: 0 in 0.320s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4c8023d6-6654-4cee-b1ac-ceb12f149d52_3tn3zv_0" returned: 1 in 0.381s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4c8023d6-6654-4cee-b1ac-ceb12f149d52_3tn3zv_0' failed. Not Retrying. {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 17:08:22 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:08:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-27381f42-1600-497d-93b8-60513aa744c7 tempest-VolumeDependencyTests-500709084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.424s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:22 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-27381f42-1600-497d-93b8-60513aa744c7 tempest-VolumeDependencyTests-500709084 None] Acquiring lock "cinder-quobyte-bbc6cbe5-cc39-4825-a916-e0c5bf466d4d-1afe0c3d-9641-4aeb-80a2-9551751f3011" by "_create_volume_from_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:08:22 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad0dde7-db1c-43f1-b5ba-e1c21626d1af]: (4, 'raw') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:08:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4c8023d6-6654-4cee-b1ac-ceb12f149d52_8jhkojj4devstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:22 devstack sudo[107589]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7da73824-6066-4e96-b073-626181857980 tempest-CreateVolumesFromImageTest-1150243246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f6ab38fb-e7a8-42d6-bfa6-2248242aacef" returned: 0 in 0.304s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:22 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-27381f42-1600-497d-93b8-60513aa744c7 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-bbc6cbe5-cc39-4825-a916-e0c5bf466d4d-1afe0c3d-9641-4aeb-80a2-9551751f3011" acquired by "_create_volume_from_snapshot" :: waited 0.048s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:08:22 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-27381f42-1600-497d-93b8-60513aa744c7 tempest-VolumeDependencyTests-500709084 None] Creating volume 1afe0c3d-9641-4aeb-80a2-9551751f3011 from snapshot bbc6cbe5-cc39-4825-a916-e0c5bf466d4d {{(pid=88591) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 30 17:08:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-27381f42-1600-497d-93b8-60513aa744c7 tempest-VolumeDependencyTests-500709084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-27381f42-1600-497d-93b8-60513aa744c7 tempest-VolumeDependencyTests-500709084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:22 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-27381f42-1600-497d-93b8-60513aa744c7 tempest-VolumeDependencyTests-500709084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:08:22 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-27381f42-1600-497d-93b8-60513aa744c7 tempest-VolumeDependencyTests-500709084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:08:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-27381f42-1600-497d-93b8-60513aa744c7 tempest-VolumeDependencyTests-500709084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:22 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-27381f42-1600-497d-93b8-60513aa744c7 tempest-VolumeDependencyTests-500709084 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:08:22 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-27381f42-1600-497d-93b8-60513aa744c7 tempest-VolumeDependencyTests-500709084 None] Acquiring lock "cinder-quobyte-1afe0c3d-9641-4aeb-80a2-9551751f3011" by "_copy_volume_from_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:08:22 devstack cinder-volume[88591]: DEBUG cinder.volume.volume_utils [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Attempting download of 435c9708-bf16-4c4a-b476-4896ceecdca9 ((None, [{'url': 'file:///opt/stack/data/glance/images/435c9708-bf16-4c4a-b476-4896ceecdca9', 'metadata': {}}])) to volume 0fe38d45-aa91-48de-9dca-8ba9b1efa668. {{(pid=88591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 30 17:08:22 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7da73824-6066-4e96-b073-626181857980 tempest-CreateVolumesFromImageTest-1150243246 None] Lock "cinder-quobyte-f6ab38fb-e7a8-42d6-bfa6-2248242aacef" released by "delete_volume" :: held 0.861s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:08:22 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-27381f42-1600-497d-93b8-60513aa744c7 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-1afe0c3d-9641-4aeb-80a2-9551751f3011" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:08:22 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-27381f42-1600-497d-93b8-60513aa744c7 tempest-VolumeDependencyTests-500709084 None] snapshot: bbc6cbe5-cc39-4825-a916-e0c5bf466d4d, volume: 1afe0c3d-9641-4aeb-80a2-9551751f3011, {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 17:08:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-27381f42-1600-497d-93b8-60513aa744c7 tempest-VolumeDependencyTests-500709084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-27381f42-1600-497d-93b8-60513aa744c7 tempest-VolumeDependencyTests-500709084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:22 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-27381f42-1600-497d-93b8-60513aa744c7 tempest-VolumeDependencyTests-500709084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:08:22 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-27381f42-1600-497d-93b8-60513aa744c7 tempest-VolumeDependencyTests-500709084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:08:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-27381f42-1600-497d-93b8-60513aa744c7 tempest-VolumeDependencyTests-500709084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:22 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2952b3-439c-4821-b43a-1e61e89eb39c]: (4, 'raw') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:08:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_435c9708-bf16-4c4a-b476-4896ceecdca9_8hjjkv_c {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:22 devstack sudo[107597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4c8023d6-6654-4cee-b1ac-ceb12f149d52_8jhkojj4devstack@QuobyteHD Jul 30 17:08:22 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:22 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd93e69e-f1aa-4f29-bbb0-9eb96fb713e2]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:08:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-27381f42-1600-497d-93b8-60513aa744c7 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef4ded4-31f8-458e-83a4-2afaa037f927.bbc6cbe5-cc39-4825-a916-e0c5bf466d4d {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:22 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-7da73824-6066-4e96-b073-626181857980 tempest-CreateVolumesFromImageTest-1150243246 None] Created reservations ['280e1b3a-7169-4cc0-934f-7c46b9cff67f', 'd371df8f-7bae-4db6-a7cc-90d1ee93ef4e', '9fe843fe-1331-4abe-95e4-812295b8bb61', 'a35de5bb-b260-4554-a808-6275507a6b4f'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:08:22 devstack sudo[107599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_435c9708-bf16-4c4a-b476-4896ceecdca9_8hjjkv_c Jul 30 17:08:22 devstack sudo[107599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7da73824-6066-4e96-b073-626181857980 tempest-CreateVolumesFromImageTest-1150243246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7da73824-6066-4e96-b073-626181857980 tempest-CreateVolumesFromImageTest-1150243246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:22 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7da73824-6066-4e96-b073-626181857980 tempest-CreateVolumesFromImageTest-1150243246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:08:22 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7da73824-6066-4e96-b073-626181857980 tempest-CreateVolumesFromImageTest-1150243246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:08:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7da73824-6066-4e96-b073-626181857980 tempest-CreateVolumesFromImageTest-1150243246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7da73824-6066-4e96-b073-626181857980 tempest-CreateVolumesFromImageTest-1150243246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:22 devstack sudo[107600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef4ded4-31f8-458e-83a4-2afaa037f927.bbc6cbe5-cc39-4825-a916-e0c5bf466d4d Jul 30 17:08:22 devstack sudo[107600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:22 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:08:22 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:22 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4c8023d6-6654-4cee-b1ac-ceb12f149d52_8jhkojj4devstack@QuobyteHD" returned: 0 in 0.420s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4c8023d6-6654-4cee-b1ac-ceb12f149d52_8jhkojj4devstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:23 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4c8023d6-6654-4cee-b1ac-ceb12f149d52_8jhkojj4devstack@QuobyteHD Jul 30 17:08:23 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:23 devstack sudo[107599]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_435c9708-bf16-4c4a-b476-4896ceecdca9_8hjjkv_c" returned: 0 in 0.425s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_435c9708-bf16-4c4a-b476-4896ceecdca9_8hjjkv_c {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:23 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7da73824-6066-4e96-b073-626181857980 tempest-CreateVolumesFromImageTest-1150243246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.335s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:23 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-7da73824-6066-4e96-b073-626181857980 tempest-CreateVolumesFromImageTest-1150243246 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:08:23 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-7da73824-6066-4e96-b073-626181857980 tempest-CreateVolumesFromImageTest-1150243246 None] Deleted volume successfully. Jul 30 17:08:23 devstack sudo[107600]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-27381f42-1600-497d-93b8-60513aa744c7 tempest-VolumeDependencyTests-500709084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef4ded4-31f8-458e-83a4-2afaa037f927.bbc6cbe5-cc39-4825-a916-e0c5bf466d4d" returned: 0 in 0.496s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:23 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-27381f42-1600-497d-93b8-60513aa744c7 tempest-VolumeDependencyTests-500709084 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fef4ded4-31f8-458e-83a4-2afaa037f927(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:08:23 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cdba10d-e6a3-4453-9d79-007b5b3d78f5]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:08:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-27381f42-1600-497d-93b8-60513aa744c7 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef4ded4-31f8-458e-83a4-2afaa037f927 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:23 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7da73824-6066-4e96-b073-626181857980 tempest-CreateVolumesFromImageTest-1150243246 None] Lock "cinder-f6ab38fb-e7a8-42d6-bfa6-2248242aacef-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:08:23 devstack sudo[107614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_435c9708-bf16-4c4a-b476-4896ceecdca9_8hjjkv_c Jul 30 17:08:23 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:23 devstack sudo[107616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef4ded4-31f8-458e-83a4-2afaa037f927 Jul 30 17:08:23 devstack sudo[107616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:23 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4c8023d6-6654-4cee-b1ac-ceb12f149d52_8jhkojj4devstack@QuobyteHD" returned: 1 in 0.380s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4c8023d6-6654-4cee-b1ac-ceb12f149d52_8jhkojj4devstack@QuobyteHD' failed. Not Retrying. {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 17:08:23 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] 4c8023d6-6654-4cee-b1ac-ceb12f149d52 was raw, converting to qcow2 {{(pid=88591) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 30 17:08:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4c8023d6-6654-4cee-b1ac-ceb12f149d52_8jhkojj4devstack@QuobyteHD /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3a04709f-1150-4cc2-979c-ae5edda637f5 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:23 devstack sudo[107622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4c8023d6-6654-4cee-b1ac-ceb12f149d52_8jhkojj4devstack@QuobyteHD /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3a04709f-1150-4cc2-979c-ae5edda637f5 Jul 30 17:08:23 devstack sudo[107622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:23 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_435c9708-bf16-4c4a-b476-4896ceecdca9_8hjjkv_c" returned: 1 in 0.362s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_435c9708-bf16-4c4a-b476-4896ceecdca9_8hjjkv_c' failed. Not Retrying. {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 17:08:23 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[93308a38-4595-4707-9a34-65341ff88d94]: (4, 'raw') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:08:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_435c9708-bf16-4c4a-b476-4896ceecdca9_rl3tfizmdevstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:23 devstack sudo[107626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_435c9708-bf16-4c4a-b476-4896ceecdca9_rl3tfizmdevstack@QuobyteHD Jul 30 17:08:23 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:23 devstack sudo[107616]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-27381f42-1600-497d-93b8-60513aa744c7 tempest-VolumeDependencyTests-500709084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef4ded4-31f8-458e-83a4-2afaa037f927" returned: 0 in 0.402s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:23 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-27381f42-1600-497d-93b8-60513aa744c7 tempest-VolumeDependencyTests-500709084 None] will copy from snapshot at /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef4ded4-31f8-458e-83a4-2afaa037f927 {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 17:08:23 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-27381f42-1600-497d-93b8-60513aa744c7 tempest-VolumeDependencyTests-500709084 None] Creating direct copy from snapshot {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 17:08:23 devstack cinder-volume[88591]: DEBUG cinder.utils [None req-27381f42-1600-497d-93b8-60513aa744c7 tempest-VolumeDependencyTests-500709084 None] Path /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011 not found in is_blk_device check {{(pid=88591) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 17:08:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-27381f42-1600-497d-93b8-60513aa744c7 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef4ded4-31f8-458e-83a4-2afaa037f927 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:23 devstack sudo[107634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef4ded4-31f8-458e-83a4-2afaa037f927 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011 Jul 30 17:08:23 devstack sudo[107634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:23 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_435c9708-bf16-4c4a-b476-4896ceecdca9_rl3tfizmdevstack@QuobyteHD" returned: 0 in 0.349s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_435c9708-bf16-4c4a-b476-4896ceecdca9_rl3tfizmdevstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:23 devstack sudo[107622]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4c8023d6-6654-4cee-b1ac-ceb12f149d52_8jhkojj4devstack@QuobyteHD /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3a04709f-1150-4cc2-979c-ae5edda637f5" returned: 0 in 0.513s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:23 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4c8023d6-6654-4cee-b1ac-ceb12f149d52_8jhkojj4devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3a04709f-1150-4cc2-979c-ae5edda637f5 {{(pid=88591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 17:08:23 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] Converted 0.00 MB image at 0.00 MB/s Jul 30 17:08:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3a04709f-1150-4cc2-979c-ae5edda637f5 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:23 devstack sudo[107640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3a04709f-1150-4cc2-979c-ae5edda637f5 1G Jul 30 17:08:23 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-1af51948-897d-4584-b808-73f8d9d28311 tempest-CreateVolumesFromImageTest-1150243246 None] Acquiring lock "cinder-1104d7c1-906d-4435-9a66-9c123f69af4b-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:08:23 devstack sudo[107640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:23 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-1af51948-897d-4584-b808-73f8d9d28311 tempest-CreateVolumesFromImageTest-1150243246 None] Lock "cinder-1104d7c1-906d-4435-9a66-9c123f69af4b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:08:24 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-1af51948-897d-4584-b808-73f8d9d28311 tempest-CreateVolumesFromImageTest-1150243246 None] Acquiring lock "cinder-quobyte-1104d7c1-906d-4435-9a66-9c123f69af4b" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:08:24 devstack sudo[107638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_435c9708-bf16-4c4a-b476-4896ceecdca9_rl3tfizmdevstack@QuobyteHD Jul 30 17:08:24 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-1af51948-897d-4584-b808-73f8d9d28311 tempest-CreateVolumesFromImageTest-1150243246 None] Lock "cinder-quobyte-1104d7c1-906d-4435-9a66-9c123f69af4b" acquired by "delete_volume" :: waited 0.022s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:08:24 devstack sudo[107638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:24 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[165b70bc-50f8-4c76-b4f0-b53e306bf0b0]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:08:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1af51948-897d-4584-b808-73f8d9d28311 tempest-CreateVolumesFromImageTest-1150243246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1104d7c1-906d-4435-9a66-9c123f69af4b {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:24 devstack sudo[107645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1104d7c1-906d-4435-9a66-9c123f69af4b Jul 30 17:08:24 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:24 devstack sudo[107638]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_435c9708-bf16-4c4a-b476-4896ceecdca9_rl3tfizmdevstack@QuobyteHD" returned: 1 in 0.487s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_435c9708-bf16-4c4a-b476-4896ceecdca9_rl3tfizmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 17:08:24 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] 435c9708-bf16-4c4a-b476-4896ceecdca9 was raw, converting to qcow2 {{(pid=88591) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 30 17:08:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_435c9708-bf16-4c4a-b476-4896ceecdca9_rl3tfizmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0fe38d45-aa91-48de-9dca-8ba9b1efa668 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:24 devstack sudo[107640]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3a04709f-1150-4cc2-979c-ae5edda637f5 1G" returned: 0 in 0.539s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:24 devstack sudo[107660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_435c9708-bf16-4c4a-b476-4896ceecdca9_rl3tfizmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0fe38d45-aa91-48de-9dca-8ba9b1efa668 Jul 30 17:08:24 devstack cinder-volume[88591]: DEBUG cinder.volume.volume_utils [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] Downloaded image 4c8023d6-6654-4cee-b1ac-ceb12f149d52 ((None, [{'url': 'file:///opt/stack/data/glance/images/4c8023d6-6654-4cee-b1ac-ceb12f149d52', 'metadata': {}}])) to volume 3a04709f-1150-4cc2-979c-ae5edda637f5 successfully. {{(pid=88591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 30 17:08:24 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] Temporary image 4c8023d6-6654-4cee-b1ac-ceb12f149d52 for user e4eedb818424482c9370625aced56a0a is deleted. {{(pid=88591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 30 17:08:24 devstack sudo[107660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:24 devstack cinder-volume[88591]: DEBUG cinder.volume.volume_utils [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] Marking volume 3a04709f-1150-4cc2-979c-ae5edda637f5 as bootable. {{(pid=88591) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 30 17:08:24 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] Copying metadata from image 4c8023d6-6654-4cee-b1ac-ceb12f149d52 to 3a04709f-1150-4cc2-979c-ae5edda637f5. {{(pid=88591) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 30 17:08:24 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] Creating volume glance metadata for volume 3a04709f-1150-4cc2-979c-ae5edda637f5 backed by image 4c8023d6-6654-4cee-b1ac-ceb12f149d52 with: {'image_id': '4c8023d6-6654-4cee-b1ac-ceb12f149d52', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '137e3cb8d975bd19c36eebab1dae2d42', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88591) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 30 17:08:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3b3b529-ed45-4e31-8b6f-eb0779af0eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a04709f-1150-4cc2-979c-ae5edda637f5', 'volume_size': 1, 'image_id': '4c8023d6-6654-4cee-b1ac-ceb12f149d52', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4c8023d6-6654-4cee-b1ac-ceb12f149d52', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '137e3cb8d975bd19c36eebab1dae2d42', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '58f61df38a914ec2a6713104b0278991', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ab4e13db3bb3f652ec39d3b8b538d21f3b0fb9635bfca6dfe00c847f230f0fe33ce4770e6527427c2353291ba7887d3d79814b608720543eee894d1b04d539a2', 'id': '4c8023d6-6654-4cee-b1ac-ceb12f149d52', 'created_at': datetime.datetime(2026, 7, 30, 15, 8, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 15, 8, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4c8023d6-6654-4cee-b1ac-ceb12f149d52/file', 'properties': {}}, 'image_service': }' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e27ef268-0973-40f2-a1a7-28b5d42328fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:24 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] Volume volume-3a04709f-1150-4cc2-979c-ae5edda637f5 (3a04709f-1150-4cc2-979c-ae5edda637f5): created successfully Jul 30 17:08:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e27ef268-0973-40f2-a1a7-28b5d42328fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] Flow 'volume_create_manager' (885cfd2c-3ccf-45d8-806e-81209f372b14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:08:24 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-2eb76341-9348-4c5e-95f0-c66995ad0b3b tempest-VolumeImageDependencyTests-1529416407 None] Created volume successfully. Jul 30 17:08:24 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1af51948-897d-4584-b808-73f8d9d28311 tempest-CreateVolumesFromImageTest-1150243246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1104d7c1-906d-4435-9a66-9c123f69af4b" returned: 0 in 0.822s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1af51948-897d-4584-b808-73f8d9d28311 tempest-CreateVolumesFromImageTest-1150243246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1104d7c1-906d-4435-9a66-9c123f69af4b {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:24 devstack sudo[107669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1104d7c1-906d-4435-9a66-9c123f69af4b Jul 30 17:08:24 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:25 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1af51948-897d-4584-b808-73f8d9d28311 tempest-CreateVolumesFromImageTest-1150243246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1104d7c1-906d-4435-9a66-9c123f69af4b" returned: 0 in 0.560s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:25 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-1af51948-897d-4584-b808-73f8d9d28311 tempest-CreateVolumesFromImageTest-1150243246 None] Lock "cinder-quobyte-1104d7c1-906d-4435-9a66-9c123f69af4b" released by "delete_volume" :: held 1.459s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:08:25 devstack sudo[107660]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_435c9708-bf16-4c4a-b476-4896ceecdca9_rl3tfizmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0fe38d45-aa91-48de-9dca-8ba9b1efa668" returned: 0 in 1.248s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:25 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_435c9708-bf16-4c4a-b476-4896ceecdca9_rl3tfizmdevstack@QuobyteHD, size 0.00 MB, duration 1.25 sec, destination /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0fe38d45-aa91-48de-9dca-8ba9b1efa668 {{(pid=88591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 17:08:25 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Converted 0.00 MB image at 0.00 MB/s Jul 30 17:08:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0fe38d45-aa91-48de-9dca-8ba9b1efa668 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:25 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-1af51948-897d-4584-b808-73f8d9d28311 tempest-CreateVolumesFromImageTest-1150243246 None] Created reservations ['5de4ab32-3320-4169-8185-18659fdae4e5', 'e8ea70c9-a28d-4b56-8729-af0897566e8f', '0a0f7e2a-9900-4242-aa2a-16d759322fd5', '818b99a7-875f-49fe-b65a-86f2df03a0b9'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:08:25 devstack sudo[107673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0fe38d45-aa91-48de-9dca-8ba9b1efa668 1G Jul 30 17:08:25 devstack sudo[107673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1af51948-897d-4584-b808-73f8d9d28311 tempest-CreateVolumesFromImageTest-1150243246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1af51948-897d-4584-b808-73f8d9d28311 tempest-CreateVolumesFromImageTest-1150243246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:25 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-1af51948-897d-4584-b808-73f8d9d28311 tempest-CreateVolumesFromImageTest-1150243246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:08:25 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-1af51948-897d-4584-b808-73f8d9d28311 tempest-CreateVolumesFromImageTest-1150243246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:08:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1af51948-897d-4584-b808-73f8d9d28311 tempest-CreateVolumesFromImageTest-1150243246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1af51948-897d-4584-b808-73f8d9d28311 tempest-CreateVolumesFromImageTest-1150243246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:25 devstack sudo[107675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:08:25 devstack sudo[107675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:26 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-34a1f9c5-71c4-49d3-a18f-7cd758a9db66 tempest-VolumeImageDependencyTests-1529416407 None] Acquiring lock "cinder-3a04709f-1150-4cc2-979c-ae5edda637f5-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:08:26 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-34a1f9c5-71c4-49d3-a18f-7cd758a9db66 tempest-VolumeImageDependencyTests-1529416407 None] Lock "cinder-3a04709f-1150-4cc2-979c-ae5edda637f5-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:08:26 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-34a1f9c5-71c4-49d3-a18f-7cd758a9db66 tempest-VolumeImageDependencyTests-1529416407 None] Acquiring lock "cinder-quobyte-3a04709f-1150-4cc2-979c-ae5edda637f5" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:08:26 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-34a1f9c5-71c4-49d3-a18f-7cd758a9db66 tempest-VolumeImageDependencyTests-1529416407 None] Lock "cinder-quobyte-3a04709f-1150-4cc2-979c-ae5edda637f5" acquired by "delete_volume" :: waited 0.046s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:08:26 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-bee10af2-7f6a-4e6a-84d8-853fe1dbd231 tempest-CreateVolumesFromImageTest-1150243246 None] Acquiring lock "cinder-69ac7a9a-32a0-44f6-beb7-9d76787802b0-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:08:26 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[408d4cc1-b45d-4e1c-a1f2-7c99bb2d8994]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:08:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34a1f9c5-71c4-49d3-a18f-7cd758a9db66 tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3a04709f-1150-4cc2-979c-ae5edda637f5 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:26 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-bee10af2-7f6a-4e6a-84d8-853fe1dbd231 tempest-CreateVolumesFromImageTest-1150243246 None] Lock "cinder-69ac7a9a-32a0-44f6-beb7-9d76787802b0-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:08:26 devstack sudo[107675]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1af51948-897d-4584-b808-73f8d9d28311 tempest-CreateVolumesFromImageTest-1150243246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.782s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:26 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-1af51948-897d-4584-b808-73f8d9d28311 tempest-CreateVolumesFromImageTest-1150243246 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:08:26 devstack sudo[107673]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:26 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-1af51948-897d-4584-b808-73f8d9d28311 tempest-CreateVolumesFromImageTest-1150243246 None] Deleted volume successfully. Jul 30 17:08:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0fe38d45-aa91-48de-9dca-8ba9b1efa668 1G" returned: 0 in 1.128s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:26 devstack cinder-volume[88591]: DEBUG cinder.volume.volume_utils [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Downloaded image 435c9708-bf16-4c4a-b476-4896ceecdca9 ((None, [{'url': 'file:///opt/stack/data/glance/images/435c9708-bf16-4c4a-b476-4896ceecdca9', 'metadata': {}}])) to volume 0fe38d45-aa91-48de-9dca-8ba9b1efa668 successfully. {{(pid=88591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 30 17:08:26 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Temporary image 435c9708-bf16-4c4a-b476-4896ceecdca9 for user 98bed34f2e0540858c14d6048cb06400 is deleted. {{(pid=88591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 30 17:08:26 devstack cinder-volume[88591]: DEBUG cinder.volume.volume_utils [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Marking volume 0fe38d45-aa91-48de-9dca-8ba9b1efa668 as bootable. {{(pid=88591) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 30 17:08:26 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-bee10af2-7f6a-4e6a-84d8-853fe1dbd231 tempest-CreateVolumesFromImageTest-1150243246 None] Acquiring lock "cinder-quobyte-69ac7a9a-32a0-44f6-beb7-9d76787802b0" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:08:26 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Copying metadata from image 435c9708-bf16-4c4a-b476-4896ceecdca9 to 0fe38d45-aa91-48de-9dca-8ba9b1efa668. {{(pid=88591) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 30 17:08:26 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Creating volume glance metadata for volume 0fe38d45-aa91-48de-9dca-8ba9b1efa668 backed by image 435c9708-bf16-4c4a-b476-4896ceecdca9 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '435c9708-bf16-4c4a-b476-4896ceecdca9', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'a20d1da091f7b48713e28ae47a114f96', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88591) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 30 17:08:26 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-1af51948-897d-4584-b808-73f8d9d28311 tempest-CreateVolumesFromImageTest-1150243246 None] Lock "cinder-1104d7c1-906d-4435-9a66-9c123f69af4b-delete_volume" released by "delete_volume" :: held 2.837s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:08:26 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-bee10af2-7f6a-4e6a-84d8-853fe1dbd231 tempest-CreateVolumesFromImageTest-1150243246 None] Lock "cinder-quobyte-69ac7a9a-32a0-44f6-beb7-9d76787802b0" acquired by "delete_volume" :: waited 0.047s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:08:26 devstack sudo[107683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3a04709f-1150-4cc2-979c-ae5edda637f5 Jul 30 17:08:26 devstack sudo[107683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:26 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[00912c2f-4b78-422e-8138-ab0de5303214]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:08:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bee10af2-7f6a-4e6a-84d8-853fe1dbd231 tempest-CreateVolumesFromImageTest-1150243246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-69ac7a9a-32a0-44f6-beb7-9d76787802b0 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:27 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fca67384-77d8-4d04-8f30-3f829bdefb1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fe38d45-aa91-48de-9dca-8ba9b1efa668', 'volume_size': 1, 'image_id': '435c9708-bf16-4c4a-b476-4896ceecdca9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/435c9708-bf16-4c4a-b476-4896ceecdca9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a20d1da091f7b48713e28ae47a114f96', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b1dd9b585664431bb7bb37c711b54a5f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a35d85ead63f97941a9ae098282d47bd68b16a0101b7c2cc86976042c5284cdbb8d6e1c5f74ad654d91e2199da063c56bf1d7d09f00f074190bd7a32c3659f92', 'id': '435c9708-bf16-4c4a-b476-4896ceecdca9', 'created_at': datetime.datetime(2026, 7, 30, 15, 8, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 15, 8, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/435c9708-bf16-4c4a-b476-4896ceecdca9/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:27 devstack sudo[107685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-69ac7a9a-32a0-44f6-beb7-9d76787802b0 Jul 30 17:08:27 devstack sudo[107685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:27 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e7fa554-e433-43a4-a5df-2bc4f4380c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:27 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Volume volume-0fe38d45-aa91-48de-9dca-8ba9b1efa668 (0fe38d45-aa91-48de-9dca-8ba9b1efa668): created successfully Jul 30 17:08:27 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e7fa554-e433-43a4-a5df-2bc4f4380c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:27 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Flow 'volume_create_manager' (516f3d01-dcd5-43a6-b2d4-cde3820bcff8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:08:27 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-b9492f88-de12-4d22-a270-d2cd36eb0b39 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Created volume successfully. Jul 30 17:08:27 devstack sudo[107683]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34a1f9c5-71c4-49d3-a18f-7cd758a9db66 tempest-VolumeImageDependencyTests-1529416407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3a04709f-1150-4cc2-979c-ae5edda637f5" returned: 0 in 1.176s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34a1f9c5-71c4-49d3-a18f-7cd758a9db66 tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3a04709f-1150-4cc2-979c-ae5edda637f5 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:27 devstack sudo[107685]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bee10af2-7f6a-4e6a-84d8-853fe1dbd231 tempest-CreateVolumesFromImageTest-1150243246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-69ac7a9a-32a0-44f6-beb7-9d76787802b0" returned: 0 in 0.861s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bee10af2-7f6a-4e6a-84d8-853fe1dbd231 tempest-CreateVolumesFromImageTest-1150243246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-69ac7a9a-32a0-44f6-beb7-9d76787802b0 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:27 devstack sudo[107694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3a04709f-1150-4cc2-979c-ae5edda637f5 Jul 30 17:08:27 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:27 devstack sudo[107695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-69ac7a9a-32a0-44f6-beb7-9d76787802b0 Jul 30 17:08:27 devstack sudo[107695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:28 devstack sudo[107695]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bee10af2-7f6a-4e6a-84d8-853fe1dbd231 tempest-CreateVolumesFromImageTest-1150243246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-69ac7a9a-32a0-44f6-beb7-9d76787802b0" returned: 0 in 0.499s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:28 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34a1f9c5-71c4-49d3-a18f-7cd758a9db66 tempest-VolumeImageDependencyTests-1529416407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3a04709f-1150-4cc2-979c-ae5edda637f5" returned: 0 in 0.562s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:28 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-bee10af2-7f6a-4e6a-84d8-853fe1dbd231 tempest-CreateVolumesFromImageTest-1150243246 None] Lock "cinder-quobyte-69ac7a9a-32a0-44f6-beb7-9d76787802b0" released by "delete_volume" :: held 1.494s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:08:28 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-34a1f9c5-71c4-49d3-a18f-7cd758a9db66 tempest-VolumeImageDependencyTests-1529416407 None] Lock "cinder-quobyte-3a04709f-1150-4cc2-979c-ae5edda637f5" released by "delete_volume" :: held 1.926s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:08:28 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-bee10af2-7f6a-4e6a-84d8-853fe1dbd231 tempest-CreateVolumesFromImageTest-1150243246 None] Created reservations ['9cb23d8d-c8fe-469e-9527-a14d86d54d0a', 'e5f0faac-33de-40c9-b805-5916515322db', '1684e163-452b-421c-a415-b3d67bf21ba0', '68d432b9-6b99-4999-8c1b-4a7e59b63bcc'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:08:28 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-2b0c19f6-d9cd-4f85-9e77-191b865f2ef0 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Acquiring lock "cinder-0fe38d45-aa91-48de-9dca-8ba9b1efa668-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:08:28 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-34a1f9c5-71c4-49d3-a18f-7cd758a9db66 tempest-VolumeImageDependencyTests-1529416407 None] Created reservations ['c1706bc8-c7f9-418b-90ed-b185982dc7e5', '709f5af9-afb2-4141-8e9c-7366a885edcf', '3be7a3d7-7793-4c7f-8485-29833a56b7a7', '33d6d06f-2e97-4fff-8058-714f640a07ac'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:08:28 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-2b0c19f6-d9cd-4f85-9e77-191b865f2ef0 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Lock "cinder-0fe38d45-aa91-48de-9dca-8ba9b1efa668-delete_volume" acquired by "delete_volume" :: waited 0.105s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:08:28 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-2b0c19f6-d9cd-4f85-9e77-191b865f2ef0 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Acquiring lock "cinder-quobyte-0fe38d45-aa91-48de-9dca-8ba9b1efa668" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:08:28 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-2b0c19f6-d9cd-4f85-9e77-191b865f2ef0 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Lock "cinder-quobyte-0fe38d45-aa91-48de-9dca-8ba9b1efa668" acquired by "delete_volume" :: waited 0.061s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:08:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-bee10af2-7f6a-4e6a-84d8-853fe1dbd231 tempest-CreateVolumesFromImageTest-1150243246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-bee10af2-7f6a-4e6a-84d8-853fe1dbd231 tempest-CreateVolumesFromImageTest-1150243246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:29 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-bee10af2-7f6a-4e6a-84d8-853fe1dbd231 tempest-CreateVolumesFromImageTest-1150243246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:08:29 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-bee10af2-7f6a-4e6a-84d8-853fe1dbd231 tempest-CreateVolumesFromImageTest-1150243246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:08:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-bee10af2-7f6a-4e6a-84d8-853fe1dbd231 tempest-CreateVolumesFromImageTest-1150243246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bee10af2-7f6a-4e6a-84d8-853fe1dbd231 tempest-CreateVolumesFromImageTest-1150243246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:29 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[4574af61-6386-45a1-a676-7d46bf9c8525]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:08:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2b0c19f6-d9cd-4f85-9e77-191b865f2ef0 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0fe38d45-aa91-48de-9dca-8ba9b1efa668 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:29 devstack sudo[107700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:08:29 devstack sudo[107700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34a1f9c5-71c4-49d3-a18f-7cd758a9db66 tempest-VolumeImageDependencyTests-1529416407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34a1f9c5-71c4-49d3-a18f-7cd758a9db66 tempest-VolumeImageDependencyTests-1529416407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:29 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-34a1f9c5-71c4-49d3-a18f-7cd758a9db66 tempest-VolumeImageDependencyTests-1529416407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:08:29 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-34a1f9c5-71c4-49d3-a18f-7cd758a9db66 tempest-VolumeImageDependencyTests-1529416407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:08:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34a1f9c5-71c4-49d3-a18f-7cd758a9db66 tempest-VolumeImageDependencyTests-1529416407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34a1f9c5-71c4-49d3-a18f-7cd758a9db66 tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:29 devstack sudo[107701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0fe38d45-aa91-48de-9dca-8ba9b1efa668 Jul 30 17:08:29 devstack sudo[107701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:29 devstack sudo[107703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:08:29 devstack sudo[107703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:29 devstack sudo[107701]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2b0c19f6-d9cd-4f85-9e77-191b865f2ef0 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0fe38d45-aa91-48de-9dca-8ba9b1efa668" returned: 0 in 0.664s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2b0c19f6-d9cd-4f85-9e77-191b865f2ef0 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0fe38d45-aa91-48de-9dca-8ba9b1efa668 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:29 devstack sudo[107634]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-27381f42-1600-497d-93b8-60513aa744c7 tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef4ded4-31f8-458e-83a4-2afaa037f927 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011" returned: 0 in 6.136s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:29 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-27381f42-1600-497d-93b8-60513aa744c7 tempest-VolumeDependencyTests-500709084 None] Image conversion details: src /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef4ded4-31f8-458e-83a4-2afaa037f927, size 1024.00 MB, duration 6.14 sec, destination /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011 {{(pid=88591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 17:08:29 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-27381f42-1600-497d-93b8-60513aa744c7 tempest-VolumeDependencyTests-500709084 None] Converted 1024.00 MB image at 166.85 MB/s Jul 30 17:08:29 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-27381f42-1600-497d-93b8-60513aa744c7 tempest-VolumeDependencyTests-500709084 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011 is being set with open permissions: ugo+rw Jul 30 17:08:29 devstack sudo[107711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0fe38d45-aa91-48de-9dca-8ba9b1efa668 Jul 30 17:08:29 devstack sudo[107711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-27381f42-1600-497d-93b8-60513aa744c7 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:29 devstack sudo[107703]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34a1f9c5-71c4-49d3-a18f-7cd758a9db66 tempest-VolumeImageDependencyTests-1529416407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.586s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:29 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-34a1f9c5-71c4-49d3-a18f-7cd758a9db66 tempest-VolumeImageDependencyTests-1529416407 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:08:29 devstack sudo[107714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011 Jul 30 17:08:29 devstack sudo[107714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:29 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-34a1f9c5-71c4-49d3-a18f-7cd758a9db66 tempest-VolumeImageDependencyTests-1529416407 None] Deleted volume successfully. Jul 30 17:08:29 devstack sudo[107700]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:29 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-34a1f9c5-71c4-49d3-a18f-7cd758a9db66 tempest-VolumeImageDependencyTests-1529416407 None] Lock "cinder-3a04709f-1150-4cc2-979c-ae5edda637f5-delete_volume" released by "delete_volume" :: held 3.710s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:08:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bee10af2-7f6a-4e6a-84d8-853fe1dbd231 tempest-CreateVolumesFromImageTest-1150243246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.877s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:29 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-bee10af2-7f6a-4e6a-84d8-853fe1dbd231 tempest-CreateVolumesFromImageTest-1150243246 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:08:29 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-bee10af2-7f6a-4e6a-84d8-853fe1dbd231 tempest-CreateVolumesFromImageTest-1150243246 None] Deleted volume successfully. Jul 30 17:08:29 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-bee10af2-7f6a-4e6a-84d8-853fe1dbd231 tempest-CreateVolumesFromImageTest-1150243246 None] Lock "cinder-69ac7a9a-32a0-44f6-beb7-9d76787802b0-delete_volume" released by "delete_volume" :: held 3.356s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:08:30 devstack sudo[107711]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2b0c19f6-d9cd-4f85-9e77-191b865f2ef0 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0fe38d45-aa91-48de-9dca-8ba9b1efa668" returned: 0 in 0.404s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:30 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-2b0c19f6-d9cd-4f85-9e77-191b865f2ef0 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Lock "cinder-quobyte-0fe38d45-aa91-48de-9dca-8ba9b1efa668" released by "delete_volume" :: held 1.190s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:08:30 devstack sudo[107714]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-27381f42-1600-497d-93b8-60513aa744c7 tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011" returned: 0 in 0.425s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:30 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-27381f42-1600-497d-93b8-60513aa744c7 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-1afe0c3d-9641-4aeb-80a2-9551751f3011" released by "_copy_volume_from_snapshot" :: held 7.582s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:08:30 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-2b0c19f6-d9cd-4f85-9e77-191b865f2ef0 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Created reservations ['aa653683-677f-4174-84e6-3b34ab808505', 'b0fdebf1-06e2-42b8-83fc-f55d2085520a', '8dccd124-877c-44ca-abe7-d8c566b6e4e3', '58a6c063-451d-4828-ba89-79526273fd5f'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:08:30 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-27381f42-1600-497d-93b8-60513aa744c7 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-bbc6cbe5-cc39-4825-a916-e0c5bf466d4d-1afe0c3d-9641-4aeb-80a2-9551751f3011" released by "_create_volume_from_snapshot" :: held 7.672s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:08:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-27381f42-1600-497d-93b8-60513aa744c7 tempest-VolumeDependencyTests-500709084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.722s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:30 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-27381f42-1600-497d-93b8-60513aa744c7 tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea4046fc-af0f-4de0-9fad-2d1db77066ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1afe0c3d-9641-4aeb-80a2-9551751f3011', 'volume_size': 1, 'snapshot_id': 'bbc6cbe5-cc39-4825-a916-e0c5bf466d4d'}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:30 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-27381f42-1600-497d-93b8-60513aa744c7 tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f5865f3-1761-4ac5-9302-72e84f73a1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:30 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-27381f42-1600-497d-93b8-60513aa744c7 tempest-VolumeDependencyTests-500709084 None] Volume volume-1afe0c3d-9641-4aeb-80a2-9551751f3011 (1afe0c3d-9641-4aeb-80a2-9551751f3011): created successfully Jul 30 17:08:30 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-27381f42-1600-497d-93b8-60513aa744c7 tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f5865f3-1761-4ac5-9302-72e84f73a1b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:30 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-27381f42-1600-497d-93b8-60513aa744c7 tempest-VolumeDependencyTests-500709084 None] Flow 'volume_create_manager' (07935666-5999-4932-8c8d-7dfe9c72b872) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:08:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2b0c19f6-d9cd-4f85-9e77-191b865f2ef0 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2b0c19f6-d9cd-4f85-9e77-191b865f2ef0 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:30 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-2b0c19f6-d9cd-4f85-9e77-191b865f2ef0 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:08:30 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-2b0c19f6-d9cd-4f85-9e77-191b865f2ef0 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:08:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2b0c19f6-d9cd-4f85-9e77-191b865f2ef0 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2b0c19f6-d9cd-4f85-9e77-191b865f2ef0 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:30 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-27381f42-1600-497d-93b8-60513aa744c7 tempest-VolumeDependencyTests-500709084 None] Created volume successfully. Jul 30 17:08:30 devstack sudo[107718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:08:30 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:30 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2b0c19f6-d9cd-4f85-9e77-191b865f2ef0 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.294s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:30 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-2b0c19f6-d9cd-4f85-9e77-191b865f2ef0 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:08:30 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-2b0c19f6-d9cd-4f85-9e77-191b865f2ef0 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Deleted volume successfully. Jul 30 17:08:30 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-2b0c19f6-d9cd-4f85-9e77-191b865f2ef0 tempest-VolumeAndVolumeTypeFromImageTest-1629873362 None] Lock "cinder-0fe38d45-aa91-48de-9dca-8ba9b1efa668-delete_volume" released by "delete_volume" :: held 1.990s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:08:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a3a863e5-3f2f-4736-a8f7-8b2876fd68df tempest-VolumeDependencyTests-500709084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a3a863e5-3f2f-4736-a8f7-8b2876fd68df tempest-VolumeDependencyTests-500709084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:31 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-a3a863e5-3f2f-4736-a8f7-8b2876fd68df tempest-VolumeDependencyTests-500709084 None] Creating offline snapshot 182c8d60-c4d9-41f6-b152-a3dcd98cb4a1 of volume 1afe0c3d-9641-4aeb-80a2-9551751f3011 {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:08:31 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee64510-60bb-4b86-8648-fefc9891f38b]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:08:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a3a863e5-3f2f-4736-a8f7-8b2876fd68df tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:31 devstack sudo[107721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011 Jul 30 17:08:31 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:31 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a3a863e5-3f2f-4736-a8f7-8b2876fd68df tempest-VolumeDependencyTests-500709084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011" returned: 0 in 0.420s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a3a863e5-3f2f-4736-a8f7-8b2876fd68df tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011.182c8d60-c4d9-41f6-b152-a3dcd98cb4a1 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:31 devstack sudo[107726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011.182c8d60-c4d9-41f6-b152-a3dcd98cb4a1 1G Jul 30 17:08:31 devstack sudo[107726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:32 devstack sudo[107726]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a3a863e5-3f2f-4736-a8f7-8b2876fd68df tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011.182c8d60-c4d9-41f6-b152-a3dcd98cb4a1 1G" returned: 0 in 0.512s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a3a863e5-3f2f-4736-a8f7-8b2876fd68df tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1afe0c3d-9641-4aeb-80a2-9551751f3011 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011.182c8d60-c4d9-41f6-b152-a3dcd98cb4a1 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:32 devstack sudo[107732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1afe0c3d-9641-4aeb-80a2-9551751f3011 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011.182c8d60-c4d9-41f6-b152-a3dcd98cb4a1 Jul 30 17:08:32 devstack sudo[107732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:32 devstack sudo[107732]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a3a863e5-3f2f-4736-a8f7-8b2876fd68df tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1afe0c3d-9641-4aeb-80a2-9551751f3011 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011.182c8d60-c4d9-41f6-b152-a3dcd98cb4a1" returned: 0 in 0.326s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:32 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-a3a863e5-3f2f-4736-a8f7-8b2876fd68df tempest-VolumeDependencyTests-500709084 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011.182c8d60-c4d9-41f6-b152-a3dcd98cb4a1 is being set with open permissions: ugo+rw Jul 30 17:08:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a3a863e5-3f2f-4736-a8f7-8b2876fd68df tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011.182c8d60-c4d9-41f6-b152-a3dcd98cb4a1 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:32 devstack sudo[107738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011.182c8d60-c4d9-41f6-b152-a3dcd98cb4a1 Jul 30 17:08:32 devstack sudo[107738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:32 devstack sudo[107738]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a3a863e5-3f2f-4736-a8f7-8b2876fd68df tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011.182c8d60-c4d9-41f6-b152-a3dcd98cb4a1" returned: 0 in 0.311s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a3a863e5-3f2f-4736-a8f7-8b2876fd68df tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:33 devstack sudo[107741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011.info Jul 30 17:08:33 devstack sudo[107741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:33 devstack sudo[107741]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a3a863e5-3f2f-4736-a8f7-8b2876fd68df tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011.info" returned: 0 in 0.339s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:33 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-a3a863e5-3f2f-4736-a8f7-8b2876fd68df tempest-VolumeDependencyTests-500709084 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011.info is being set with open permissions: ugo+rw Jul 30 17:08:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a3a863e5-3f2f-4736-a8f7-8b2876fd68df tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:33 devstack sudo[107744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011.info Jul 30 17:08:33 devstack sudo[107744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:33 devstack sudo[107744]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a3a863e5-3f2f-4736-a8f7-8b2876fd68df tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011.info" returned: 0 in 0.374s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a3a863e5-3f2f-4736-a8f7-8b2876fd68df tempest-VolumeDependencyTests-500709084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.416s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:33 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-a3a863e5-3f2f-4736-a8f7-8b2876fd68df tempest-VolumeDependencyTests-500709084 None] Create snapshot completed successfully Jul 30 17:08:34 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:08:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] Flow 'volume_create_manager' (0d9ece05-6c5f-4cbf-afbf-e4f9a56456c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:08:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51eafdb9-ba43-42aa-957d-71b303e76e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51eafdb9-ba43-42aa-957d-71b303e76e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:08:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test0e20bd6e-440f-41d8-9b5d-fc047ac00423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e231878-9c22-44e8-a15d-565539d0fafa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f61df38a914ec2a6713104b0278991',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:08:34Z,use_quota=True,user_id='e4eedb818424482c9370625aced56a0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40bb447a-0a70-4637-989f-8182040a7d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40bb447a-0a70-4637-989f-8182040a7d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3933a1a8-8b71-4c3e-955f-8857472c7080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:34 devstack cinder-volume[88591]: DEBUG cinder.image.glance [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] Creating Keystone auth plugin from conf {{(pid=88591) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 30 17:08:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3933a1a8-8b71-4c3e-955f-8857472c7080) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1e231878-9c22-44e8-a15d-565539d0fafa', 'volume_name': 'volume-1e231878-9c22-44e8-a15d-565539d0fafa', 'volume_size': 1, 'image_id': '549f5237-0d27-4590-9dc7-f74d9dd3b0ae', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/549f5237-0d27-4590-9dc7-f74d9dd3b0ae', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-0e20bd6e-440f-41d8-9b5d-fc047ac00423', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0ec535f64c3786b1b148f1d582bdfc14', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '58f61df38a914ec2a6713104b0278991', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '147a30d878ecc494a7a409e213ed0b6996be0d19f3fb24b421bc6f1438a71787248ec2547ca3c5b7f7a841cfee1788eb65501b4cc893c69f704bcfdae319ff31', 'id': '549f5237-0d27-4590-9dc7-f74d9dd3b0ae', 'created_at': datetime.datetime(2026, 7, 30, 15, 8, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 15, 8, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/549f5237-0d27-4590-9dc7-f74d9dd3b0ae/file', 'properties': {}}, 'image_service': }' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b826a52-da23-4fc1-ae61-4397183cb610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b826a52-da23-4fc1-ae61-4397183cb610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:34 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4567c46c-519c-40e7-b40e-e89842233e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:34 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] Volume 1e231878-9c22-44e8-a15d-565539d0fafa: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1e231878-9c22-44e8-a15d-565539d0fafa', 'volume_size': 1, 'image_id': '549f5237-0d27-4590-9dc7-f74d9dd3b0ae', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/549f5237-0d27-4590-9dc7-f74d9dd3b0ae', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-0e20bd6e-440f-41d8-9b5d-fc047ac00423', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0ec535f64c3786b1b148f1d582bdfc14', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '58f61df38a914ec2a6713104b0278991', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '147a30d878ecc494a7a409e213ed0b6996be0d19f3fb24b421bc6f1438a71787248ec2547ca3c5b7f7a841cfee1788eb65501b4cc893c69f704bcfdae319ff31', 'id': '549f5237-0d27-4590-9dc7-f74d9dd3b0ae', 'created_at': datetime.datetime(2026, 7, 30, 15, 8, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 15, 8, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/549f5237-0d27-4590-9dc7-f74d9dd3b0ae/file', 'properties': {}}, 'image_service': } Jul 30 17:08:34 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] Trying to clone 1e231878-9c22-44e8-a15d-565539d0fafa from image 549f5237-0d27-4590-9dc7-f74d9dd3b0ae at location (None, [{'url': 'file:///opt/stack/data/glance/images/549f5237-0d27-4590-9dc7-f74d9dd3b0ae', 'metadata': {}}]). {{(pid=88591) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 30 17:08:34 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_549f5237-0d27-4590-9dc7-f74d9dd3b0ae_7po5fuocdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88591) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 30 17:08:34 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] Image download 0.00 MB at 0.00 MB/s Jul 30 17:08:34 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[84024a66-e1bd-4f20-b8fc-dd6c0f7ebe9f]: (4, 'raw') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:08:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_549f5237-0d27-4590-9dc7-f74d9dd3b0ae_7po5fuocdevstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:34 devstack sudo[107747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_549f5237-0d27-4590-9dc7-f74d9dd3b0ae_7po5fuocdevstack@QuobyteHD Jul 30 17:08:34 devstack sudo[107747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:35 devstack sudo[107747]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_549f5237-0d27-4590-9dc7-f74d9dd3b0ae_7po5fuocdevstack@QuobyteHD" returned: 0 in 0.457s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_549f5237-0d27-4590-9dc7-f74d9dd3b0ae_7po5fuocdevstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:35 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-99e2f540-c048-417c-be83-2ed94b7b097c tempest-ProjectMemberTests-1145856324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:08:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-99e2f540-c048-417c-be83-2ed94b7b097c tempest-ProjectMemberTests-1145856324 None] Flow 'volume_create_manager' (05c53f6c-733b-4173-b14a-2e4eae4f3998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:08:35 devstack sudo[107751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_549f5237-0d27-4590-9dc7-f74d9dd3b0ae_7po5fuocdevstack@QuobyteHD Jul 30 17:08:35 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-99e2f540-c048-417c-be83-2ed94b7b097c tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fd270d8-410e-4a2d-a7f1-cac1df796d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-99e2f540-c048-417c-be83-2ed94b7b097c tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fd270d8-410e-4a2d-a7f1-cac1df796d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-873627299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b13e35b1-7132-4ebd-ad79-b5aadc51721f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26c22addd8364bc982bc8002f431ee32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:08:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:08:35Z,use_quota=True,user_id='c9da4889b5dd47d3bb88b442a104a944',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-99e2f540-c048-417c-be83-2ed94b7b097c tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0ae5c08-a7a0-41b9-a7f2-fd9fe2946b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-99e2f540-c048-417c-be83-2ed94b7b097c tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0ae5c08-a7a0-41b9-a7f2-fd9fe2946b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-99e2f540-c048-417c-be83-2ed94b7b097c tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de396bb9-bbee-4df6-ab29-9bba416665e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-99e2f540-c048-417c-be83-2ed94b7b097c tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de396bb9-bbee-4df6-ab29-9bba416665e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b13e35b1-7132-4ebd-ad79-b5aadc51721f', 'volume_name': 'volume-b13e35b1-7132-4ebd-ad79-b5aadc51721f', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-99e2f540-c048-417c-be83-2ed94b7b097c tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c4acfe6-b989-477a-9275-0dd6e0dce56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-99e2f540-c048-417c-be83-2ed94b7b097c tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c4acfe6-b989-477a-9275-0dd6e0dce56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-99e2f540-c048-417c-be83-2ed94b7b097c tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe400321-71ce-4967-be44-8940adccf28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:35 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-99e2f540-c048-417c-be83-2ed94b7b097c tempest-ProjectMemberTests-1145856324 None] Volume b13e35b1-7132-4ebd-ad79-b5aadc51721f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b13e35b1-7132-4ebd-ad79-b5aadc51721f', 'volume_size': 1} Jul 30 17:08:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-99e2f540-c048-417c-be83-2ed94b7b097c tempest-ProjectMemberTests-1145856324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-99e2f540-c048-417c-be83-2ed94b7b097c tempest-ProjectMemberTests-1145856324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:35 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-99e2f540-c048-417c-be83-2ed94b7b097c tempest-ProjectMemberTests-1145856324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-873627299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b13e35b1-7132-4ebd-ad79-b5aadc51721f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26c22addd8364bc982bc8002f431ee32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:08:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:08:35Z,use_quota=True,user_id='c9da4889b5dd47d3bb88b442a104a944',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:08:35 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-99e2f540-c048-417c-be83-2ed94b7b097c tempest-ProjectMemberTests-1145856324 None] Creating volume b13e35b1-7132-4ebd-ad79-b5aadc51721f {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:08:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-99e2f540-c048-417c-be83-2ed94b7b097c tempest-ProjectMemberTests-1145856324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-99e2f540-c048-417c-be83-2ed94b7b097c tempest-ProjectMemberTests-1145856324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:35 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-99e2f540-c048-417c-be83-2ed94b7b097c tempest-ProjectMemberTests-1145856324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:08:35 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-99e2f540-c048-417c-be83-2ed94b7b097c tempest-ProjectMemberTests-1145856324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:08:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-99e2f540-c048-417c-be83-2ed94b7b097c tempest-ProjectMemberTests-1145856324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:35 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-99e2f540-c048-417c-be83-2ed94b7b097c tempest-ProjectMemberTests-1145856324 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:08:35 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-99e2f540-c048-417c-be83-2ed94b7b097c tempest-ProjectMemberTests-1145856324 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:08:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-99e2f540-c048-417c-be83-2ed94b7b097c tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b13e35b1-7132-4ebd-ad79-b5aadc51721f 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:35 devstack sudo[107753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b13e35b1-7132-4ebd-ad79-b5aadc51721f 1073741824 Jul 30 17:08:35 devstack sudo[107753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:35 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee251b6b-6f7d-4e68-a53b-13b47f6dbaeb tempest-VolumeDependencyTests-500709084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:08:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ee251b6b-6f7d-4e68-a53b-13b47f6dbaeb tempest-VolumeDependencyTests-500709084 None] Flow 'volume_create_manager' (90809225-dec4-4c36-a03b-44e6e5b69c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:08:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ee251b6b-6f7d-4e68-a53b-13b47f6dbaeb tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4082e57b-af34-4354-afe9-e0ce30654955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ee251b6b-6f7d-4e68-a53b-13b47f6dbaeb tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4082e57b-af34-4354-afe9-e0ce30654955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2023038995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=492ebdb2-b6fa-4a35-be2c-63891133e3db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75be733264504175956c041c2312fa52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:08:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=182c8d60-c4d9-41f6-b152-a3dcd98cb4a1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:08:35Z,use_quota=True,user_id='9ee0dab1317a4cfeafb4f6b50ca81a57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ee251b6b-6f7d-4e68-a53b-13b47f6dbaeb tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a8be593-d294-4d4e-83cb-8be6ec56316f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ee251b6b-6f7d-4e68-a53b-13b47f6dbaeb tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a8be593-d294-4d4e-83cb-8be6ec56316f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ee251b6b-6f7d-4e68-a53b-13b47f6dbaeb tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85b82085-45e8-426a-968a-cb954ab55dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ee251b6b-6f7d-4e68-a53b-13b47f6dbaeb tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85b82085-45e8-426a-968a-cb954ab55dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '492ebdb2-b6fa-4a35-be2c-63891133e3db', 'volume_name': 'volume-492ebdb2-b6fa-4a35-be2c-63891133e3db', 'volume_size': 1, 'snapshot_id': '182c8d60-c4d9-41f6-b152-a3dcd98cb4a1'}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ee251b6b-6f7d-4e68-a53b-13b47f6dbaeb tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c1d6073-95ce-4369-89ab-2ff85ff2fdf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ee251b6b-6f7d-4e68-a53b-13b47f6dbaeb tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c1d6073-95ce-4369-89ab-2ff85ff2fdf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ee251b6b-6f7d-4e68-a53b-13b47f6dbaeb tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2138eb8b-7734-40c5-aed8-960846a06a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:35 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-ee251b6b-6f7d-4e68-a53b-13b47f6dbaeb tempest-VolumeDependencyTests-500709084 None] Volume 492ebdb2-b6fa-4a35-be2c-63891133e3db: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-492ebdb2-b6fa-4a35-be2c-63891133e3db', 'volume_size': 1, 'snapshot_id': '182c8d60-c4d9-41f6-b152-a3dcd98cb4a1'} Jul 30 17:08:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ee251b6b-6f7d-4e68-a53b-13b47f6dbaeb tempest-VolumeDependencyTests-500709084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:35 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_549f5237-0d27-4590-9dc7-f74d9dd3b0ae_7po5fuocdevstack@QuobyteHD" returned: 1 in 0.379s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_549f5237-0d27-4590-9dc7-f74d9dd3b0ae_7po5fuocdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 17:08:35 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] Temporary image 549f5237-0d27-4590-9dc7-f74d9dd3b0ae is fetched for user e4eedb818424482c9370625aced56a0a. {{(pid=88591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 30 17:08:35 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[955c858b-2cf0-4649-8073-f74bb98dcffc]: (4, 'raw') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:08:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_549f5237-0d27-4590-9dc7-f74d9dd3b0ae_7po5fuocdevstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:35 devstack sudo[107758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_549f5237-0d27-4590-9dc7-f74d9dd3b0ae_7po5fuocdevstack@QuobyteHD Jul 30 17:08:35 devstack sudo[107758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:35 devstack sudo[107753]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-99e2f540-c048-417c-be83-2ed94b7b097c tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b13e35b1-7132-4ebd-ad79-b5aadc51721f 1073741824" returned: 0 in 0.532s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-99e2f540-c048-417c-be83-2ed94b7b097c tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b13e35b1-7132-4ebd-ad79-b5aadc51721f {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:36 devstack sudo[107758]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_549f5237-0d27-4590-9dc7-f74d9dd3b0ae_7po5fuocdevstack@QuobyteHD" returned: 0 in 0.377s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_549f5237-0d27-4590-9dc7-f74d9dd3b0ae_7po5fuocdevstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:36 devstack sudo[107766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b13e35b1-7132-4ebd-ad79-b5aadc51721f Jul 30 17:08:36 devstack sudo[107766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:36 devstack sudo[107768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_549f5237-0d27-4590-9dc7-f74d9dd3b0ae_7po5fuocdevstack@QuobyteHD Jul 30 17:08:36 devstack sudo[107768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:36 devstack sudo[107766]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-99e2f540-c048-417c-be83-2ed94b7b097c tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b13e35b1-7132-4ebd-ad79-b5aadc51721f" returned: 0 in 0.310s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:36 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-99e2f540-c048-417c-be83-2ed94b7b097c tempest-ProjectMemberTests-1145856324 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:08:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-99e2f540-c048-417c-be83-2ed94b7b097c tempest-ProjectMemberTests-1145856324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ee251b6b-6f7d-4e68-a53b-13b47f6dbaeb tempest-VolumeDependencyTests-500709084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.729s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:36 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ee251b6b-6f7d-4e68-a53b-13b47f6dbaeb tempest-VolumeDependencyTests-500709084 None] Acquiring lock "cinder-quobyte-182c8d60-c4d9-41f6-b152-a3dcd98cb4a1-492ebdb2-b6fa-4a35-be2c-63891133e3db" by "_create_volume_from_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:08:36 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-99e2f540-c048-417c-be83-2ed94b7b097c tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe400321-71ce-4967-be44-8940adccf28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b13e35b1-7132-4ebd-ad79-b5aadc51721f', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:36 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-99e2f540-c048-417c-be83-2ed94b7b097c tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ee49089-aa79-490c-baa1-07ead5aafdaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:36 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ee251b6b-6f7d-4e68-a53b-13b47f6dbaeb tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-182c8d60-c4d9-41f6-b152-a3dcd98cb4a1-492ebdb2-b6fa-4a35-be2c-63891133e3db" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:08:36 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ee251b6b-6f7d-4e68-a53b-13b47f6dbaeb tempest-VolumeDependencyTests-500709084 None] Creating volume 492ebdb2-b6fa-4a35-be2c-63891133e3db from snapshot 182c8d60-c4d9-41f6-b152-a3dcd98cb4a1 {{(pid=88591) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 30 17:08:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ee251b6b-6f7d-4e68-a53b-13b47f6dbaeb tempest-VolumeDependencyTests-500709084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ee251b6b-6f7d-4e68-a53b-13b47f6dbaeb tempest-VolumeDependencyTests-500709084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:36 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ee251b6b-6f7d-4e68-a53b-13b47f6dbaeb tempest-VolumeDependencyTests-500709084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:08:36 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ee251b6b-6f7d-4e68-a53b-13b47f6dbaeb tempest-VolumeDependencyTests-500709084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:08:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ee251b6b-6f7d-4e68-a53b-13b47f6dbaeb tempest-VolumeDependencyTests-500709084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:36 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ee251b6b-6f7d-4e68-a53b-13b47f6dbaeb tempest-VolumeDependencyTests-500709084 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:08:36 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ee251b6b-6f7d-4e68-a53b-13b47f6dbaeb tempest-VolumeDependencyTests-500709084 None] Acquiring lock "cinder-quobyte-492ebdb2-b6fa-4a35-be2c-63891133e3db" by "_copy_volume_from_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:08:36 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-99e2f540-c048-417c-be83-2ed94b7b097c tempest-ProjectMemberTests-1145856324 None] Volume volume-b13e35b1-7132-4ebd-ad79-b5aadc51721f (b13e35b1-7132-4ebd-ad79-b5aadc51721f): created successfully Jul 30 17:08:36 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-99e2f540-c048-417c-be83-2ed94b7b097c tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ee49089-aa79-490c-baa1-07ead5aafdaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:36 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-99e2f540-c048-417c-be83-2ed94b7b097c tempest-ProjectMemberTests-1145856324 None] Flow 'volume_create_manager' (05c53f6c-733b-4173-b14a-2e4eae4f3998) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:08:36 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ee251b6b-6f7d-4e68-a53b-13b47f6dbaeb tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-492ebdb2-b6fa-4a35-be2c-63891133e3db" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:08:36 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ee251b6b-6f7d-4e68-a53b-13b47f6dbaeb tempest-VolumeDependencyTests-500709084 None] snapshot: 182c8d60-c4d9-41f6-b152-a3dcd98cb4a1, volume: 492ebdb2-b6fa-4a35-be2c-63891133e3db, {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 17:08:36 devstack sudo[107768]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_549f5237-0d27-4590-9dc7-f74d9dd3b0ae_7po5fuocdevstack@QuobyteHD" returned: 1 in 0.359s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_549f5237-0d27-4590-9dc7-f74d9dd3b0ae_7po5fuocdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 17:08:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ee251b6b-6f7d-4e68-a53b-13b47f6dbaeb tempest-VolumeDependencyTests-500709084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ee251b6b-6f7d-4e68-a53b-13b47f6dbaeb tempest-VolumeDependencyTests-500709084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:36 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ee251b6b-6f7d-4e68-a53b-13b47f6dbaeb tempest-VolumeDependencyTests-500709084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:08:36 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ee251b6b-6f7d-4e68-a53b-13b47f6dbaeb tempest-VolumeDependencyTests-500709084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:08:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ee251b6b-6f7d-4e68-a53b-13b47f6dbaeb tempest-VolumeDependencyTests-500709084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:36 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-99e2f540-c048-417c-be83-2ed94b7b097c tempest-ProjectMemberTests-1145856324 None] Created volume successfully. Jul 30 17:08:36 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebb8801-25a2-47a7-ae7a-10ff0cecce3e]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:08:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ee251b6b-6f7d-4e68-a53b-13b47f6dbaeb tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011.182c8d60-c4d9-41f6-b152-a3dcd98cb4a1 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:36 devstack sudo[107774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011.182c8d60-c4d9-41f6-b152-a3dcd98cb4a1 Jul 30 17:08:36 devstack sudo[107774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:36 devstack sudo[107774]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ee251b6b-6f7d-4e68-a53b-13b47f6dbaeb tempest-VolumeDependencyTests-500709084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011.182c8d60-c4d9-41f6-b152-a3dcd98cb4a1" returned: 0 in 0.390s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:36 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-ee251b6b-6f7d-4e68-a53b-13b47f6dbaeb tempest-VolumeDependencyTests-500709084 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1afe0c3d-9641-4aeb-80a2-9551751f3011(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:08:36 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[00940d55-8448-400d-a36a-9c6159139aee]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:08:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ee251b6b-6f7d-4e68-a53b-13b47f6dbaeb tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:36 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe6b0bdc-034a-46f9-8b5a-e7e3bbee4572 tempest-CreateVolumesFromSnapshotTest-654342443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:08:36 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fe6b0bdc-034a-46f9-8b5a-e7e3bbee4572 tempest-CreateVolumesFromSnapshotTest-654342443 None] Flow 'volume_create_manager' (9de74835-e9e3-44a6-9fdc-d8d533fc53ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:08:36 devstack sudo[107779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011 Jul 30 17:08:36 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fe6b0bdc-034a-46f9-8b5a-e7e3bbee4572 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b699633-1479-470b-bc4d-6abee244758b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:36 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:36 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fe6b0bdc-034a-46f9-8b5a-e7e3bbee4572 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b699633-1479-470b-bc4d-6abee244758b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:08:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1130315205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e51f29ae-daaf-422b-ae26-a1ec598be3fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf26b5bad6894c7983357ed898b033b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:08:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:08:37Z,use_quota=True,user_id='9b033975bdb9430198a108890d26bedb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:36 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fe6b0bdc-034a-46f9-8b5a-e7e3bbee4572 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f80fb598-7306-4584-86ea-0bb754ed3f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:36 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fe6b0bdc-034a-46f9-8b5a-e7e3bbee4572 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f80fb598-7306-4584-86ea-0bb754ed3f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:36 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fe6b0bdc-034a-46f9-8b5a-e7e3bbee4572 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cef37fc-75d3-404e-8227-16e60450cf2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:37 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fe6b0bdc-034a-46f9-8b5a-e7e3bbee4572 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cef37fc-75d3-404e-8227-16e60450cf2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e51f29ae-daaf-422b-ae26-a1ec598be3fe', 'volume_name': 'volume-e51f29ae-daaf-422b-ae26-a1ec598be3fe', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:37 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fe6b0bdc-034a-46f9-8b5a-e7e3bbee4572 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07a14ce3-07c1-496e-8f73-9c06ac504f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:37 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fe6b0bdc-034a-46f9-8b5a-e7e3bbee4572 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07a14ce3-07c1-496e-8f73-9c06ac504f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:37 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fe6b0bdc-034a-46f9-8b5a-e7e3bbee4572 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc51dbf7-4f23-4d6f-9f74-3fddceebffb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:37 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-fe6b0bdc-034a-46f9-8b5a-e7e3bbee4572 tempest-CreateVolumesFromSnapshotTest-654342443 None] Volume e51f29ae-daaf-422b-ae26-a1ec598be3fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e51f29ae-daaf-422b-ae26-a1ec598be3fe', 'volume_size': 1} Jul 30 17:08:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-fe6b0bdc-034a-46f9-8b5a-e7e3bbee4572 tempest-CreateVolumesFromSnapshotTest-654342443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:37 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ee251b6b-6f7d-4e68-a53b-13b47f6dbaeb tempest-VolumeDependencyTests-500709084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011" returned: 0 in 0.395s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:37 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ee251b6b-6f7d-4e68-a53b-13b47f6dbaeb tempest-VolumeDependencyTests-500709084 None] will copy from snapshot at /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011 {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 17:08:37 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ee251b6b-6f7d-4e68-a53b-13b47f6dbaeb tempest-VolumeDependencyTests-500709084 None] Creating direct copy from snapshot {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 17:08:37 devstack cinder-volume[88591]: DEBUG cinder.utils [None req-ee251b6b-6f7d-4e68-a53b-13b47f6dbaeb tempest-VolumeDependencyTests-500709084 None] Path /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db not found in is_blk_device check {{(pid=88591) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 17:08:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ee251b6b-6f7d-4e68-a53b-13b47f6dbaeb tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:37 devstack sudo[107784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db Jul 30 17:08:37 devstack sudo[107784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c11ee4e5-6dd5-4123-bee8-3b6e6f41196a tempest-ProjectMemberTests-1145856324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:37 devstack sudo[107784]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ee251b6b-6f7d-4e68-a53b-13b47f6dbaeb tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db" returned: 0 in 0.441s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:37 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-ee251b6b-6f7d-4e68-a53b-13b47f6dbaeb tempest-VolumeDependencyTests-500709084 None] Image conversion details: src /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db {{(pid=88591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 17:08:37 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-ee251b6b-6f7d-4e68-a53b-13b47f6dbaeb tempest-VolumeDependencyTests-500709084 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 30 17:08:37 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-ee251b6b-6f7d-4e68-a53b-13b47f6dbaeb tempest-VolumeDependencyTests-500709084 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db is being set with open permissions: ugo+rw Jul 30 17:08:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ee251b6b-6f7d-4e68-a53b-13b47f6dbaeb tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:37 devstack sudo[107790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db Jul 30 17:08:37 devstack sudo[107790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:37 devstack sudo[107790]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ee251b6b-6f7d-4e68-a53b-13b47f6dbaeb tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db" returned: 0 in 0.248s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:37 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ee251b6b-6f7d-4e68-a53b-13b47f6dbaeb tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-492ebdb2-b6fa-4a35-be2c-63891133e3db" released by "_copy_volume_from_snapshot" :: held 1.562s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:08:37 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ee251b6b-6f7d-4e68-a53b-13b47f6dbaeb tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-182c8d60-c4d9-41f6-b152-a3dcd98cb4a1-492ebdb2-b6fa-4a35-be2c-63891133e3db" released by "_create_volume_from_snapshot" :: held 1.643s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:08:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ee251b6b-6f7d-4e68-a53b-13b47f6dbaeb tempest-VolumeDependencyTests-500709084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 1.679s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.594s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:37 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:08:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test0e20bd6e-440f-41d8-9b5d-fc047ac00423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e231878-9c22-44e8-a15d-565539d0fafa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f61df38a914ec2a6713104b0278991',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:08:34Z,use_quota=True,user_id='e4eedb818424482c9370625aced56a0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:08:37 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] Creating volume 1e231878-9c22-44e8-a15d-565539d0fafa {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:08:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:37 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:08:37 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:08:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:37 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:08:37 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:08:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:38 devstack sudo[107793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa 1073741824 Jul 30 17:08:38 devstack sudo[107793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:38 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ee251b6b-6f7d-4e68-a53b-13b47f6dbaeb tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2138eb8b-7734-40c5-aed8-960846a06a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-492ebdb2-b6fa-4a35-be2c-63891133e3db', 'volume_size': 1, 'snapshot_id': '182c8d60-c4d9-41f6-b152-a3dcd98cb4a1'}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:38 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ee251b6b-6f7d-4e68-a53b-13b47f6dbaeb tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00bf06a1-ed95-4a84-a851-0fecd687c816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:38 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-ee251b6b-6f7d-4e68-a53b-13b47f6dbaeb tempest-VolumeDependencyTests-500709084 None] Volume volume-492ebdb2-b6fa-4a35-be2c-63891133e3db (492ebdb2-b6fa-4a35-be2c-63891133e3db): created successfully Jul 30 17:08:38 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ee251b6b-6f7d-4e68-a53b-13b47f6dbaeb tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00bf06a1-ed95-4a84-a851-0fecd687c816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:38 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ee251b6b-6f7d-4e68-a53b-13b47f6dbaeb tempest-VolumeDependencyTests-500709084 None] Flow 'volume_create_manager' (90809225-dec4-4c36-a03b-44e6e5b69c18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:08:38 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-ee251b6b-6f7d-4e68-a53b-13b47f6dbaeb tempest-VolumeDependencyTests-500709084 None] Created volume successfully. Jul 30 17:08:38 devstack sudo[107793]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa 1073741824" returned: 0 in 0.423s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:38 devstack sudo[107798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa Jul 30 17:08:38 devstack sudo[107798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:38 devstack sudo[107798]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa" returned: 0 in 0.285s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:38 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:08:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-fe6b0bdc-034a-46f9-8b5a-e7e3bbee4572 tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.719s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:38 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-fe6b0bdc-034a-46f9-8b5a-e7e3bbee4572 tempest-CreateVolumesFromSnapshotTest-654342443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:08:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1130315205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e51f29ae-daaf-422b-ae26-a1ec598be3fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf26b5bad6894c7983357ed898b033b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:08:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:08:37Z,use_quota=True,user_id='9b033975bdb9430198a108890d26bedb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:08:38 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-fe6b0bdc-034a-46f9-8b5a-e7e3bbee4572 tempest-CreateVolumesFromSnapshotTest-654342443 None] Creating volume e51f29ae-daaf-422b-ae26-a1ec598be3fe {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:08:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-fe6b0bdc-034a-46f9-8b5a-e7e3bbee4572 tempest-CreateVolumesFromSnapshotTest-654342443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-fe6b0bdc-034a-46f9-8b5a-e7e3bbee4572 tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:38 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-fe6b0bdc-034a-46f9-8b5a-e7e3bbee4572 tempest-CreateVolumesFromSnapshotTest-654342443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:08:38 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-fe6b0bdc-034a-46f9-8b5a-e7e3bbee4572 tempest-CreateVolumesFromSnapshotTest-654342443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:08:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-fe6b0bdc-034a-46f9-8b5a-e7e3bbee4572 tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:38 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-fe6b0bdc-034a-46f9-8b5a-e7e3bbee4572 tempest-CreateVolumesFromSnapshotTest-654342443 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:08:38 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-fe6b0bdc-034a-46f9-8b5a-e7e3bbee4572 tempest-CreateVolumesFromSnapshotTest-654342443 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:08:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fe6b0bdc-034a-46f9-8b5a-e7e3bbee4572 tempest-CreateVolumesFromSnapshotTest-654342443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e51f29ae-daaf-422b-ae26-a1ec598be3fe 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:38 devstack sudo[107801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e51f29ae-daaf-422b-ae26-a1ec598be3fe 1073741824 Jul 30 17:08:38 devstack sudo[107801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:38 devstack cinder-volume[88591]: DEBUG cinder.volume.volume_utils [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] Attempting download of 549f5237-0d27-4590-9dc7-f74d9dd3b0ae ((None, [{'url': 'file:///opt/stack/data/glance/images/549f5237-0d27-4590-9dc7-f74d9dd3b0ae', 'metadata': {}}])) to volume 1e231878-9c22-44e8-a15d-565539d0fafa. {{(pid=88591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 30 17:08:38 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d515e55-45b5-46b3-ae00-95d56f3ba280]: (4, 'raw') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:08:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_549f5237-0d27-4590-9dc7-f74d9dd3b0ae_ydi1e6gf {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:38 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:08:38 devstack sudo[107803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_549f5237-0d27-4590-9dc7-f74d9dd3b0ae_ydi1e6gf Jul 30 17:08:38 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] Flow 'volume_create_manager' (0a045383-9987-4778-8a63-69d34c721106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:08:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9ab752b-425b-444b-a46f-f58d8c5908dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9ab752b-425b-444b-a46f-f58d8c5908dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:08:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1292092889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b827d622-7d7d-472b-af3a-d34394a60c06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75be733264504175956c041c2312fa52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:08:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=492ebdb2-b6fa-4a35-be2c-63891133e3db,status='creating',terminated_at=None,updated_at=2026-07-30T15:08:39Z,use_quota=True,user_id='9ee0dab1317a4cfeafb4f6b50ca81a57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acf2c6ca-259f-4cd9-8766-a084a8d8ba03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acf2c6ca-259f-4cd9-8766-a084a8d8ba03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (783500bd-b9ca-453a-a4b8-812508e41c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (783500bd-b9ca-453a-a4b8-812508e41c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b827d622-7d7d-472b-af3a-d34394a60c06', 'volume_name': 'volume-b827d622-7d7d-472b-af3a-d34394a60c06', 'volume_size': 1, 'source_volid': '492ebdb2-b6fa-4a35-be2c-63891133e3db', 'source_volstatus': 'available'}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60ef5f69-fe11-4136-ab99-8f4981c16b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60ef5f69-fe11-4136-ab99-8f4981c16b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67d53d2e-ac59-4131-b758-64453dea027b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:39 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] Volume b827d622-7d7d-472b-af3a-d34394a60c06: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b827d622-7d7d-472b-af3a-d34394a60c06', 'volume_size': 1, 'source_volid': '492ebdb2-b6fa-4a35-be2c-63891133e3db', 'source_volstatus': 'available'} Jul 30 17:08:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:39 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_549f5237-0d27-4590-9dc7-f74d9dd3b0ae_ydi1e6gf" returned: 0 in 0.395s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_549f5237-0d27-4590-9dc7-f74d9dd3b0ae_ydi1e6gf {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:39 devstack sudo[107801]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fe6b0bdc-034a-46f9-8b5a-e7e3bbee4572 tempest-CreateVolumesFromSnapshotTest-654342443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e51f29ae-daaf-422b-ae26-a1ec598be3fe 1073741824" returned: 0 in 0.508s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fe6b0bdc-034a-46f9-8b5a-e7e3bbee4572 tempest-CreateVolumesFromSnapshotTest-654342443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e51f29ae-daaf-422b-ae26-a1ec598be3fe {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:39 devstack sudo[107811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e51f29ae-daaf-422b-ae26-a1ec598be3fe Jul 30 17:08:39 devstack sudo[107811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:39 devstack sudo[107810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_549f5237-0d27-4590-9dc7-f74d9dd3b0ae_ydi1e6gf Jul 30 17:08:39 devstack sudo[107810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:39 devstack sudo[107811]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fe6b0bdc-034a-46f9-8b5a-e7e3bbee4572 tempest-CreateVolumesFromSnapshotTest-654342443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e51f29ae-daaf-422b-ae26-a1ec598be3fe" returned: 0 in 0.257s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:39 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-fe6b0bdc-034a-46f9-8b5a-e7e3bbee4572 tempest-CreateVolumesFromSnapshotTest-654342443 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:08:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-fe6b0bdc-034a-46f9-8b5a-e7e3bbee4572 tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c11ee4e5-6dd5-4123-bee8-3b6e6f41196a tempest-ProjectMemberTests-1145856324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.012s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:39 devstack sudo[107810]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fe6b0bdc-034a-46f9-8b5a-e7e3bbee4572 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc51dbf7-4f23-4d6f-9f74-3fddceebffb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e51f29ae-daaf-422b-ae26-a1ec598be3fe', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fe6b0bdc-034a-46f9-8b5a-e7e3bbee4572 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f758bd6-7098-43c1-8a4e-c2afaa7aa4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_549f5237-0d27-4590-9dc7-f74d9dd3b0ae_ydi1e6gf" returned: 1 in 0.359s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_549f5237-0d27-4590-9dc7-f74d9dd3b0ae_ydi1e6gf' failed. Not Retrying. {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 17:08:39 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-c11ee4e5-6dd5-4123-bee8-3b6e6f41196a tempest-ProjectMemberTests-1145856324 None] Creating offline snapshot 71d11a8b-187b-4f33-8de4-13d13298d016 of volume b13e35b1-7132-4ebd-ad79-b5aadc51721f {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:08:39 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b4d957-6835-471d-ad19-d288e14b810b]: (4, 'raw') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:08:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_549f5237-0d27-4590-9dc7-f74d9dd3b0ae_7po5fuocdevstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:39 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-fe6b0bdc-034a-46f9-8b5a-e7e3bbee4572 tempest-CreateVolumesFromSnapshotTest-654342443 None] Volume volume-e51f29ae-daaf-422b-ae26-a1ec598be3fe (e51f29ae-daaf-422b-ae26-a1ec598be3fe): created successfully Jul 30 17:08:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fe6b0bdc-034a-46f9-8b5a-e7e3bbee4572 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f758bd6-7098-43c1-8a4e-c2afaa7aa4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fe6b0bdc-034a-46f9-8b5a-e7e3bbee4572 tempest-CreateVolumesFromSnapshotTest-654342443 None] Flow 'volume_create_manager' (9de74835-e9e3-44a6-9fdc-d8d533fc53ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:08:39 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[329d20e2-9cb1-4c49-ad3e-d9dc75e83780]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:08:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c11ee4e5-6dd5-4123-bee8-3b6e6f41196a tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b13e35b1-7132-4ebd-ad79-b5aadc51721f {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:39 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-fe6b0bdc-034a-46f9-8b5a-e7e3bbee4572 tempest-CreateVolumesFromSnapshotTest-654342443 None] Created volume successfully. Jul 30 17:08:39 devstack sudo[107817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_549f5237-0d27-4590-9dc7-f74d9dd3b0ae_7po5fuocdevstack@QuobyteHD Jul 30 17:08:39 devstack sudo[107817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:39 devstack sudo[107818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b13e35b1-7132-4ebd-ad79-b5aadc51721f Jul 30 17:08:39 devstack sudo[107818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:39 devstack sudo[107817]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_549f5237-0d27-4590-9dc7-f74d9dd3b0ae_7po5fuocdevstack@QuobyteHD" returned: 0 in 0.341s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_549f5237-0d27-4590-9dc7-f74d9dd3b0ae_7po5fuocdevstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:40 devstack sudo[107818]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c11ee4e5-6dd5-4123-bee8-3b6e6f41196a tempest-ProjectMemberTests-1145856324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b13e35b1-7132-4ebd-ad79-b5aadc51721f" returned: 0 in 0.375s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c11ee4e5-6dd5-4123-bee8-3b6e6f41196a tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b13e35b1-7132-4ebd-ad79-b5aadc51721f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b13e35b1-7132-4ebd-ad79-b5aadc51721f.71d11a8b-187b-4f33-8de4-13d13298d016 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:40 devstack sudo[107827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b13e35b1-7132-4ebd-ad79-b5aadc51721f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b13e35b1-7132-4ebd-ad79-b5aadc51721f.71d11a8b-187b-4f33-8de4-13d13298d016 1G Jul 30 17:08:40 devstack sudo[107827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:40 devstack sudo[107825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_549f5237-0d27-4590-9dc7-f74d9dd3b0ae_7po5fuocdevstack@QuobyteHD Jul 30 17:08:40 devstack sudo[107825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-873388be-d866-4f1e-9916-528821768992 tempest-CreateVolumesFromSnapshotTest-654342443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:40 devstack sudo[107825]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_549f5237-0d27-4590-9dc7-f74d9dd3b0ae_7po5fuocdevstack@QuobyteHD" returned: 1 in 0.383s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_549f5237-0d27-4590-9dc7-f74d9dd3b0ae_7po5fuocdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 17:08:40 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] 549f5237-0d27-4590-9dc7-f74d9dd3b0ae was raw, converting to qcow2 {{(pid=88591) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 30 17:08:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_549f5237-0d27-4590-9dc7-f74d9dd3b0ae_7po5fuocdevstack@QuobyteHD /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:40 devstack sudo[107836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_549f5237-0d27-4590-9dc7-f74d9dd3b0ae_7po5fuocdevstack@QuobyteHD /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa Jul 30 17:08:40 devstack sudo[107836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:40 devstack sudo[107827]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c11ee4e5-6dd5-4123-bee8-3b6e6f41196a tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b13e35b1-7132-4ebd-ad79-b5aadc51721f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b13e35b1-7132-4ebd-ad79-b5aadc51721f.71d11a8b-187b-4f33-8de4-13d13298d016 1G" returned: 0 in 0.478s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c11ee4e5-6dd5-4123-bee8-3b6e6f41196a tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b13e35b1-7132-4ebd-ad79-b5aadc51721f -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b13e35b1-7132-4ebd-ad79-b5aadc51721f.71d11a8b-187b-4f33-8de4-13d13298d016 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:40 devstack sudo[107839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b13e35b1-7132-4ebd-ad79-b5aadc51721f -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b13e35b1-7132-4ebd-ad79-b5aadc51721f.71d11a8b-187b-4f33-8de4-13d13298d016 Jul 30 17:08:40 devstack sudo[107839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:40 devstack sudo[107836]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_549f5237-0d27-4590-9dc7-f74d9dd3b0ae_7po5fuocdevstack@QuobyteHD /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa" returned: 0 in 0.484s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:40 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_549f5237-0d27-4590-9dc7-f74d9dd3b0ae_7po5fuocdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa {{(pid=88591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 17:08:40 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] Converted 0.00 MB image at 0.00 MB/s Jul 30 17:08:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:40 devstack sudo[107839]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c11ee4e5-6dd5-4123-bee8-3b6e6f41196a tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b13e35b1-7132-4ebd-ad79-b5aadc51721f -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b13e35b1-7132-4ebd-ad79-b5aadc51721f.71d11a8b-187b-4f33-8de4-13d13298d016" returned: 0 in 0.342s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:40 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-c11ee4e5-6dd5-4123-bee8-3b6e6f41196a tempest-ProjectMemberTests-1145856324 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b13e35b1-7132-4ebd-ad79-b5aadc51721f.71d11a8b-187b-4f33-8de4-13d13298d016 is being set with open permissions: ugo+rw Jul 30 17:08:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c11ee4e5-6dd5-4123-bee8-3b6e6f41196a tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b13e35b1-7132-4ebd-ad79-b5aadc51721f.71d11a8b-187b-4f33-8de4-13d13298d016 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:40 devstack sudo[107847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa 1G Jul 30 17:08:40 devstack sudo[107847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:40 devstack sudo[107848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b13e35b1-7132-4ebd-ad79-b5aadc51721f.71d11a8b-187b-4f33-8de4-13d13298d016 Jul 30 17:08:40 devstack sudo[107848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:41 devstack sudo[107848]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c11ee4e5-6dd5-4123-bee8-3b6e6f41196a tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b13e35b1-7132-4ebd-ad79-b5aadc51721f.71d11a8b-187b-4f33-8de4-13d13298d016" returned: 0 in 0.262s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c11ee4e5-6dd5-4123-bee8-3b6e6f41196a tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b13e35b1-7132-4ebd-ad79-b5aadc51721f.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:41 devstack sudo[107847]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa 1G" returned: 0 in 0.326s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:41 devstack cinder-volume[88591]: DEBUG cinder.volume.volume_utils [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] Downloaded image 549f5237-0d27-4590-9dc7-f74d9dd3b0ae ((None, [{'url': 'file:///opt/stack/data/glance/images/549f5237-0d27-4590-9dc7-f74d9dd3b0ae', 'metadata': {}}])) to volume 1e231878-9c22-44e8-a15d-565539d0fafa successfully. {{(pid=88591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 30 17:08:41 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] Temporary image 549f5237-0d27-4590-9dc7-f74d9dd3b0ae for user e4eedb818424482c9370625aced56a0a is deleted. {{(pid=88591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 30 17:08:41 devstack cinder-volume[88591]: DEBUG cinder.volume.volume_utils [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] Marking volume 1e231878-9c22-44e8-a15d-565539d0fafa as bootable. {{(pid=88591) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 30 17:08:41 devstack sudo[107856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b13e35b1-7132-4ebd-ad79-b5aadc51721f.info Jul 30 17:08:41 devstack sudo[107856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:41 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] Copying metadata from image 549f5237-0d27-4590-9dc7-f74d9dd3b0ae to 1e231878-9c22-44e8-a15d-565539d0fafa. {{(pid=88591) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 30 17:08:41 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] Creating volume glance metadata for volume 1e231878-9c22-44e8-a15d-565539d0fafa backed by image 549f5237-0d27-4590-9dc7-f74d9dd3b0ae with: {'image_id': '549f5237-0d27-4590-9dc7-f74d9dd3b0ae', 'image_name': 'image-for-test-0e20bd6e-440f-41d8-9b5d-fc047ac00423', 'checksum': '0ec535f64c3786b1b148f1d582bdfc14', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88591) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 30 17:08:41 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4567c46c-519c-40e7-b40e-e89842233e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e231878-9c22-44e8-a15d-565539d0fafa', 'volume_size': 1, 'image_id': '549f5237-0d27-4590-9dc7-f74d9dd3b0ae', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/549f5237-0d27-4590-9dc7-f74d9dd3b0ae', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-0e20bd6e-440f-41d8-9b5d-fc047ac00423', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0ec535f64c3786b1b148f1d582bdfc14', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '58f61df38a914ec2a6713104b0278991', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '147a30d878ecc494a7a409e213ed0b6996be0d19f3fb24b421bc6f1438a71787248ec2547ca3c5b7f7a841cfee1788eb65501b4cc893c69f704bcfdae319ff31', 'id': '549f5237-0d27-4590-9dc7-f74d9dd3b0ae', 'created_at': datetime.datetime(2026, 7, 30, 15, 8, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 15, 8, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/549f5237-0d27-4590-9dc7-f74d9dd3b0ae/file', 'properties': {}}, 'image_service': }' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:41 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33cf6984-c976-4e06-bf42-6cc205b28bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:41 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] Volume volume-1e231878-9c22-44e8-a15d-565539d0fafa (1e231878-9c22-44e8-a15d-565539d0fafa): created successfully Jul 30 17:08:41 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33cf6984-c976-4e06-bf42-6cc205b28bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:41 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] Flow 'volume_create_manager' (0d9ece05-6c5f-4cbf-afbf-e4f9a56456c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:08:41 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-1b4fc005-65b9-4a78-a8de-375c15efc7e9 tempest-VolumeImageDependencyTests-1529416407 None] Created volume successfully. Jul 30 17:08:41 devstack sudo[107856]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c11ee4e5-6dd5-4123-bee8-3b6e6f41196a tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b13e35b1-7132-4ebd-ad79-b5aadc51721f.info" returned: 0 in 0.261s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:41 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-c11ee4e5-6dd5-4123-bee8-3b6e6f41196a tempest-ProjectMemberTests-1145856324 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b13e35b1-7132-4ebd-ad79-b5aadc51721f.info is being set with open permissions: ugo+rw Jul 30 17:08:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c11ee4e5-6dd5-4123-bee8-3b6e6f41196a tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b13e35b1-7132-4ebd-ad79-b5aadc51721f.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:41 devstack sudo[107859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b13e35b1-7132-4ebd-ad79-b5aadc51721f.info Jul 30 17:08:41 devstack sudo[107859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:41 devstack sudo[107859]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c11ee4e5-6dd5-4123-bee8-3b6e6f41196a tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b13e35b1-7132-4ebd-ad79-b5aadc51721f.info" returned: 0 in 0.252s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c11ee4e5-6dd5-4123-bee8-3b6e6f41196a tempest-ProjectMemberTests-1145856324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.120s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 2.579s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:41 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] Cloning volume 492ebdb2-b6fa-4a35-be2c-63891133e3db to volume b827d622-7d7d-472b-af3a-d34394a60c06 Jul 30 17:08:41 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-c11ee4e5-6dd5-4123-bee8-3b6e6f41196a tempest-ProjectMemberTests-1145856324 None] Create snapshot completed successfully Jul 30 17:08:41 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] Creating offline snapshot 099686ef-0723-42a9-bbcc-ed52eac4db65 of volume 492ebdb2-b6fa-4a35-be2c-63891133e3db {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:08:41 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5dfa29-bcd5-40ec-aff5-4bf5fad23395]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:08:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:41 devstack sudo[107862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db Jul 30 17:08:41 devstack sudo[107862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:42 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:08:42 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] Flow 'volume_create_manager' (0997ef3d-382a-48ed-ab73-c2dd7c4548f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:08:42 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3183f6c1-ce03-4b7d-92a6-d7fb7d6bf3fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:42 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3183f6c1-ce03-4b7d-92a6-d7fb7d6bf3fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume2-for-test-0e20bd6e-440f-41d8-9b5d-fc047ac00423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54bc1f11-e727-4577-870d-3000bbd16dca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f61df38a914ec2a6713104b0278991',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=1e231878-9c22-44e8-a15d-565539d0fafa,status='creating',terminated_at=None,updated_at=2026-07-30T15:08:42Z,use_quota=True,user_id='e4eedb818424482c9370625aced56a0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:42 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1a54947-4239-4a04-b7dd-cd335abf0885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:42 devstack sudo[107862]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:42 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1a54947-4239-4a04-b7dd-cd335abf0885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:42 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b605bcd3-b2de-44b6-b1c9-f16a6a9bab87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db" returned: 0 in 0.421s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db.099686ef-0723-42a9-bbcc-ed52eac4db65 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:42 devstack sudo[107867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db.099686ef-0723-42a9-bbcc-ed52eac4db65 1G Jul 30 17:08:42 devstack sudo[107867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:42 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b605bcd3-b2de-44b6-b1c9-f16a6a9bab87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '54bc1f11-e727-4577-870d-3000bbd16dca', 'volume_name': 'volume-54bc1f11-e727-4577-870d-3000bbd16dca', 'volume_size': 1, 'source_volid': '1e231878-9c22-44e8-a15d-565539d0fafa', 'source_volstatus': 'available'}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:42 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (714ecc26-da9b-4f60-8d15-ab35f9fc2dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:42 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (714ecc26-da9b-4f60-8d15-ab35f9fc2dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:42 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a25cf4f-55f1-4fe2-aeb5-989c54185d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:42 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] Volume 54bc1f11-e727-4577-870d-3000bbd16dca: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-54bc1f11-e727-4577-870d-3000bbd16dca', 'volume_size': 1, 'source_volid': '1e231878-9c22-44e8-a15d-565539d0fafa', 'source_volstatus': 'available'} Jul 30 17:08:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:42 devstack sudo[107867]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db.099686ef-0723-42a9-bbcc-ed52eac4db65 1G" returned: 0 in 0.379s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-492ebdb2-b6fa-4a35-be2c-63891133e3db -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db.099686ef-0723-42a9-bbcc-ed52eac4db65 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:42 devstack sudo[107873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-492ebdb2-b6fa-4a35-be2c-63891133e3db -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db.099686ef-0723-42a9-bbcc-ed52eac4db65 Jul 30 17:08:42 devstack sudo[107873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:42 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c720a06c-7468-40fa-9f38-98351cce8130 tempest-ProjectMemberTests-1145856324 None] Acquiring lock "cinder-71d11a8b-187b-4f33-8de4-13d13298d016-delete_snapshot" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:08:42 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c720a06c-7468-40fa-9f38-98351cce8130 tempest-ProjectMemberTests-1145856324 None] Lock "cinder-71d11a8b-187b-4f33-8de4-13d13298d016-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:08:42 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c720a06c-7468-40fa-9f38-98351cce8130 tempest-ProjectMemberTests-1145856324 None] Acquiring lock "cinder-quobyte-b13e35b1-7132-4ebd-ad79-b5aadc51721f" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:08:42 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c720a06c-7468-40fa-9f38-98351cce8130 tempest-ProjectMemberTests-1145856324 None] Lock "cinder-quobyte-b13e35b1-7132-4ebd-ad79-b5aadc51721f" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:08:42 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c720a06c-7468-40fa-9f38-98351cce8130 tempest-ProjectMemberTests-1145856324 None] Acquiring lock "cinder-quobyte-71d11a8b-187b-4f33-8de4-13d13298d016" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:08:42 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c720a06c-7468-40fa-9f38-98351cce8130 tempest-ProjectMemberTests-1145856324 None] Lock "cinder-quobyte-71d11a8b-187b-4f33-8de4-13d13298d016" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:08:42 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-c720a06c-7468-40fa-9f38-98351cce8130 tempest-ProjectMemberTests-1145856324 None] Deleting offline snapshot 71d11a8b-187b-4f33-8de4-13d13298d016 of volume b13e35b1-7132-4ebd-ad79-b5aadc51721f {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:08:42 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-c720a06c-7468-40fa-9f38-98351cce8130 tempest-ProjectMemberTests-1145856324 None] snapshot_file for this snap is: volume-b13e35b1-7132-4ebd-ad79-b5aadc51721f.71d11a8b-187b-4f33-8de4-13d13298d016 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:08:42 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[366fd761-598f-44db-861f-05aecbeaebd7]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:08:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c720a06c-7468-40fa-9f38-98351cce8130 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b13e35b1-7132-4ebd-ad79-b5aadc51721f.71d11a8b-187b-4f33-8de4-13d13298d016 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:42 devstack sudo[107873]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-492ebdb2-b6fa-4a35-be2c-63891133e3db -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db.099686ef-0723-42a9-bbcc-ed52eac4db65" returned: 0 in 0.327s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:42 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db.099686ef-0723-42a9-bbcc-ed52eac4db65 is being set with open permissions: ugo+rw Jul 30 17:08:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db.099686ef-0723-42a9-bbcc-ed52eac4db65 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:42 devstack sudo[107879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db.099686ef-0723-42a9-bbcc-ed52eac4db65 Jul 30 17:08:42 devstack sudo[107879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:42 devstack sudo[107878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b13e35b1-7132-4ebd-ad79-b5aadc51721f.71d11a8b-187b-4f33-8de4-13d13298d016 Jul 30 17:08:42 devstack sudo[107878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:43 devstack sudo[107879]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db.099686ef-0723-42a9-bbcc-ed52eac4db65" returned: 0 in 0.281s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:43 devstack sudo[107885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db.info Jul 30 17:08:43 devstack sudo[107885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:43 devstack sudo[107878]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c720a06c-7468-40fa-9f38-98351cce8130 tempest-ProjectMemberTests-1145856324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b13e35b1-7132-4ebd-ad79-b5aadc51721f.71d11a8b-187b-4f33-8de4-13d13298d016" returned: 0 in 0.387s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:43 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-c720a06c-7468-40fa-9f38-98351cce8130 tempest-ProjectMemberTests-1145856324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b13e35b1-7132-4ebd-ad79-b5aadc51721f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:08:43 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eca81a9-2fa9-496b-ac83-46cad5259dcd]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:08:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c720a06c-7468-40fa-9f38-98351cce8130 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b13e35b1-7132-4ebd-ad79-b5aadc51721f {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:43 devstack sudo[107888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b13e35b1-7132-4ebd-ad79-b5aadc51721f Jul 30 17:08:43 devstack sudo[107888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:43 devstack sudo[107885]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db.info" returned: 0 in 0.270s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:43 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db.info is being set with open permissions: ugo+rw Jul 30 17:08:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:43 devstack sudo[107891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db.info Jul 30 17:08:43 devstack sudo[107891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:43 devstack sudo[107888]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c720a06c-7468-40fa-9f38-98351cce8130 tempest-ProjectMemberTests-1145856324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b13e35b1-7132-4ebd-ad79-b5aadc51721f" returned: 0 in 0.367s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c720a06c-7468-40fa-9f38-98351cce8130 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b13e35b1-7132-4ebd-ad79-b5aadc51721f.71d11a8b-187b-4f33-8de4-13d13298d016 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:43 devstack sudo[107896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b13e35b1-7132-4ebd-ad79-b5aadc51721f.71d11a8b-187b-4f33-8de4-13d13298d016 Jul 30 17:08:43 devstack sudo[107896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:43 devstack sudo[107891]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db.info" returned: 0 in 0.267s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:43 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] Acquiring lock "cinder-quobyte-b827d622-7d7d-472b-af3a-d34394a60c06" by "_copy_volume_from_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:08:43 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-b827d622-7d7d-472b-af3a-d34394a60c06" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:08:43 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] snapshot: 099686ef-0723-42a9-bbcc-ed52eac4db65, volume: b827d622-7d7d-472b-af3a-d34394a60c06, {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 17:08:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:43 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:08:43 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:08:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:43 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[89733b62-bc0d-48b6-8495-c9bd94eedd91]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:08:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db.099686ef-0723-42a9-bbcc-ed52eac4db65 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:43 devstack sudo[107899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db.099686ef-0723-42a9-bbcc-ed52eac4db65 Jul 30 17:08:43 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:44 devstack sudo[107896]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c720a06c-7468-40fa-9f38-98351cce8130 tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b13e35b1-7132-4ebd-ad79-b5aadc51721f.71d11a8b-187b-4f33-8de4-13d13298d016" returned: 0 in 0.353s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c720a06c-7468-40fa-9f38-98351cce8130 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b13e35b1-7132-4ebd-ad79-b5aadc51721f.71d11a8b-187b-4f33-8de4-13d13298d016 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:44 devstack sudo[107904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b13e35b1-7132-4ebd-ad79-b5aadc51721f.71d11a8b-187b-4f33-8de4-13d13298d016 Jul 30 17:08:44 devstack sudo[107904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:44 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db.099686ef-0723-42a9-bbcc-ed52eac4db65" returned: 0 in 0.407s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:44 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-492ebdb2-b6fa-4a35-be2c-63891133e3db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:08:44 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b91bf7-09af-4c8d-89d5-3e1c1b03c0ed]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:08:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:44 devstack sudo[107904]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c720a06c-7468-40fa-9f38-98351cce8130 tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b13e35b1-7132-4ebd-ad79-b5aadc51721f.71d11a8b-187b-4f33-8de4-13d13298d016" returned: 0 in 0.273s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:44 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c720a06c-7468-40fa-9f38-98351cce8130 tempest-ProjectMemberTests-1145856324 None] Lock "cinder-quobyte-71d11a8b-187b-4f33-8de4-13d13298d016" released by "_delete_snapshot" :: held 1.492s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:08:44 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c720a06c-7468-40fa-9f38-98351cce8130 tempest-ProjectMemberTests-1145856324 None] Lock "cinder-quobyte-b13e35b1-7132-4ebd-ad79-b5aadc51721f" released by "delete_snapshot" :: held 1.515s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:08:44 devstack sudo[107909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db Jul 30 17:08:44 devstack sudo[107909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:44 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-c720a06c-7468-40fa-9f38-98351cce8130 tempest-ProjectMemberTests-1145856324 None] Created reservations ['2ee3be32-b70b-47f3-9f6c-62c0a2333288', '77fc3bad-7731-49cd-8b02-c5bd3337b838', '6d033c9a-2bde-4911-b7a0-6f0e2f803654', '6b686ffa-d1ec-4c71-901e-ecf8ba2d6c97'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:08:44 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-c720a06c-7468-40fa-9f38-98351cce8130 tempest-ProjectMemberTests-1145856324 None] Delete snapshot completed successfully. Jul 30 17:08:44 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c720a06c-7468-40fa-9f38-98351cce8130 tempest-ProjectMemberTests-1145856324 None] Lock "cinder-71d11a8b-187b-4f33-8de4-13d13298d016-delete_snapshot" released by "delete_snapshot" :: held 1.670s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:08:44 devstack sudo[107909]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db" returned: 0 in 0.381s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:44 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] will copy from snapshot at /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 17:08:44 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] Creating direct copy from snapshot {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 17:08:44 devstack cinder-volume[88591]: DEBUG cinder.utils [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] Path /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b827d622-7d7d-472b-af3a-d34394a60c06 not found in is_blk_device check {{(pid=88591) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 17:08:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b827d622-7d7d-472b-af3a-d34394a60c06 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:44 devstack sudo[107915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b827d622-7d7d-472b-af3a-d34394a60c06 Jul 30 17:08:44 devstack sudo[107915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:44 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d6861138-7409-406a-a92a-d7cd43476411 tempest-ProjectMemberTests-1145856324 None] Acquiring lock "cinder-b13e35b1-7132-4ebd-ad79-b5aadc51721f-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:08:44 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d6861138-7409-406a-a92a-d7cd43476411 tempest-ProjectMemberTests-1145856324 None] Lock "cinder-b13e35b1-7132-4ebd-ad79-b5aadc51721f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:08:45 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d6861138-7409-406a-a92a-d7cd43476411 tempest-ProjectMemberTests-1145856324 None] Acquiring lock "cinder-quobyte-b13e35b1-7132-4ebd-ad79-b5aadc51721f" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:08:45 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d6861138-7409-406a-a92a-d7cd43476411 tempest-ProjectMemberTests-1145856324 None] Lock "cinder-quobyte-b13e35b1-7132-4ebd-ad79-b5aadc51721f" acquired by "delete_volume" :: waited 0.018s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:08:45 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da9811a-baff-49ce-946b-8644535a714f]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:08:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d6861138-7409-406a-a92a-d7cd43476411 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b13e35b1-7132-4ebd-ad79-b5aadc51721f {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:45 devstack sudo[107915]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b827d622-7d7d-472b-af3a-d34394a60c06" returned: 0 in 0.521s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:45 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] Image conversion details: src /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b827d622-7d7d-472b-af3a-d34394a60c06 {{(pid=88591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 17:08:45 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 30 17:08:45 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b827d622-7d7d-472b-af3a-d34394a60c06 is being set with open permissions: ugo+rw Jul 30 17:08:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b827d622-7d7d-472b-af3a-d34394a60c06 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:45 devstack sudo[107921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b827d622-7d7d-472b-af3a-d34394a60c06 Jul 30 17:08:45 devstack sudo[107921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:45 devstack sudo[107920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b13e35b1-7132-4ebd-ad79-b5aadc51721f Jul 30 17:08:45 devstack sudo[107920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:45 devstack sudo[107921]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b827d622-7d7d-472b-af3a-d34394a60c06" returned: 0 in 0.260s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:45 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-b827d622-7d7d-472b-af3a-d34394a60c06" released by "_copy_volume_from_snapshot" :: held 1.637s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:08:45 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] Acquiring lock "cinder-quobyte-099686ef-0723-42a9-bbcc-ed52eac4db65" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:08:45 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-099686ef-0723-42a9-bbcc-ed52eac4db65" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:08:45 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] Deleting offline snapshot 099686ef-0723-42a9-bbcc-ed52eac4db65 of volume 492ebdb2-b6fa-4a35-be2c-63891133e3db {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:08:45 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] snapshot_file for this snap is: volume-492ebdb2-b6fa-4a35-be2c-63891133e3db.099686ef-0723-42a9-bbcc-ed52eac4db65 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:08:45 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[503b41b5-fe1d-4052-8f14-23c42859f522]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:08:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db.099686ef-0723-42a9-bbcc-ed52eac4db65 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:45 devstack sudo[107920]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d6861138-7409-406a-a92a-d7cd43476411 tempest-ProjectMemberTests-1145856324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b13e35b1-7132-4ebd-ad79-b5aadc51721f" returned: 0 in 0.392s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d6861138-7409-406a-a92a-d7cd43476411 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b13e35b1-7132-4ebd-ad79-b5aadc51721f {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:45 devstack sudo[107929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b13e35b1-7132-4ebd-ad79-b5aadc51721f Jul 30 17:08:45 devstack sudo[107929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:45 devstack sudo[107928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db.099686ef-0723-42a9-bbcc-ed52eac4db65 Jul 30 17:08:45 devstack sudo[107928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:45 devstack sudo[107929]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d6861138-7409-406a-a92a-d7cd43476411 tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b13e35b1-7132-4ebd-ad79-b5aadc51721f" returned: 0 in 0.260s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:45 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d6861138-7409-406a-a92a-d7cd43476411 tempest-ProjectMemberTests-1145856324 None] Lock "cinder-quobyte-b13e35b1-7132-4ebd-ad79-b5aadc51721f" released by "delete_volume" :: held 0.716s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:08:45 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-d6861138-7409-406a-a92a-d7cd43476411 tempest-ProjectMemberTests-1145856324 None] Created reservations ['ead0b45a-35e7-4221-adeb-786e41d88662', '4a792323-196c-4c2f-b837-38ac817d43d4', '1151da34-5ef7-4f08-aec8-7e0661ec256d', '8fed0ce5-cd2a-4f07-8e9b-e68257f46d04'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:08:45 devstack sudo[107928]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db.099686ef-0723-42a9-bbcc-ed52eac4db65" returned: 0 in 0.377s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:45 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-492ebdb2-b6fa-4a35-be2c-63891133e3db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:08:45 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfba2763-4287-4af6-bfe5-5d76d10ed785]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:08:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d6861138-7409-406a-a92a-d7cd43476411 tempest-ProjectMemberTests-1145856324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d6861138-7409-406a-a92a-d7cd43476411 tempest-ProjectMemberTests-1145856324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:45 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d6861138-7409-406a-a92a-d7cd43476411 tempest-ProjectMemberTests-1145856324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:08:45 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d6861138-7409-406a-a92a-d7cd43476411 tempest-ProjectMemberTests-1145856324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:08:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d6861138-7409-406a-a92a-d7cd43476411 tempest-ProjectMemberTests-1145856324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d6861138-7409-406a-a92a-d7cd43476411 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:45 devstack sudo[107937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:08:45 devstack sudo[107937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:45 devstack sudo[107936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db Jul 30 17:08:45 devstack sudo[107936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:46 devstack sudo[107937]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d6861138-7409-406a-a92a-d7cd43476411 tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.281s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:46 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-d6861138-7409-406a-a92a-d7cd43476411 tempest-ProjectMemberTests-1145856324 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:08:46 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-d6861138-7409-406a-a92a-d7cd43476411 tempest-ProjectMemberTests-1145856324 None] Deleted volume successfully. Jul 30 17:08:46 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d6861138-7409-406a-a92a-d7cd43476411 tempest-ProjectMemberTests-1145856324 None] Lock "cinder-b13e35b1-7132-4ebd-ad79-b5aadc51721f-delete_volume" released by "delete_volume" :: held 1.272s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:08:46 devstack sudo[107936]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db" returned: 0 in 0.456s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db.099686ef-0723-42a9-bbcc-ed52eac4db65 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:46 devstack sudo[107944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db.099686ef-0723-42a9-bbcc-ed52eac4db65 Jul 30 17:08:46 devstack sudo[107944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:46 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab5087e1-07ec-4304-87c3-c4994808ad08 tempest-ProjectMemberTests-1145856324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:08:46 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ab5087e1-07ec-4304-87c3-c4994808ad08 tempest-ProjectMemberTests-1145856324 None] Flow 'volume_create_manager' (192e0f17-772c-4081-89eb-d14635dba105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:08:46 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ab5087e1-07ec-4304-87c3-c4994808ad08 tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (117d0930-8473-4d69-84b0-ed2c61066e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:46 devstack sudo[107944]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:46 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ab5087e1-07ec-4304-87c3-c4994808ad08 tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (117d0930-8473-4d69-84b0-ed2c61066e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:08:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2122362731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f62deeb-1217-4416-854e-b6e5d09b3b63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26c22addd8364bc982bc8002f431ee32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:08:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:08:47Z,use_quota=True,user_id='c9da4889b5dd47d3bb88b442a104a944',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:46 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ab5087e1-07ec-4304-87c3-c4994808ad08 tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce868148-14ee-4031-8afe-64d83d5ff45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:46 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ab5087e1-07ec-4304-87c3-c4994808ad08 tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce868148-14ee-4031-8afe-64d83d5ff45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:46 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ab5087e1-07ec-4304-87c3-c4994808ad08 tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b226f9eb-d153-4ab7-82e8-36794dde352f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:46 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ab5087e1-07ec-4304-87c3-c4994808ad08 tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b226f9eb-d153-4ab7-82e8-36794dde352f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f62deeb-1217-4416-854e-b6e5d09b3b63', 'volume_name': 'volume-0f62deeb-1217-4416-854e-b6e5d09b3b63', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:46 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ab5087e1-07ec-4304-87c3-c4994808ad08 tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (182b1244-a64b-42b8-b7bf-b9e11c6f9a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:46 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ab5087e1-07ec-4304-87c3-c4994808ad08 tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (182b1244-a64b-42b8-b7bf-b9e11c6f9a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:46 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ab5087e1-07ec-4304-87c3-c4994808ad08 tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a754fc5a-3ef5-43a1-8062-4031c9ec149a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:46 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-ab5087e1-07ec-4304-87c3-c4994808ad08 tempest-ProjectMemberTests-1145856324 None] Volume 0f62deeb-1217-4416-854e-b6e5d09b3b63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f62deeb-1217-4416-854e-b6e5d09b3b63', 'volume_size': 1} Jul 30 17:08:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ab5087e1-07ec-4304-87c3-c4994808ad08 tempest-ProjectMemberTests-1145856324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db.099686ef-0723-42a9-bbcc-ed52eac4db65" returned: 0 in 0.410s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db.099686ef-0723-42a9-bbcc-ed52eac4db65 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:46 devstack sudo[107949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db.099686ef-0723-42a9-bbcc-ed52eac4db65 Jul 30 17:08:46 devstack sudo[107949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:47 devstack sudo[107949]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db.099686ef-0723-42a9-bbcc-ed52eac4db65" returned: 0 in 0.257s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:47 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-099686ef-0723-42a9-bbcc-ed52eac4db65" released by "_delete_snapshot" :: held 1.598s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:08:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 5.380s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-873388be-d866-4f1e-9916-528821768992 tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.763s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:47 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-873388be-d866-4f1e-9916-528821768992 tempest-CreateVolumesFromSnapshotTest-654342443 None] Creating offline snapshot ac10703d-00b1-4781-aa19-c75548df31e1 of volume e51f29ae-daaf-422b-ae26-a1ec598be3fe {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:08:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67d53d2e-ac59-4131-b758-64453dea027b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b827d622-7d7d-472b-af3a-d34394a60c06', 'volume_size': 1, 'source_volid': '492ebdb2-b6fa-4a35-be2c-63891133e3db', 'source_volstatus': 'available'}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d66e212f-5980-4973-a63e-07dbd7f7e54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:47 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[eedb5837-1816-4950-9c12-5c1cd3555d83]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:08:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-873388be-d866-4f1e-9916-528821768992 tempest-CreateVolumesFromSnapshotTest-654342443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e51f29ae-daaf-422b-ae26-a1ec598be3fe {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:47 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] Volume volume-b827d622-7d7d-472b-af3a-d34394a60c06 (b827d622-7d7d-472b-af3a-d34394a60c06): created successfully Jul 30 17:08:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d66e212f-5980-4973-a63e-07dbd7f7e54a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] Flow 'volume_create_manager' (0a045383-9987-4778-8a63-69d34c721106) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:08:47 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-fb1c6b39-3068-44fd-a83b-b46bea06eafb tempest-VolumeDependencyTests-500709084 None] Created volume successfully. Jul 30 17:08:47 devstack sudo[107952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e51f29ae-daaf-422b-ae26-a1ec598be3fe Jul 30 17:08:47 devstack sudo[107952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:47 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ba139859-37b7-4b7e-bb56-f8f9d9672d9d tempest-VolumeDependencyTests-500709084 None] Acquiring lock "cinder-bbc6cbe5-cc39-4825-a916-e0c5bf466d4d-delete_snapshot" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:08:47 devstack sudo[107952]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-873388be-d866-4f1e-9916-528821768992 tempest-CreateVolumesFromSnapshotTest-654342443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e51f29ae-daaf-422b-ae26-a1ec598be3fe" returned: 0 in 0.374s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-873388be-d866-4f1e-9916-528821768992 tempest-CreateVolumesFromSnapshotTest-654342443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e51f29ae-daaf-422b-ae26-a1ec598be3fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e51f29ae-daaf-422b-ae26-a1ec598be3fe.ac10703d-00b1-4781-aa19-c75548df31e1 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:47 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ba139859-37b7-4b7e-bb56-f8f9d9672d9d tempest-VolumeDependencyTests-500709084 None] Lock "cinder-bbc6cbe5-cc39-4825-a916-e0c5bf466d4d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:08:47 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ba139859-37b7-4b7e-bb56-f8f9d9672d9d tempest-VolumeDependencyTests-500709084 None] Acquiring lock "cinder-quobyte-fef4ded4-31f8-458e-83a4-2afaa037f927" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:08:47 devstack sudo[107957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e51f29ae-daaf-422b-ae26-a1ec598be3fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e51f29ae-daaf-422b-ae26-a1ec598be3fe.ac10703d-00b1-4781-aa19-c75548df31e1 1G Jul 30 17:08:47 devstack sudo[107957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:47 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ba139859-37b7-4b7e-bb56-f8f9d9672d9d tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-fef4ded4-31f8-458e-83a4-2afaa037f927" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:08:47 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ba139859-37b7-4b7e-bb56-f8f9d9672d9d tempest-VolumeDependencyTests-500709084 None] Acquiring lock "cinder-quobyte-bbc6cbe5-cc39-4825-a916-e0c5bf466d4d" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:08:47 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ba139859-37b7-4b7e-bb56-f8f9d9672d9d tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-bbc6cbe5-cc39-4825-a916-e0c5bf466d4d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:08:47 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-ba139859-37b7-4b7e-bb56-f8f9d9672d9d tempest-VolumeDependencyTests-500709084 None] Deleting offline snapshot bbc6cbe5-cc39-4825-a916-e0c5bf466d4d of volume fef4ded4-31f8-458e-83a4-2afaa037f927 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:08:47 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-ba139859-37b7-4b7e-bb56-f8f9d9672d9d tempest-VolumeDependencyTests-500709084 None] snapshot_file for this snap is: volume-fef4ded4-31f8-458e-83a4-2afaa037f927.bbc6cbe5-cc39-4825-a916-e0c5bf466d4d {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:08:47 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c87458e-6d8a-4e74-8a5b-6ba86dfd11aa]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:08:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ba139859-37b7-4b7e-bb56-f8f9d9672d9d tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef4ded4-31f8-458e-83a4-2afaa037f927.bbc6cbe5-cc39-4825-a916-e0c5bf466d4d {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:47 devstack sudo[107959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef4ded4-31f8-458e-83a4-2afaa037f927.bbc6cbe5-cc39-4825-a916-e0c5bf466d4d Jul 30 17:08:47 devstack sudo[107959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:47 devstack sudo[107957]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-873388be-d866-4f1e-9916-528821768992 tempest-CreateVolumesFromSnapshotTest-654342443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e51f29ae-daaf-422b-ae26-a1ec598be3fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e51f29ae-daaf-422b-ae26-a1ec598be3fe.ac10703d-00b1-4781-aa19-c75548df31e1 1G" returned: 0 in 0.400s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-873388be-d866-4f1e-9916-528821768992 tempest-CreateVolumesFromSnapshotTest-654342443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e51f29ae-daaf-422b-ae26-a1ec598be3fe -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e51f29ae-daaf-422b-ae26-a1ec598be3fe.ac10703d-00b1-4781-aa19-c75548df31e1 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:47 devstack sudo[107964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e51f29ae-daaf-422b-ae26-a1ec598be3fe -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e51f29ae-daaf-422b-ae26-a1ec598be3fe.ac10703d-00b1-4781-aa19-c75548df31e1 Jul 30 17:08:47 devstack sudo[107964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:47 devstack sudo[107959]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ba139859-37b7-4b7e-bb56-f8f9d9672d9d tempest-VolumeDependencyTests-500709084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef4ded4-31f8-458e-83a4-2afaa037f927.bbc6cbe5-cc39-4825-a916-e0c5bf466d4d" returned: 0 in 0.397s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:48 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-ba139859-37b7-4b7e-bb56-f8f9d9672d9d tempest-VolumeDependencyTests-500709084 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fef4ded4-31f8-458e-83a4-2afaa037f927(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:08:48 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[64af8edf-7215-4d10-b274-a01802578781]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:08:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ba139859-37b7-4b7e-bb56-f8f9d9672d9d tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef4ded4-31f8-458e-83a4-2afaa037f927 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:48 devstack sudo[107969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef4ded4-31f8-458e-83a4-2afaa037f927 Jul 30 17:08:48 devstack sudo[107969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:48 devstack sudo[107964]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-873388be-d866-4f1e-9916-528821768992 tempest-CreateVolumesFromSnapshotTest-654342443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e51f29ae-daaf-422b-ae26-a1ec598be3fe -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e51f29ae-daaf-422b-ae26-a1ec598be3fe.ac10703d-00b1-4781-aa19-c75548df31e1" returned: 0 in 0.334s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:48 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-873388be-d866-4f1e-9916-528821768992 tempest-CreateVolumesFromSnapshotTest-654342443 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e51f29ae-daaf-422b-ae26-a1ec598be3fe.ac10703d-00b1-4781-aa19-c75548df31e1 is being set with open permissions: ugo+rw Jul 30 17:08:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-873388be-d866-4f1e-9916-528821768992 tempest-CreateVolumesFromSnapshotTest-654342443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e51f29ae-daaf-422b-ae26-a1ec598be3fe.ac10703d-00b1-4781-aa19-c75548df31e1 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:48 devstack sudo[107974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e51f29ae-daaf-422b-ae26-a1ec598be3fe.ac10703d-00b1-4781-aa19-c75548df31e1 Jul 30 17:08:48 devstack sudo[107974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:48 devstack sudo[107974]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-873388be-d866-4f1e-9916-528821768992 tempest-CreateVolumesFromSnapshotTest-654342443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e51f29ae-daaf-422b-ae26-a1ec598be3fe.ac10703d-00b1-4781-aa19-c75548df31e1" returned: 0 in 0.265s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-873388be-d866-4f1e-9916-528821768992 tempest-CreateVolumesFromSnapshotTest-654342443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e51f29ae-daaf-422b-ae26-a1ec598be3fe.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:48 devstack sudo[107979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e51f29ae-daaf-422b-ae26-a1ec598be3fe.info Jul 30 17:08:48 devstack sudo[107979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:48 devstack sudo[107969]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ba139859-37b7-4b7e-bb56-f8f9d9672d9d tempest-VolumeDependencyTests-500709084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef4ded4-31f8-458e-83a4-2afaa037f927" returned: 0 in 0.569s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ba139859-37b7-4b7e-bb56-f8f9d9672d9d tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef4ded4-31f8-458e-83a4-2afaa037f927.bbc6cbe5-cc39-4825-a916-e0c5bf466d4d {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:48 devstack sudo[107982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef4ded4-31f8-458e-83a4-2afaa037f927.bbc6cbe5-cc39-4825-a916-e0c5bf466d4d Jul 30 17:08:48 devstack sudo[107982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:48 devstack sudo[107979]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-873388be-d866-4f1e-9916-528821768992 tempest-CreateVolumesFromSnapshotTest-654342443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e51f29ae-daaf-422b-ae26-a1ec598be3fe.info" returned: 0 in 0.325s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:48 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-873388be-d866-4f1e-9916-528821768992 tempest-CreateVolumesFromSnapshotTest-654342443 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e51f29ae-daaf-422b-ae26-a1ec598be3fe.info is being set with open permissions: ugo+rw Jul 30 17:08:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-873388be-d866-4f1e-9916-528821768992 tempest-CreateVolumesFromSnapshotTest-654342443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e51f29ae-daaf-422b-ae26-a1ec598be3fe.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:48 devstack sudo[107988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e51f29ae-daaf-422b-ae26-a1ec598be3fe.info Jul 30 17:08:48 devstack sudo[107988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:48 devstack sudo[107982]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ba139859-37b7-4b7e-bb56-f8f9d9672d9d tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef4ded4-31f8-458e-83a4-2afaa037f927.bbc6cbe5-cc39-4825-a916-e0c5bf466d4d" returned: 0 in 0.370s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ba139859-37b7-4b7e-bb56-f8f9d9672d9d tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef4ded4-31f8-458e-83a4-2afaa037f927.bbc6cbe5-cc39-4825-a916-e0c5bf466d4d {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:48 devstack sudo[107990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef4ded4-31f8-458e-83a4-2afaa037f927.bbc6cbe5-cc39-4825-a916-e0c5bf466d4d Jul 30 17:08:48 devstack sudo[107990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:49 devstack sudo[107988]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-873388be-d866-4f1e-9916-528821768992 tempest-CreateVolumesFromSnapshotTest-654342443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e51f29ae-daaf-422b-ae26-a1ec598be3fe.info" returned: 0 in 0.263s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-873388be-d866-4f1e-9916-528821768992 tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.064s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 6.907s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:49 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] Cloning volume 1e231878-9c22-44e8-a15d-565539d0fafa to volume 54bc1f11-e727-4577-870d-3000bbd16dca Jul 30 17:08:49 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-873388be-d866-4f1e-9916-528821768992 tempest-CreateVolumesFromSnapshotTest-654342443 None] Create snapshot completed successfully Jul 30 17:08:49 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] Creating offline snapshot 5edacf39-77bc-43a2-b03c-442a34350bd1 of volume 1e231878-9c22-44e8-a15d-565539d0fafa {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:08:49 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f74fbe-02a5-4959-bbdf-2f1d61a8e18f]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:08:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:49 devstack sudo[107990]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ba139859-37b7-4b7e-bb56-f8f9d9672d9d tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef4ded4-31f8-458e-83a4-2afaa037f927.bbc6cbe5-cc39-4825-a916-e0c5bf466d4d" returned: 0 in 0.288s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:49 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ba139859-37b7-4b7e-bb56-f8f9d9672d9d tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-bbc6cbe5-cc39-4825-a916-e0c5bf466d4d" released by "_delete_snapshot" :: held 1.758s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:08:49 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ba139859-37b7-4b7e-bb56-f8f9d9672d9d tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-fef4ded4-31f8-458e-83a4-2afaa037f927" released by "delete_snapshot" :: held 1.789s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:08:49 devstack sudo[107994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa Jul 30 17:08:49 devstack sudo[107994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:49 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-ba139859-37b7-4b7e-bb56-f8f9d9672d9d tempest-VolumeDependencyTests-500709084 None] Created reservations ['ac7e6a9a-371d-4ca8-be8c-a6ca19892d05', '64df416b-4d88-4d23-9d77-e9128a1ed29c', '4d5762f7-f392-4d19-9043-641333de2a7d', 'd648ffd3-37d4-4d3b-b633-322a6ec47d0d'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:08:49 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-ba139859-37b7-4b7e-bb56-f8f9d9672d9d tempest-VolumeDependencyTests-500709084 None] Delete snapshot completed successfully. Jul 30 17:08:49 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ba139859-37b7-4b7e-bb56-f8f9d9672d9d tempest-VolumeDependencyTests-500709084 None] Lock "cinder-bbc6cbe5-cc39-4825-a916-e0c5bf466d4d-delete_snapshot" released by "delete_snapshot" :: held 1.948s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:08:49 devstack sudo[107994]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa" returned: 0 in 0.399s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa.5edacf39-77bc-43a2-b03c-442a34350bd1 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:49 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b721ed43-b27d-49e8-9c31-a16b078996f7 tempest-VolumeDependencyTests-500709084 None] Acquiring lock "cinder-182c8d60-c4d9-41f6-b152-a3dcd98cb4a1-delete_snapshot" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:08:49 devstack sudo[107999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa.5edacf39-77bc-43a2-b03c-442a34350bd1 1G Jul 30 17:08:49 devstack sudo[107999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:49 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b721ed43-b27d-49e8-9c31-a16b078996f7 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-182c8d60-c4d9-41f6-b152-a3dcd98cb4a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:08:49 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b721ed43-b27d-49e8-9c31-a16b078996f7 tempest-VolumeDependencyTests-500709084 None] Acquiring lock "cinder-quobyte-1afe0c3d-9641-4aeb-80a2-9551751f3011" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:08:49 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b721ed43-b27d-49e8-9c31-a16b078996f7 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-1afe0c3d-9641-4aeb-80a2-9551751f3011" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:08:49 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b721ed43-b27d-49e8-9c31-a16b078996f7 tempest-VolumeDependencyTests-500709084 None] Acquiring lock "cinder-quobyte-182c8d60-c4d9-41f6-b152-a3dcd98cb4a1" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:08:49 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b721ed43-b27d-49e8-9c31-a16b078996f7 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-182c8d60-c4d9-41f6-b152-a3dcd98cb4a1" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:08:49 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-b721ed43-b27d-49e8-9c31-a16b078996f7 tempest-VolumeDependencyTests-500709084 None] Deleting offline snapshot 182c8d60-c4d9-41f6-b152-a3dcd98cb4a1 of volume 1afe0c3d-9641-4aeb-80a2-9551751f3011 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:08:49 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-b721ed43-b27d-49e8-9c31-a16b078996f7 tempest-VolumeDependencyTests-500709084 None] snapshot_file for this snap is: volume-1afe0c3d-9641-4aeb-80a2-9551751f3011.182c8d60-c4d9-41f6-b152-a3dcd98cb4a1 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:08:49 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0aee86-af69-4d52-9160-2a4e7c9edf04]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:08:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b721ed43-b27d-49e8-9c31-a16b078996f7 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011.182c8d60-c4d9-41f6-b152-a3dcd98cb4a1 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:49 devstack sudo[108001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011.182c8d60-c4d9-41f6-b152-a3dcd98cb4a1 Jul 30 17:08:49 devstack sudo[108001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:50 devstack sudo[107999]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa.5edacf39-77bc-43a2-b03c-442a34350bd1 1G" returned: 0 in 0.528s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e231878-9c22-44e8-a15d-565539d0fafa -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa.5edacf39-77bc-43a2-b03c-442a34350bd1 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:50 devstack sudo[108009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e231878-9c22-44e8-a15d-565539d0fafa -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa.5edacf39-77bc-43a2-b03c-442a34350bd1 Jul 30 17:08:50 devstack sudo[108009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:50 devstack sudo[108001]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b721ed43-b27d-49e8-9c31-a16b078996f7 tempest-VolumeDependencyTests-500709084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011.182c8d60-c4d9-41f6-b152-a3dcd98cb4a1" returned: 0 in 0.468s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:50 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-b721ed43-b27d-49e8-9c31-a16b078996f7 tempest-VolumeDependencyTests-500709084 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1afe0c3d-9641-4aeb-80a2-9551751f3011(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:08:50 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8204cc82-681a-4473-a1e1-ccb207348e33]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:08:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b721ed43-b27d-49e8-9c31-a16b078996f7 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:50 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-f17a4ab3-a1b3-4bd4-b8ec-8a34cb5e0e3f tempest-CreateVolumesFromSnapshotTest-654342443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:08:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f17a4ab3-a1b3-4bd4-b8ec-8a34cb5e0e3f tempest-CreateVolumesFromSnapshotTest-654342443 None] Flow 'volume_create_manager' (a8a43d0a-7f1e-46be-ad2e-b6208db714aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:08:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f17a4ab3-a1b3-4bd4-b8ec-8a34cb5e0e3f tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa731a8e-d64a-439c-939e-78230501c1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f17a4ab3-a1b3-4bd4-b8ec-8a34cb5e0e3f tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa731a8e-d64a-439c-939e-78230501c1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-510607683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a922d055-fe97-4fb4-bd07-68eb44335268,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf26b5bad6894c7983357ed898b033b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:08:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:08:50Z,use_quota=True,user_id='9b033975bdb9430198a108890d26bedb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f17a4ab3-a1b3-4bd4-b8ec-8a34cb5e0e3f tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (698f72a6-8aba-4010-813c-83f1bb085ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f17a4ab3-a1b3-4bd4-b8ec-8a34cb5e0e3f tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (698f72a6-8aba-4010-813c-83f1bb085ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f17a4ab3-a1b3-4bd4-b8ec-8a34cb5e0e3f tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7573b21-b7d7-4c69-9b4b-2dcffd8b481a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f17a4ab3-a1b3-4bd4-b8ec-8a34cb5e0e3f tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7573b21-b7d7-4c69-9b4b-2dcffd8b481a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a922d055-fe97-4fb4-bd07-68eb44335268', 'volume_name': 'volume-a922d055-fe97-4fb4-bd07-68eb44335268', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f17a4ab3-a1b3-4bd4-b8ec-8a34cb5e0e3f tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ac8cae5-c477-4ab3-b038-6df60a6e10be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f17a4ab3-a1b3-4bd4-b8ec-8a34cb5e0e3f tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ac8cae5-c477-4ab3-b038-6df60a6e10be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f17a4ab3-a1b3-4bd4-b8ec-8a34cb5e0e3f tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab43b261-d44b-41a4-a999-ecc0a5958d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:50 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-f17a4ab3-a1b3-4bd4-b8ec-8a34cb5e0e3f tempest-CreateVolumesFromSnapshotTest-654342443 None] Volume a922d055-fe97-4fb4-bd07-68eb44335268: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a922d055-fe97-4fb4-bd07-68eb44335268', 'volume_size': 1} Jul 30 17:08:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f17a4ab3-a1b3-4bd4-b8ec-8a34cb5e0e3f tempest-CreateVolumesFromSnapshotTest-654342443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:50 devstack sudo[108012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011 Jul 30 17:08:50 devstack sudo[108012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:50 devstack sudo[108009]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e231878-9c22-44e8-a15d-565539d0fafa -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa.5edacf39-77bc-43a2-b03c-442a34350bd1" returned: 0 in 0.408s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:50 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa.5edacf39-77bc-43a2-b03c-442a34350bd1 is being set with open permissions: ugo+rw Jul 30 17:08:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa.5edacf39-77bc-43a2-b03c-442a34350bd1 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:50 devstack sudo[108017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa.5edacf39-77bc-43a2-b03c-442a34350bd1 Jul 30 17:08:50 devstack sudo[108017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:50 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7fe324f-ebd9-4817-aa48-38f7f529dda0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:08:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a7fe324f-ebd9-4817-aa48-38f7f529dda0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Flow 'volume_create_manager' (48d12678-62ea-4cd2-899a-221e0c24165d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:08:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a7fe324f-ebd9-4817-aa48-38f7f529dda0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b993a526-efec-42d3-9315-757439206a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a7fe324f-ebd9-4817-aa48-38f7f529dda0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b993a526-efec-42d3-9315-757439206a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1377081993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e87ab456-a239-46b6-903d-d6444e69524d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf26b5bad6894c7983357ed898b033b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:08:51Z,use_quota=True,user_id='9b033975bdb9430198a108890d26bedb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a7fe324f-ebd9-4817-aa48-38f7f529dda0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a398bcc-0bc3-445e-8ff8-6174fa39a2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a7fe324f-ebd9-4817-aa48-38f7f529dda0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a398bcc-0bc3-445e-8ff8-6174fa39a2a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a7fe324f-ebd9-4817-aa48-38f7f529dda0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a443c4b-1b25-46b9-918d-cea2a0c74a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a7fe324f-ebd9-4817-aa48-38f7f529dda0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a443c4b-1b25-46b9-918d-cea2a0c74a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e87ab456-a239-46b6-903d-d6444e69524d', 'volume_name': 'volume-e87ab456-a239-46b6-903d-d6444e69524d', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a7fe324f-ebd9-4817-aa48-38f7f529dda0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07220466-5324-4a1c-8756-5c7885e35351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a7fe324f-ebd9-4817-aa48-38f7f529dda0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07220466-5324-4a1c-8756-5c7885e35351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a7fe324f-ebd9-4817-aa48-38f7f529dda0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc60a32a-3ce3-44dd-ae10-00dd3939c0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:50 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-a7fe324f-ebd9-4817-aa48-38f7f529dda0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Volume e87ab456-a239-46b6-903d-d6444e69524d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e87ab456-a239-46b6-903d-d6444e69524d', 'volume_size': 1} Jul 30 17:08:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a7fe324f-ebd9-4817-aa48-38f7f529dda0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:50 devstack sudo[108012]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b721ed43-b27d-49e8-9c31-a16b078996f7 tempest-VolumeDependencyTests-500709084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011" returned: 0 in 0.567s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b721ed43-b27d-49e8-9c31-a16b078996f7 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011.182c8d60-c4d9-41f6-b152-a3dcd98cb4a1 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:50 devstack sudo[108022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011.182c8d60-c4d9-41f6-b152-a3dcd98cb4a1 Jul 30 17:08:50 devstack sudo[108022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:50 devstack sudo[108017]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa.5edacf39-77bc-43a2-b03c-442a34350bd1" returned: 0 in 0.381s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:51 devstack sudo[108025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa.info Jul 30 17:08:51 devstack sudo[108025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:51 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-aeb5b59a-65f2-4f75-9b14-9d33feb4bca5 tempest-CreateVolumesFromSnapshotTest-654342443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:08:51 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-aeb5b59a-65f2-4f75-9b14-9d33feb4bca5 tempest-CreateVolumesFromSnapshotTest-654342443 None] Flow 'volume_create_manager' (e687f580-a731-4de5-89b3-6e0b36a2cf85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:08:51 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-aeb5b59a-65f2-4f75-9b14-9d33feb4bca5 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3150604d-2eaa-466b-9fa1-0a4f4796965a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:51 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-aeb5b59a-65f2-4f75-9b14-9d33feb4bca5 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3150604d-2eaa-466b-9fa1-0a4f4796965a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-993922568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b76376e-a0ba-4544-82be-5be351ea5d1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf26b5bad6894c7983357ed898b033b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:08:51Z,use_quota=True,user_id='9b033975bdb9430198a108890d26bedb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:51 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-aeb5b59a-65f2-4f75-9b14-9d33feb4bca5 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9f73985-7952-4d0e-bb3a-864f0e5c047b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:51 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-aeb5b59a-65f2-4f75-9b14-9d33feb4bca5 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9f73985-7952-4d0e-bb3a-864f0e5c047b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:51 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-aeb5b59a-65f2-4f75-9b14-9d33feb4bca5 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2995aa0d-3b83-4635-8fff-08fe6d7eb276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:51 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-aeb5b59a-65f2-4f75-9b14-9d33feb4bca5 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2995aa0d-3b83-4635-8fff-08fe6d7eb276) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b76376e-a0ba-4544-82be-5be351ea5d1a', 'volume_name': 'volume-0b76376e-a0ba-4544-82be-5be351ea5d1a', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:51 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-aeb5b59a-65f2-4f75-9b14-9d33feb4bca5 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb3867b1-6dc2-473f-a39c-c159d36dcaee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:51 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-aeb5b59a-65f2-4f75-9b14-9d33feb4bca5 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb3867b1-6dc2-473f-a39c-c159d36dcaee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:51 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-aeb5b59a-65f2-4f75-9b14-9d33feb4bca5 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8e921a4-1e32-48ff-9636-152a8a1128ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:51 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-aeb5b59a-65f2-4f75-9b14-9d33feb4bca5 tempest-CreateVolumesFromSnapshotTest-654342443 None] Volume 0b76376e-a0ba-4544-82be-5be351ea5d1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b76376e-a0ba-4544-82be-5be351ea5d1a', 'volume_size': 1} Jul 30 17:08:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-aeb5b59a-65f2-4f75-9b14-9d33feb4bca5 tempest-CreateVolumesFromSnapshotTest-654342443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:51 devstack sudo[108022]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b721ed43-b27d-49e8-9c31-a16b078996f7 tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011.182c8d60-c4d9-41f6-b152-a3dcd98cb4a1" returned: 0 in 0.483s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:51 devstack sudo[108025]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b721ed43-b27d-49e8-9c31-a16b078996f7 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011.182c8d60-c4d9-41f6-b152-a3dcd98cb4a1 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa.info" returned: 0 in 0.378s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:51 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa.info is being set with open permissions: ugo+rw Jul 30 17:08:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:51 devstack sudo[108038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa.info Jul 30 17:08:51 devstack sudo[108038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:51 devstack sudo[108037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011.182c8d60-c4d9-41f6-b152-a3dcd98cb4a1 Jul 30 17:08:51 devstack sudo[108037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:51 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9ce22c6-b214-4c3c-b8bd-2fb0e1680567 tempest-CreateVolumesFromSnapshotTest-654342443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:08:51 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b9ce22c6-b214-4c3c-b8bd-2fb0e1680567 tempest-CreateVolumesFromSnapshotTest-654342443 None] Flow 'volume_create_manager' (399fd11a-bce7-40a0-a66c-566d28b1397a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:08:51 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b9ce22c6-b214-4c3c-b8bd-2fb0e1680567 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (991ece24-ee1d-4e16-9888-a552006d2adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:51 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b9ce22c6-b214-4c3c-b8bd-2fb0e1680567 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (991ece24-ee1d-4e16-9888-a552006d2adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1185187624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bf17c99-2377-4dfa-b6e1-234a9a0c4bc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf26b5bad6894c7983357ed898b033b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:08:51Z,use_quota=True,user_id='9b033975bdb9430198a108890d26bedb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:51 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b9ce22c6-b214-4c3c-b8bd-2fb0e1680567 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf4bd9d7-54c8-4820-8c82-99f6eead0cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:51 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b9ce22c6-b214-4c3c-b8bd-2fb0e1680567 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf4bd9d7-54c8-4820-8c82-99f6eead0cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:51 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b9ce22c6-b214-4c3c-b8bd-2fb0e1680567 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (917f8978-3414-480f-aea3-876ed579de36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:51 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b9ce22c6-b214-4c3c-b8bd-2fb0e1680567 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (917f8978-3414-480f-aea3-876ed579de36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bf17c99-2377-4dfa-b6e1-234a9a0c4bc7', 'volume_name': 'volume-5bf17c99-2377-4dfa-b6e1-234a9a0c4bc7', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:51 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b9ce22c6-b214-4c3c-b8bd-2fb0e1680567 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d79d5c0a-92ca-437b-87cd-aadba9830e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:51 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b9ce22c6-b214-4c3c-b8bd-2fb0e1680567 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d79d5c0a-92ca-437b-87cd-aadba9830e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:51 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b9ce22c6-b214-4c3c-b8bd-2fb0e1680567 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0874209-baa6-43e5-a151-5f29b941fb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:51 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-b9ce22c6-b214-4c3c-b8bd-2fb0e1680567 tempest-CreateVolumesFromSnapshotTest-654342443 None] Volume 5bf17c99-2377-4dfa-b6e1-234a9a0c4bc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bf17c99-2377-4dfa-b6e1-234a9a0c4bc7', 'volume_size': 1} Jul 30 17:08:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b9ce22c6-b214-4c3c-b8bd-2fb0e1680567 tempest-CreateVolumesFromSnapshotTest-654342443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:51 devstack sudo[108038]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa.info" returned: 0 in 0.314s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:51 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] Acquiring lock "cinder-quobyte-54bc1f11-e727-4577-870d-3000bbd16dca" by "_copy_volume_from_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:08:51 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] Lock "cinder-quobyte-54bc1f11-e727-4577-870d-3000bbd16dca" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:08:51 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] snapshot: 5edacf39-77bc-43a2-b03c-442a34350bd1, volume: 54bc1f11-e727-4577-870d-3000bbd16dca, {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 17:08:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:51 devstack sudo[108037]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:51 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:08:51 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:08:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b721ed43-b27d-49e8-9c31-a16b078996f7 tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011.182c8d60-c4d9-41f6-b152-a3dcd98cb4a1" returned: 0 in 0.414s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:51 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f59674-0971-4ff3-a1db-ef73673f1c4b]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:08:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa.5edacf39-77bc-43a2-b03c-442a34350bd1 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:51 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b721ed43-b27d-49e8-9c31-a16b078996f7 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-182c8d60-c4d9-41f6-b152-a3dcd98cb4a1" released by "_delete_snapshot" :: held 2.073s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:08:51 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b721ed43-b27d-49e8-9c31-a16b078996f7 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-1afe0c3d-9641-4aeb-80a2-9551751f3011" released by "delete_snapshot" :: held 2.114s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:08:51 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-b721ed43-b27d-49e8-9c31-a16b078996f7 tempest-VolumeDependencyTests-500709084 None] Created reservations ['d9065c49-1c38-46a4-9726-c70f493d8ccb', 'cfe634e3-2c51-4970-87ed-bbab0b61ef06', 'a3f30c83-7c5d-410d-8988-006d2e2322ef', '7e28133e-e4d1-467c-bc5a-0609804894ca'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:08:51 devstack sudo[108043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa.5edacf39-77bc-43a2-b03c-442a34350bd1 Jul 30 17:08:51 devstack sudo[108043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:51 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-caf981b2-2e8e-4061-96de-498b1b6ff2a0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:08:51 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-caf981b2-2e8e-4061-96de-498b1b6ff2a0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Flow 'volume_create_manager' (d0b1a9cd-1195-429e-ab17-8bc8be2ad945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:08:51 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-caf981b2-2e8e-4061-96de-498b1b6ff2a0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28389cc9-fcc3-4a13-8131-97223ae313b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:51 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-caf981b2-2e8e-4061-96de-498b1b6ff2a0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28389cc9-fcc3-4a13-8131-97223ae313b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:08:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-786264455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ccd9c42-fef3-4e7f-bc88-f74e4d891b88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf26b5bad6894c7983357ed898b033b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:08:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:08:52Z,use_quota=True,user_id='9b033975bdb9430198a108890d26bedb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-caf981b2-2e8e-4061-96de-498b1b6ff2a0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a68df089-2017-44fa-b9b5-edf9ebbaec7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-caf981b2-2e8e-4061-96de-498b1b6ff2a0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a68df089-2017-44fa-b9b5-edf9ebbaec7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-caf981b2-2e8e-4061-96de-498b1b6ff2a0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12054939-c80c-465a-a79c-5d913adaa550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-caf981b2-2e8e-4061-96de-498b1b6ff2a0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12054939-c80c-465a-a79c-5d913adaa550) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ccd9c42-fef3-4e7f-bc88-f74e4d891b88', 'volume_name': 'volume-8ccd9c42-fef3-4e7f-bc88-f74e4d891b88', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-caf981b2-2e8e-4061-96de-498b1b6ff2a0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cba9f35-e113-4f0b-9614-42ef8a8f7375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-caf981b2-2e8e-4061-96de-498b1b6ff2a0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cba9f35-e113-4f0b-9614-42ef8a8f7375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:52 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-caf981b2-2e8e-4061-96de-498b1b6ff2a0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b30f79a9-41ea-452f-a316-516258e52189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:52 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-caf981b2-2e8e-4061-96de-498b1b6ff2a0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Volume 8ccd9c42-fef3-4e7f-bc88-f74e4d891b88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ccd9c42-fef3-4e7f-bc88-f74e4d891b88', 'volume_size': 1} Jul 30 17:08:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-caf981b2-2e8e-4061-96de-498b1b6ff2a0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:52 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-b721ed43-b27d-49e8-9c31-a16b078996f7 tempest-VolumeDependencyTests-500709084 None] Delete snapshot completed successfully. Jul 30 17:08:52 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b721ed43-b27d-49e8-9c31-a16b078996f7 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-182c8d60-c4d9-41f6-b152-a3dcd98cb4a1-delete_snapshot" released by "delete_snapshot" :: held 2.389s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:08:52 devstack sudo[108043]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa.5edacf39-77bc-43a2-b03c-442a34350bd1" returned: 0 in 0.395s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:52 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e231878-9c22-44e8-a15d-565539d0fafa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:08:52 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8265d018-57eb-4fd4-91be-b40191075c1c]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:08:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:52 devstack sudo[108048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa Jul 30 17:08:52 devstack sudo[108048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:52 devstack sudo[108048]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa" returned: 0 in 0.366s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:52 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] will copy from snapshot at /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 17:08:52 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] Creating direct copy from snapshot {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 17:08:52 devstack cinder-volume[88591]: DEBUG cinder.utils [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] Path /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-54bc1f11-e727-4577-870d-3000bbd16dca not found in is_blk_device check {{(pid=88591) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 17:08:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-54bc1f11-e727-4577-870d-3000bbd16dca {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:52 devstack sudo[108054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-54bc1f11-e727-4577-870d-3000bbd16dca Jul 30 17:08:52 devstack sudo[108054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:52 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-5db4eab6-92e8-41fa-9362-ce10658d50f2 tempest-VolumeDependencyTests-500709084 None] Acquiring lock "cinder-492ebdb2-b6fa-4a35-be2c-63891133e3db-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:08:53 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-5db4eab6-92e8-41fa-9362-ce10658d50f2 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-492ebdb2-b6fa-4a35-be2c-63891133e3db-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:08:53 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-5db4eab6-92e8-41fa-9362-ce10658d50f2 tempest-VolumeDependencyTests-500709084 None] Acquiring lock "cinder-quobyte-492ebdb2-b6fa-4a35-be2c-63891133e3db" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:08:53 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-5db4eab6-92e8-41fa-9362-ce10658d50f2 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-492ebdb2-b6fa-4a35-be2c-63891133e3db" acquired by "delete_volume" :: waited 0.023s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:08:53 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f67b48a-3f49-4602-b888-bc3bb123632e]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:08:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5db4eab6-92e8-41fa-9362-ce10658d50f2 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:53 devstack sudo[108054]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-54bc1f11-e727-4577-870d-3000bbd16dca" returned: 0 in 0.671s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:53 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] Image conversion details: src /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-54bc1f11-e727-4577-870d-3000bbd16dca {{(pid=88591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 17:08:53 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 30 17:08:53 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-54bc1f11-e727-4577-870d-3000bbd16dca is being set with open permissions: ugo+rw Jul 30 17:08:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-54bc1f11-e727-4577-870d-3000bbd16dca {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:53 devstack sudo[108097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-54bc1f11-e727-4577-870d-3000bbd16dca Jul 30 17:08:53 devstack sudo[108097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:53 devstack sudo[108096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db Jul 30 17:08:53 devstack sudo[108096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:53 devstack sudo[108097]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-54bc1f11-e727-4577-870d-3000bbd16dca" returned: 0 in 0.256s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:53 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] Lock "cinder-quobyte-54bc1f11-e727-4577-870d-3000bbd16dca" released by "_copy_volume_from_snapshot" :: held 1.803s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:08:53 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] Acquiring lock "cinder-quobyte-5edacf39-77bc-43a2-b03c-442a34350bd1" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:08:53 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] Lock "cinder-quobyte-5edacf39-77bc-43a2-b03c-442a34350bd1" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:08:53 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] Deleting offline snapshot 5edacf39-77bc-43a2-b03c-442a34350bd1 of volume 1e231878-9c22-44e8-a15d-565539d0fafa {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:08:53 devstack sudo[108096]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:53 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] snapshot_file for this snap is: volume-1e231878-9c22-44e8-a15d-565539d0fafa.5edacf39-77bc-43a2-b03c-442a34350bd1 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:08:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5db4eab6-92e8-41fa-9362-ce10658d50f2 tempest-VolumeDependencyTests-500709084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db" returned: 0 in 0.386s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5db4eab6-92e8-41fa-9362-ce10658d50f2 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:53 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5da724-3e90-44c6-aaa4-7f01c2cfeed9]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:08:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa.5edacf39-77bc-43a2-b03c-442a34350bd1 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:53 devstack sudo[108104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db Jul 30 17:08:53 devstack sudo[108104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:53 devstack sudo[108105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa.5edacf39-77bc-43a2-b03c-442a34350bd1 Jul 30 17:08:53 devstack sudo[108105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:53 devstack sudo[108104]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5db4eab6-92e8-41fa-9362-ce10658d50f2 tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-492ebdb2-b6fa-4a35-be2c-63891133e3db" returned: 0 in 0.272s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:53 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-5db4eab6-92e8-41fa-9362-ce10658d50f2 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-492ebdb2-b6fa-4a35-be2c-63891133e3db" released by "delete_volume" :: held 0.723s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:08:53 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-5db4eab6-92e8-41fa-9362-ce10658d50f2 tempest-VolumeDependencyTests-500709084 None] Created reservations ['282e9ea8-c64c-4211-8ce3-fb16f2dda3df', '07f1af3e-368b-4707-9bf5-57f9e384a08d', 'e40791ef-b4b7-44f6-9ec4-e9020e922778', '071250fa-6962-446b-9899-9a8742a4731f'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:08:53 devstack sudo[108105]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa.5edacf39-77bc-43a2-b03c-442a34350bd1" returned: 0 in 0.392s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:53 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e231878-9c22-44e8-a15d-565539d0fafa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:08:54 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0794af-cd61-4068-a8c4-2fb555780690]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:08:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5db4eab6-92e8-41fa-9362-ce10658d50f2 tempest-VolumeDependencyTests-500709084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5db4eab6-92e8-41fa-9362-ce10658d50f2 tempest-VolumeDependencyTests-500709084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:54 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-5db4eab6-92e8-41fa-9362-ce10658d50f2 tempest-VolumeDependencyTests-500709084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:08:54 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-5db4eab6-92e8-41fa-9362-ce10658d50f2 tempest-VolumeDependencyTests-500709084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:08:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5db4eab6-92e8-41fa-9362-ce10658d50f2 tempest-VolumeDependencyTests-500709084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5db4eab6-92e8-41fa-9362-ce10658d50f2 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:54 devstack sudo[108113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:08:54 devstack sudo[108113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:54 devstack sudo[108112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa Jul 30 17:08:54 devstack sudo[108112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:54 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-e9f9d9eb-8119-4206-806d-301c805af716 tempest-VolumeDependencyTests-500709084 None] Acquiring lock "cinder-fef4ded4-31f8-458e-83a4-2afaa037f927-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:08:54 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-e9f9d9eb-8119-4206-806d-301c805af716 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-fef4ded4-31f8-458e-83a4-2afaa037f927-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:08:54 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-e9f9d9eb-8119-4206-806d-301c805af716 tempest-VolumeDependencyTests-500709084 None] Acquiring lock "cinder-quobyte-fef4ded4-31f8-458e-83a4-2afaa037f927" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:08:54 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-e9f9d9eb-8119-4206-806d-301c805af716 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-fef4ded4-31f8-458e-83a4-2afaa037f927" acquired by "delete_volume" :: waited 0.019s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:08:54 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[da35e525-dde7-43c1-a33f-38e95469e1f0]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:08:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e9f9d9eb-8119-4206-806d-301c805af716 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef4ded4-31f8-458e-83a4-2afaa037f927 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:54 devstack sudo[108113]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5db4eab6-92e8-41fa-9362-ce10658d50f2 tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.316s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:54 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-5db4eab6-92e8-41fa-9362-ce10658d50f2 tempest-VolumeDependencyTests-500709084 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:08:54 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-5db4eab6-92e8-41fa-9362-ce10658d50f2 tempest-VolumeDependencyTests-500709084 None] Deleted volume successfully. Jul 30 17:08:54 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-5db4eab6-92e8-41fa-9362-ce10658d50f2 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-492ebdb2-b6fa-4a35-be2c-63891133e3db-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:08:54 devstack sudo[108112]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa" returned: 0 in 0.442s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa.5edacf39-77bc-43a2-b03c-442a34350bd1 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:54 devstack sudo[108117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef4ded4-31f8-458e-83a4-2afaa037f927 Jul 30 17:08:54 devstack sudo[108117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:54 devstack sudo[108121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa.5edacf39-77bc-43a2-b03c-442a34350bd1 Jul 30 17:08:54 devstack sudo[108121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:54 devstack sudo[108117]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e9f9d9eb-8119-4206-806d-301c805af716 tempest-VolumeDependencyTests-500709084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef4ded4-31f8-458e-83a4-2afaa037f927" returned: 0 in 0.380s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e9f9d9eb-8119-4206-806d-301c805af716 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef4ded4-31f8-458e-83a4-2afaa037f927 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:54 devstack sudo[108130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef4ded4-31f8-458e-83a4-2afaa037f927 Jul 30 17:08:54 devstack sudo[108130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:54 devstack sudo[108121]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa.5edacf39-77bc-43a2-b03c-442a34350bd1" returned: 0 in 0.346s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa.5edacf39-77bc-43a2-b03c-442a34350bd1 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:54 devstack sudo[108132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa.5edacf39-77bc-43a2-b03c-442a34350bd1 Jul 30 17:08:54 devstack sudo[108132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:54 devstack sudo[108130]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e9f9d9eb-8119-4206-806d-301c805af716 tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fef4ded4-31f8-458e-83a4-2afaa037f927" returned: 0 in 0.259s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:55 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-e9f9d9eb-8119-4206-806d-301c805af716 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-fef4ded4-31f8-458e-83a4-2afaa037f927" released by "delete_volume" :: held 0.707s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:08:55 devstack sudo[108132]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa.5edacf39-77bc-43a2-b03c-442a34350bd1" returned: 0 in 0.263s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:55 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] Lock "cinder-quobyte-5edacf39-77bc-43a2-b03c-442a34350bd1" released by "_delete_snapshot" :: held 1.560s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:08:55 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-e9f9d9eb-8119-4206-806d-301c805af716 tempest-VolumeDependencyTests-500709084 None] Created reservations ['80873fb7-dc3f-4035-97f9-5459344f8a13', '45390ae2-46ff-432b-999a-7873efedabc9', 'a363a2e9-5b40-4729-934a-139b2a550898', 'a080340a-902f-47cc-9508-417d35626263'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:08:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 6.018s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:55 devstack cinder-volume[88591]: DEBUG cinder.volume.volume_utils [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] Marking volume 54bc1f11-e727-4577-870d-3000bbd16dca as bootable. {{(pid=88591) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 30 17:08:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ab5087e1-07ec-4304-87c3-c4994808ad08 tempest-ProjectMemberTests-1145856324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.420s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:55 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ab5087e1-07ec-4304-87c3-c4994808ad08 tempest-ProjectMemberTests-1145856324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:08:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2122362731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f62deeb-1217-4416-854e-b6e5d09b3b63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26c22addd8364bc982bc8002f431ee32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:08:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:08:47Z,use_quota=True,user_id='c9da4889b5dd47d3bb88b442a104a944',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:08:55 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-ab5087e1-07ec-4304-87c3-c4994808ad08 tempest-ProjectMemberTests-1145856324 None] Creating volume 0f62deeb-1217-4416-854e-b6e5d09b3b63 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:08:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ab5087e1-07ec-4304-87c3-c4994808ad08 tempest-ProjectMemberTests-1145856324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ab5087e1-07ec-4304-87c3-c4994808ad08 tempest-ProjectMemberTests-1145856324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:55 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ab5087e1-07ec-4304-87c3-c4994808ad08 tempest-ProjectMemberTests-1145856324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:08:55 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ab5087e1-07ec-4304-87c3-c4994808ad08 tempest-ProjectMemberTests-1145856324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:08:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ab5087e1-07ec-4304-87c3-c4994808ad08 tempest-ProjectMemberTests-1145856324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:55 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ab5087e1-07ec-4304-87c3-c4994808ad08 tempest-ProjectMemberTests-1145856324 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:08:55 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-ab5087e1-07ec-4304-87c3-c4994808ad08 tempest-ProjectMemberTests-1145856324 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:08:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ab5087e1-07ec-4304-87c3-c4994808ad08 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0f62deeb-1217-4416-854e-b6e5d09b3b63 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:55 devstack sudo[108136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0f62deeb-1217-4416-854e-b6e5d09b3b63 1073741824 Jul 30 17:08:55 devstack sudo[108136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:55 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] Copying metadata from source volume 1e231878-9c22-44e8-a15d-565539d0fafa to 54bc1f11-e727-4577-870d-3000bbd16dca. {{(pid=88591) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:438}} Jul 30 17:08:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-e9f9d9eb-8119-4206-806d-301c805af716 tempest-VolumeDependencyTests-500709084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-e9f9d9eb-8119-4206-806d-301c805af716 tempest-VolumeDependencyTests-500709084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:55 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-e9f9d9eb-8119-4206-806d-301c805af716 tempest-VolumeDependencyTests-500709084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:08:55 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-e9f9d9eb-8119-4206-806d-301c805af716 tempest-VolumeDependencyTests-500709084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:08:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-e9f9d9eb-8119-4206-806d-301c805af716 tempest-VolumeDependencyTests-500709084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e9f9d9eb-8119-4206-806d-301c805af716 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:55 devstack sudo[108138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:08:55 devstack sudo[108138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:55 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a25cf4f-55f1-4fe2-aeb5-989c54185d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54bc1f11-e727-4577-870d-3000bbd16dca', 'volume_size': 1, 'source_volid': '1e231878-9c22-44e8-a15d-565539d0fafa', 'source_volstatus': 'available'}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:55 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f3fb801-4635-461e-ae08-575f20466f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:55 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] Volume volume-54bc1f11-e727-4577-870d-3000bbd16dca (54bc1f11-e727-4577-870d-3000bbd16dca): created successfully Jul 30 17:08:55 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f3fb801-4635-461e-ae08-575f20466f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:55 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] Flow 'volume_create_manager' (0997ef3d-382a-48ed-ab73-c2dd7c4548f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:08:55 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-3330a387-72f9-4f95-878f-3626d44ccab3 tempest-VolumeImageDependencyTests-1529416407 None] Created volume successfully. Jul 30 17:08:55 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-bb0bca99-04e9-4e14-8add-a70e67039825 tempest-VolumeDependencyTests-500709084 None] Acquiring lock "cinder-1afe0c3d-9641-4aeb-80a2-9551751f3011-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:08:55 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-bb0bca99-04e9-4e14-8add-a70e67039825 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-1afe0c3d-9641-4aeb-80a2-9551751f3011-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:08:55 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-bb0bca99-04e9-4e14-8add-a70e67039825 tempest-VolumeDependencyTests-500709084 None] Acquiring lock "cinder-quobyte-1afe0c3d-9641-4aeb-80a2-9551751f3011" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:08:55 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-bb0bca99-04e9-4e14-8add-a70e67039825 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-1afe0c3d-9641-4aeb-80a2-9551751f3011" acquired by "delete_volume" :: waited 0.033s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:08:55 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f49099e-1025-42ce-93e7-d5ba765baa23]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:08:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bb0bca99-04e9-4e14-8add-a70e67039825 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:55 devstack sudo[108138]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e9f9d9eb-8119-4206-806d-301c805af716 tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.314s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:55 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-e9f9d9eb-8119-4206-806d-301c805af716 tempest-VolumeDependencyTests-500709084 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:08:55 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-e9f9d9eb-8119-4206-806d-301c805af716 tempest-VolumeDependencyTests-500709084 None] Deleted volume successfully. Jul 30 17:08:55 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-e9f9d9eb-8119-4206-806d-301c805af716 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-fef4ded4-31f8-458e-83a4-2afaa037f927-delete_volume" released by "delete_volume" :: held 1.367s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:08:55 devstack sudo[108144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011 Jul 30 17:08:55 devstack sudo[108144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:55 devstack sudo[108136]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ab5087e1-07ec-4304-87c3-c4994808ad08 tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0f62deeb-1217-4416-854e-b6e5d09b3b63 1073741824" returned: 0 in 0.574s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ab5087e1-07ec-4304-87c3-c4994808ad08 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0f62deeb-1217-4416-854e-b6e5d09b3b63 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:55 devstack sudo[108146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0f62deeb-1217-4416-854e-b6e5d09b3b63 Jul 30 17:08:55 devstack sudo[108146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:55 devstack sudo[108144]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bb0bca99-04e9-4e14-8add-a70e67039825 tempest-VolumeDependencyTests-500709084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011" returned: 0 in 0.399s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bb0bca99-04e9-4e14-8add-a70e67039825 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:55 devstack sudo[108151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011 Jul 30 17:08:55 devstack sudo[108151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ef0cbeaa-c78c-473f-8e77-f52b56830c32 tempest-VolumeImageDependencyTests-1529416407 None] Acquiring lock "cinder-1e231878-9c22-44e8-a15d-565539d0fafa-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:08:56 devstack sudo[108146]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ab5087e1-07ec-4304-87c3-c4994808ad08 tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0f62deeb-1217-4416-854e-b6e5d09b3b63" returned: 0 in 0.287s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ab5087e1-07ec-4304-87c3-c4994808ad08 tempest-ProjectMemberTests-1145856324 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ab5087e1-07ec-4304-87c3-c4994808ad08 tempest-ProjectMemberTests-1145856324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f17a4ab3-a1b3-4bd4-b8ec-8a34cb5e0e3f tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.660s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f17a4ab3-a1b3-4bd4-b8ec-8a34cb5e0e3f tempest-CreateVolumesFromSnapshotTest-654342443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-510607683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a922d055-fe97-4fb4-bd07-68eb44335268,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf26b5bad6894c7983357ed898b033b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:08:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:08:50Z,use_quota=True,user_id='9b033975bdb9430198a108890d26bedb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-f17a4ab3-a1b3-4bd4-b8ec-8a34cb5e0e3f tempest-CreateVolumesFromSnapshotTest-654342443 None] Creating volume a922d055-fe97-4fb4-bd07-68eb44335268 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f17a4ab3-a1b3-4bd4-b8ec-8a34cb5e0e3f tempest-CreateVolumesFromSnapshotTest-654342443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f17a4ab3-a1b3-4bd4-b8ec-8a34cb5e0e3f tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f17a4ab3-a1b3-4bd4-b8ec-8a34cb5e0e3f tempest-CreateVolumesFromSnapshotTest-654342443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f17a4ab3-a1b3-4bd4-b8ec-8a34cb5e0e3f tempest-CreateVolumesFromSnapshotTest-654342443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f17a4ab3-a1b3-4bd4-b8ec-8a34cb5e0e3f tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f17a4ab3-a1b3-4bd4-b8ec-8a34cb5e0e3f tempest-CreateVolumesFromSnapshotTest-654342443 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:08:56 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-f17a4ab3-a1b3-4bd4-b8ec-8a34cb5e0e3f tempest-CreateVolumesFromSnapshotTest-654342443 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f17a4ab3-a1b3-4bd4-b8ec-8a34cb5e0e3f tempest-CreateVolumesFromSnapshotTest-654342443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a922d055-fe97-4fb4-bd07-68eb44335268 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:56 devstack sudo[108154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a922d055-fe97-4fb4-bd07-68eb44335268 1073741824 Jul 30 17:08:56 devstack sudo[108154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ef0cbeaa-c78c-473f-8e77-f52b56830c32 tempest-VolumeImageDependencyTests-1529416407 None] Lock "cinder-1e231878-9c22-44e8-a15d-565539d0fafa-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ab5087e1-07ec-4304-87c3-c4994808ad08 tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a754fc5a-3ef5-43a1-8062-4031c9ec149a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f62deeb-1217-4416-854e-b6e5d09b3b63', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ab5087e1-07ec-4304-87c3-c4994808ad08 tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b4f67d2-49a8-413b-955d-f4bd5491b1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:56 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-ab5087e1-07ec-4304-87c3-c4994808ad08 tempest-ProjectMemberTests-1145856324 None] Volume volume-0f62deeb-1217-4416-854e-b6e5d09b3b63 (0f62deeb-1217-4416-854e-b6e5d09b3b63): created successfully Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ab5087e1-07ec-4304-87c3-c4994808ad08 tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b4f67d2-49a8-413b-955d-f4bd5491b1b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ab5087e1-07ec-4304-87c3-c4994808ad08 tempest-ProjectMemberTests-1145856324 None] Flow 'volume_create_manager' (192e0f17-772c-4081-89eb-d14635dba105) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:08:56 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-ab5087e1-07ec-4304-87c3-c4994808ad08 tempest-ProjectMemberTests-1145856324 None] Created volume successfully. Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ef0cbeaa-c78c-473f-8e77-f52b56830c32 tempest-VolumeImageDependencyTests-1529416407 None] Acquiring lock "cinder-quobyte-1e231878-9c22-44e8-a15d-565539d0fafa" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ef0cbeaa-c78c-473f-8e77-f52b56830c32 tempest-VolumeImageDependencyTests-1529416407 None] Lock "cinder-quobyte-1e231878-9c22-44e8-a15d-565539d0fafa" acquired by "delete_volume" :: waited 0.020s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:08:56 devstack sudo[108151]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bb0bca99-04e9-4e14-8add-a70e67039825 tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1afe0c3d-9641-4aeb-80a2-9551751f3011" returned: 0 in 0.329s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62391f4-6a6b-47fd-861f-3cd088b56730]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ef0cbeaa-c78c-473f-8e77-f52b56830c32 tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-bb0bca99-04e9-4e14-8add-a70e67039825 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-1afe0c3d-9641-4aeb-80a2-9551751f3011" released by "delete_volume" :: held 0.807s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-bb0bca99-04e9-4e14-8add-a70e67039825 tempest-VolumeDependencyTests-500709084 None] Created reservations ['680f5ad4-a291-4b91-9394-6c8110f5dbda', '83ef2115-5537-467e-a0d2-627c024044db', '904ee93a-8c7d-43fd-ac8c-9399faf82727', '254a162d-22ab-4610-a05e-aabbb4c1f054'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:08:56 devstack sudo[108157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa Jul 30 17:08:56 devstack sudo[108157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-bb0bca99-04e9-4e14-8add-a70e67039825 tempest-VolumeDependencyTests-500709084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-bb0bca99-04e9-4e14-8add-a70e67039825 tempest-VolumeDependencyTests-500709084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-bb0bca99-04e9-4e14-8add-a70e67039825 tempest-VolumeDependencyTests-500709084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-bb0bca99-04e9-4e14-8add-a70e67039825 tempest-VolumeDependencyTests-500709084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-bb0bca99-04e9-4e14-8add-a70e67039825 tempest-VolumeDependencyTests-500709084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bb0bca99-04e9-4e14-8add-a70e67039825 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:56 devstack sudo[108162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:08:56 devstack sudo[108162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-538641a5-f107-430f-ba4a-3426b59efba2 tempest-VolumeDependencyTests-500709084 None] Acquiring lock "cinder-b827d622-7d7d-472b-af3a-d34394a60c06-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-538641a5-f107-430f-ba4a-3426b59efba2 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-b827d622-7d7d-472b-af3a-d34394a60c06-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:08:56 devstack sudo[108154]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f17a4ab3-a1b3-4bd4-b8ec-8a34cb5e0e3f tempest-CreateVolumesFromSnapshotTest-654342443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a922d055-fe97-4fb4-bd07-68eb44335268 1073741824" returned: 0 in 0.538s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-538641a5-f107-430f-ba4a-3426b59efba2 tempest-VolumeDependencyTests-500709084 None] Acquiring lock "cinder-quobyte-b827d622-7d7d-472b-af3a-d34394a60c06" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f17a4ab3-a1b3-4bd4-b8ec-8a34cb5e0e3f tempest-CreateVolumesFromSnapshotTest-654342443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a922d055-fe97-4fb4-bd07-68eb44335268 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:56 devstack sudo[108157]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ef0cbeaa-c78c-473f-8e77-f52b56830c32 tempest-VolumeImageDependencyTests-1529416407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa" returned: 0 in 0.425s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ef0cbeaa-c78c-473f-8e77-f52b56830c32 tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:56 devstack sudo[108168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a922d055-fe97-4fb4-bd07-68eb44335268 Jul 30 17:08:56 devstack sudo[108168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-538641a5-f107-430f-ba4a-3426b59efba2 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-b827d622-7d7d-472b-af3a-d34394a60c06" acquired by "delete_volume" :: waited 0.045s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:08:56 devstack sudo[108169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa Jul 30 17:08:56 devstack sudo[108169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[383cf49b-921f-467c-b663-47210deb9b3c]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-538641a5-f107-430f-ba4a-3426b59efba2 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b827d622-7d7d-472b-af3a-d34394a60c06 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:56 devstack sudo[108162]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bb0bca99-04e9-4e14-8add-a70e67039825 tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.325s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-bb0bca99-04e9-4e14-8add-a70e67039825 tempest-VolumeDependencyTests-500709084 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:08:56 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-bb0bca99-04e9-4e14-8add-a70e67039825 tempest-VolumeDependencyTests-500709084 None] Deleted volume successfully. Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-bb0bca99-04e9-4e14-8add-a70e67039825 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-1afe0c3d-9641-4aeb-80a2-9551751f3011-delete_volume" released by "delete_volume" :: held 1.406s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:08:56 devstack sudo[108173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b827d622-7d7d-472b-af3a-d34394a60c06 Jul 30 17:08:56 devstack sudo[108173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:56 devstack sudo[108168]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f17a4ab3-a1b3-4bd4-b8ec-8a34cb5e0e3f tempest-CreateVolumesFromSnapshotTest-654342443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a922d055-fe97-4fb4-bd07-68eb44335268" returned: 0 in 0.255s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f17a4ab3-a1b3-4bd4-b8ec-8a34cb5e0e3f tempest-CreateVolumesFromSnapshotTest-654342443 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f17a4ab3-a1b3-4bd4-b8ec-8a34cb5e0e3f tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a7fe324f-ebd9-4817-aa48-38f7f529dda0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.152s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a7fe324f-ebd9-4817-aa48-38f7f529dda0 tempest-CreateVolumesFromSnapshotTest-654342443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1377081993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e87ab456-a239-46b6-903d-d6444e69524d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf26b5bad6894c7983357ed898b033b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:08:51Z,use_quota=True,user_id='9b033975bdb9430198a108890d26bedb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-a7fe324f-ebd9-4817-aa48-38f7f529dda0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Creating volume e87ab456-a239-46b6-903d-d6444e69524d {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a7fe324f-ebd9-4817-aa48-38f7f529dda0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a7fe324f-ebd9-4817-aa48-38f7f529dda0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a7fe324f-ebd9-4817-aa48-38f7f529dda0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a7fe324f-ebd9-4817-aa48-38f7f529dda0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a7fe324f-ebd9-4817-aa48-38f7f529dda0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a7fe324f-ebd9-4817-aa48-38f7f529dda0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:08:56 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-a7fe324f-ebd9-4817-aa48-38f7f529dda0 tempest-CreateVolumesFromSnapshotTest-654342443 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a7fe324f-ebd9-4817-aa48-38f7f529dda0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e87ab456-a239-46b6-903d-d6444e69524d 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:56 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f17a4ab3-a1b3-4bd4-b8ec-8a34cb5e0e3f tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab43b261-d44b-41a4-a999-ecc0a5958d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a922d055-fe97-4fb4-bd07-68eb44335268', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:56 devstack sudo[108177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e87ab456-a239-46b6-903d-d6444e69524d 1073741824 Jul 30 17:08:56 devstack sudo[108177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:57 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f17a4ab3-a1b3-4bd4-b8ec-8a34cb5e0e3f tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feda0027-3633-49aa-80dc-6fed12828996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:57 devstack sudo[108169]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ef0cbeaa-c78c-473f-8e77-f52b56830c32 tempest-VolumeImageDependencyTests-1529416407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-1e231878-9c22-44e8-a15d-565539d0fafa" returned: 0 in 0.302s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:57 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-f17a4ab3-a1b3-4bd4-b8ec-8a34cb5e0e3f tempest-CreateVolumesFromSnapshotTest-654342443 None] Volume volume-a922d055-fe97-4fb4-bd07-68eb44335268 (a922d055-fe97-4fb4-bd07-68eb44335268): created successfully Jul 30 17:08:57 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f17a4ab3-a1b3-4bd4-b8ec-8a34cb5e0e3f tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feda0027-3633-49aa-80dc-6fed12828996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:57 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f17a4ab3-a1b3-4bd4-b8ec-8a34cb5e0e3f tempest-CreateVolumesFromSnapshotTest-654342443 None] Flow 'volume_create_manager' (a8a43d0a-7f1e-46be-ad2e-b6208db714aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:08:57 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ef0cbeaa-c78c-473f-8e77-f52b56830c32 tempest-VolumeImageDependencyTests-1529416407 None] Lock "cinder-quobyte-1e231878-9c22-44e8-a15d-565539d0fafa" released by "delete_volume" :: held 0.808s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:08:57 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-f17a4ab3-a1b3-4bd4-b8ec-8a34cb5e0e3f tempest-CreateVolumesFromSnapshotTest-654342443 None] Created volume successfully. Jul 30 17:08:57 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-ef0cbeaa-c78c-473f-8e77-f52b56830c32 tempest-VolumeImageDependencyTests-1529416407 None] Created reservations ['8fca557e-c38b-49bf-b68e-50c707781026', '1dfea2d1-ff57-4fed-8070-3cacbdbf3ecc', 'bf1c11e2-601b-4259-bc7b-e2ae36df1539', '9c734ff3-a379-4f3d-b70a-506df7e70fd0'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:08:57 devstack sudo[108173]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-538641a5-f107-430f-ba4a-3426b59efba2 tempest-VolumeDependencyTests-500709084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b827d622-7d7d-472b-af3a-d34394a60c06" returned: 0 in 0.402s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-538641a5-f107-430f-ba4a-3426b59efba2 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b827d622-7d7d-472b-af3a-d34394a60c06 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:57 devstack sudo[108182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b827d622-7d7d-472b-af3a-d34394a60c06 Jul 30 17:08:57 devstack sudo[108182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ef0cbeaa-c78c-473f-8e77-f52b56830c32 tempest-VolumeImageDependencyTests-1529416407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ef0cbeaa-c78c-473f-8e77-f52b56830c32 tempest-VolumeImageDependencyTests-1529416407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:57 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ef0cbeaa-c78c-473f-8e77-f52b56830c32 tempest-VolumeImageDependencyTests-1529416407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:08:57 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ef0cbeaa-c78c-473f-8e77-f52b56830c32 tempest-VolumeImageDependencyTests-1529416407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:08:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ef0cbeaa-c78c-473f-8e77-f52b56830c32 tempest-VolumeImageDependencyTests-1529416407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ef0cbeaa-c78c-473f-8e77-f52b56830c32 tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:57 devstack sudo[108184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:08:57 devstack sudo[108184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1cabc51e-8649-4656-9881-b512e90d976b tempest-ProjectMemberTests-1145856324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:57 devstack sudo[108182]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-538641a5-f107-430f-ba4a-3426b59efba2 tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b827d622-7d7d-472b-af3a-d34394a60c06" returned: 0 in 0.444s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:57 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-538641a5-f107-430f-ba4a-3426b59efba2 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-b827d622-7d7d-472b-af3a-d34394a60c06" released by "delete_volume" :: held 0.891s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:08:57 devstack sudo[108184]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:57 devstack sudo[108177]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ef0cbeaa-c78c-473f-8e77-f52b56830c32 tempest-VolumeImageDependencyTests-1529416407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.397s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:57 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-ef0cbeaa-c78c-473f-8e77-f52b56830c32 tempest-VolumeImageDependencyTests-1529416407 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:08:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a7fe324f-ebd9-4817-aa48-38f7f529dda0 tempest-CreateVolumesFromSnapshotTest-654342443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e87ab456-a239-46b6-903d-d6444e69524d 1073741824" returned: 0 in 0.679s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:57 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-ef0cbeaa-c78c-473f-8e77-f52b56830c32 tempest-VolumeImageDependencyTests-1529416407 None] Deleted volume successfully. Jul 30 17:08:57 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-ef0cbeaa-c78c-473f-8e77-f52b56830c32 tempest-VolumeImageDependencyTests-1529416407 None] Lock "cinder-1e231878-9c22-44e8-a15d-565539d0fafa-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:08:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a7fe324f-ebd9-4817-aa48-38f7f529dda0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e87ab456-a239-46b6-903d-d6444e69524d {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:57 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-538641a5-f107-430f-ba4a-3426b59efba2 tempest-VolumeDependencyTests-500709084 None] Created reservations ['a751a3a1-d042-48d1-abf3-8447fe3f282d', '2bc97932-f0b5-4cb5-aba0-2ec096b377b5', 'c0b8a72f-41ce-4ea4-8927-20fac72c233d', '87ce7eec-03e3-4411-92ad-bc34c8ef63bf'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:08:57 devstack sudo[108192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e87ab456-a239-46b6-903d-d6444e69524d Jul 30 17:08:57 devstack sudo[108192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-538641a5-f107-430f-ba4a-3426b59efba2 tempest-VolumeDependencyTests-500709084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-538641a5-f107-430f-ba4a-3426b59efba2 tempest-VolumeDependencyTests-500709084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:57 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-538641a5-f107-430f-ba4a-3426b59efba2 tempest-VolumeDependencyTests-500709084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:08:57 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-538641a5-f107-430f-ba4a-3426b59efba2 tempest-VolumeDependencyTests-500709084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:08:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-538641a5-f107-430f-ba4a-3426b59efba2 tempest-VolumeDependencyTests-500709084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-538641a5-f107-430f-ba4a-3426b59efba2 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:57 devstack sudo[108194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:08:57 devstack sudo[108194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:57 devstack sudo[108192]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a7fe324f-ebd9-4817-aa48-38f7f529dda0 tempest-CreateVolumesFromSnapshotTest-654342443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e87ab456-a239-46b6-903d-d6444e69524d" returned: 0 in 0.272s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:57 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a7fe324f-ebd9-4817-aa48-38f7f529dda0 tempest-CreateVolumesFromSnapshotTest-654342443 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:08:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a7fe324f-ebd9-4817-aa48-38f7f529dda0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-aeb5b59a-65f2-4f75-9b14-9d33feb4bca5 tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.750s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:57 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-aeb5b59a-65f2-4f75-9b14-9d33feb4bca5 tempest-CreateVolumesFromSnapshotTest-654342443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-993922568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b76376e-a0ba-4544-82be-5be351ea5d1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf26b5bad6894c7983357ed898b033b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:08:51Z,use_quota=True,user_id='9b033975bdb9430198a108890d26bedb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:08:57 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-aeb5b59a-65f2-4f75-9b14-9d33feb4bca5 tempest-CreateVolumesFromSnapshotTest-654342443 None] Creating volume 0b76376e-a0ba-4544-82be-5be351ea5d1a {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:08:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-aeb5b59a-65f2-4f75-9b14-9d33feb4bca5 tempest-CreateVolumesFromSnapshotTest-654342443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-aeb5b59a-65f2-4f75-9b14-9d33feb4bca5 tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:57 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-aeb5b59a-65f2-4f75-9b14-9d33feb4bca5 tempest-CreateVolumesFromSnapshotTest-654342443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:08:57 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-aeb5b59a-65f2-4f75-9b14-9d33feb4bca5 tempest-CreateVolumesFromSnapshotTest-654342443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:08:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-aeb5b59a-65f2-4f75-9b14-9d33feb4bca5 tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:57 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-aeb5b59a-65f2-4f75-9b14-9d33feb4bca5 tempest-CreateVolumesFromSnapshotTest-654342443 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:08:57 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-aeb5b59a-65f2-4f75-9b14-9d33feb4bca5 tempest-CreateVolumesFromSnapshotTest-654342443 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:08:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-aeb5b59a-65f2-4f75-9b14-9d33feb4bca5 tempest-CreateVolumesFromSnapshotTest-654342443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0b76376e-a0ba-4544-82be-5be351ea5d1a 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a7fe324f-ebd9-4817-aa48-38f7f529dda0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc60a32a-3ce3-44dd-ae10-00dd3939c0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e87ab456-a239-46b6-903d-d6444e69524d', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:58 devstack sudo[108197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0b76376e-a0ba-4544-82be-5be351ea5d1a 1073741824 Jul 30 17:08:58 devstack sudo[108197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a7fe324f-ebd9-4817-aa48-38f7f529dda0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b73d208-bec1-4f7c-adaf-c56043cac9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:58 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-a7fe324f-ebd9-4817-aa48-38f7f529dda0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Volume volume-e87ab456-a239-46b6-903d-d6444e69524d (e87ab456-a239-46b6-903d-d6444e69524d): created successfully Jul 30 17:08:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a7fe324f-ebd9-4817-aa48-38f7f529dda0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b73d208-bec1-4f7c-adaf-c56043cac9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-a7fe324f-ebd9-4817-aa48-38f7f529dda0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Flow 'volume_create_manager' (48d12678-62ea-4cd2-899a-221e0c24165d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:08:58 devstack sudo[108194]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-538641a5-f107-430f-ba4a-3426b59efba2 tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.273s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:58 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-538641a5-f107-430f-ba4a-3426b59efba2 tempest-VolumeDependencyTests-500709084 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:08:58 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-a7fe324f-ebd9-4817-aa48-38f7f529dda0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Created volume successfully. Jul 30 17:08:58 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-538641a5-f107-430f-ba4a-3426b59efba2 tempest-VolumeDependencyTests-500709084 None] Deleted volume successfully. Jul 30 17:08:58 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-538641a5-f107-430f-ba4a-3426b59efba2 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-b827d622-7d7d-472b-af3a-d34394a60c06-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:08:58 devstack sudo[108197]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-aeb5b59a-65f2-4f75-9b14-9d33feb4bca5 tempest-CreateVolumesFromSnapshotTest-654342443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0b76376e-a0ba-4544-82be-5be351ea5d1a 1073741824" returned: 0 in 0.521s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-aeb5b59a-65f2-4f75-9b14-9d33feb4bca5 tempest-CreateVolumesFromSnapshotTest-654342443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0b76376e-a0ba-4544-82be-5be351ea5d1a {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:58 devstack sudo[108203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0b76376e-a0ba-4544-82be-5be351ea5d1a Jul 30 17:08:58 devstack sudo[108203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:58 devstack sudo[108203]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-aeb5b59a-65f2-4f75-9b14-9d33feb4bca5 tempest-CreateVolumesFromSnapshotTest-654342443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0b76376e-a0ba-4544-82be-5be351ea5d1a" returned: 0 in 0.268s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:58 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-aeb5b59a-65f2-4f75-9b14-9d33feb4bca5 tempest-CreateVolumesFromSnapshotTest-654342443 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:08:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-aeb5b59a-65f2-4f75-9b14-9d33feb4bca5 tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b9ce22c6-b214-4c3c-b8bd-2fb0e1680567 tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.198s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:58 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b9ce22c6-b214-4c3c-b8bd-2fb0e1680567 tempest-CreateVolumesFromSnapshotTest-654342443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1185187624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bf17c99-2377-4dfa-b6e1-234a9a0c4bc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf26b5bad6894c7983357ed898b033b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:08:51Z,use_quota=True,user_id='9b033975bdb9430198a108890d26bedb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:08:58 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-b9ce22c6-b214-4c3c-b8bd-2fb0e1680567 tempest-CreateVolumesFromSnapshotTest-654342443 None] Creating volume 5bf17c99-2377-4dfa-b6e1-234a9a0c4bc7 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:08:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b9ce22c6-b214-4c3c-b8bd-2fb0e1680567 tempest-CreateVolumesFromSnapshotTest-654342443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b9ce22c6-b214-4c3c-b8bd-2fb0e1680567 tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:58 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b9ce22c6-b214-4c3c-b8bd-2fb0e1680567 tempest-CreateVolumesFromSnapshotTest-654342443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:08:58 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b9ce22c6-b214-4c3c-b8bd-2fb0e1680567 tempest-CreateVolumesFromSnapshotTest-654342443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:08:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b9ce22c6-b214-4c3c-b8bd-2fb0e1680567 tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:58 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b9ce22c6-b214-4c3c-b8bd-2fb0e1680567 tempest-CreateVolumesFromSnapshotTest-654342443 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:08:58 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-b9ce22c6-b214-4c3c-b8bd-2fb0e1680567 tempest-CreateVolumesFromSnapshotTest-654342443 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:08:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b9ce22c6-b214-4c3c-b8bd-2fb0e1680567 tempest-CreateVolumesFromSnapshotTest-654342443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5bf17c99-2377-4dfa-b6e1-234a9a0c4bc7 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-aeb5b59a-65f2-4f75-9b14-9d33feb4bca5 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8e921a4-1e32-48ff-9636-152a8a1128ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b76376e-a0ba-4544-82be-5be351ea5d1a', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-aeb5b59a-65f2-4f75-9b14-9d33feb4bca5 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d96d64fe-d841-4cb2-b5f6-b22f95e56d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:58 devstack sudo[108206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5bf17c99-2377-4dfa-b6e1-234a9a0c4bc7 1073741824 Jul 30 17:08:58 devstack sudo[108206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:58 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-aeb5b59a-65f2-4f75-9b14-9d33feb4bca5 tempest-CreateVolumesFromSnapshotTest-654342443 None] Volume volume-0b76376e-a0ba-4544-82be-5be351ea5d1a (0b76376e-a0ba-4544-82be-5be351ea5d1a): created successfully Jul 30 17:08:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-aeb5b59a-65f2-4f75-9b14-9d33feb4bca5 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d96d64fe-d841-4cb2-b5f6-b22f95e56d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:58 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-aeb5b59a-65f2-4f75-9b14-9d33feb4bca5 tempest-CreateVolumesFromSnapshotTest-654342443 None] Flow 'volume_create_manager' (e687f580-a731-4de5-89b3-6e0b36a2cf85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:08:58 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-aeb5b59a-65f2-4f75-9b14-9d33feb4bca5 tempest-CreateVolumesFromSnapshotTest-654342443 None] Created volume successfully. Jul 30 17:08:59 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c05d144-fa5b-452b-9a21-78916edce4ea tempest-VolumeDependencyTests-500709084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:08:59 devstack sudo[108206]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:59 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8c05d144-fa5b-452b-9a21-78916edce4ea tempest-VolumeDependencyTests-500709084 None] Flow 'volume_create_manager' (9391fdd4-7b91-416d-a220-29236fd0a832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:08:59 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8c05d144-fa5b-452b-9a21-78916edce4ea tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (269b622c-c010-4db7-aea0-404921e8fd4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b9ce22c6-b214-4c3c-b8bd-2fb0e1680567 tempest-CreateVolumesFromSnapshotTest-654342443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5bf17c99-2377-4dfa-b6e1-234a9a0c4bc7 1073741824" returned: 0 in 0.607s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:59 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8c05d144-fa5b-452b-9a21-78916edce4ea tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (269b622c-c010-4db7-aea0-404921e8fd4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:08:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-509494833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d48bfa2-dfb0-4990-a275-d31b3723c2a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75be733264504175956c041c2312fa52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:08:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:08:59Z,use_quota=True,user_id='9ee0dab1317a4cfeafb4f6b50ca81a57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:59 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8c05d144-fa5b-452b-9a21-78916edce4ea tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a95fd1e-bd90-4cf0-b1a5-3e17a7cb6a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:59 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8c05d144-fa5b-452b-9a21-78916edce4ea tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a95fd1e-bd90-4cf0-b1a5-3e17a7cb6a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:59 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8c05d144-fa5b-452b-9a21-78916edce4ea tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c655826a-2526-4b03-b991-42c345aed3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:59 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8c05d144-fa5b-452b-9a21-78916edce4ea tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c655826a-2526-4b03-b991-42c345aed3b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d48bfa2-dfb0-4990-a275-d31b3723c2a2', 'volume_name': 'volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:59 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8c05d144-fa5b-452b-9a21-78916edce4ea tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (489a4161-2fcf-48d1-8f4f-89e2a0206416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:59 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8c05d144-fa5b-452b-9a21-78916edce4ea tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (489a4161-2fcf-48d1-8f4f-89e2a0206416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:59 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8c05d144-fa5b-452b-9a21-78916edce4ea tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (354ed11c-f906-4ba8-aee3-5a7786ee637d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:59 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-8c05d144-fa5b-452b-9a21-78916edce4ea tempest-VolumeDependencyTests-500709084 None] Volume 2d48bfa2-dfb0-4990-a275-d31b3723c2a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2', 'volume_size': 1} Jul 30 17:08:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8c05d144-fa5b-452b-9a21-78916edce4ea tempest-VolumeDependencyTests-500709084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b9ce22c6-b214-4c3c-b8bd-2fb0e1680567 tempest-CreateVolumesFromSnapshotTest-654342443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5bf17c99-2377-4dfa-b6e1-234a9a0c4bc7 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:59 devstack sudo[108212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5bf17c99-2377-4dfa-b6e1-234a9a0c4bc7 Jul 30 17:08:59 devstack sudo[108212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:59 devstack sudo[108212]: pam_unix(sudo:session): session closed for user root Jul 30 17:08:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b9ce22c6-b214-4c3c-b8bd-2fb0e1680567 tempest-CreateVolumesFromSnapshotTest-654342443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5bf17c99-2377-4dfa-b6e1-234a9a0c4bc7" returned: 0 in 0.274s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:08:59 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b9ce22c6-b214-4c3c-b8bd-2fb0e1680567 tempest-CreateVolumesFromSnapshotTest-654342443 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:08:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b9ce22c6-b214-4c3c-b8bd-2fb0e1680567 tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-caf981b2-2e8e-4061-96de-498b1b6ff2a0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.772s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:59 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-caf981b2-2e8e-4061-96de-498b1b6ff2a0 tempest-CreateVolumesFromSnapshotTest-654342443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:08:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-786264455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ccd9c42-fef3-4e7f-bc88-f74e4d891b88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf26b5bad6894c7983357ed898b033b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:08:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:08:52Z,use_quota=True,user_id='9b033975bdb9430198a108890d26bedb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:08:59 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-caf981b2-2e8e-4061-96de-498b1b6ff2a0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Creating volume 8ccd9c42-fef3-4e7f-bc88-f74e4d891b88 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:08:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-caf981b2-2e8e-4061-96de-498b1b6ff2a0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:08:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-caf981b2-2e8e-4061-96de-498b1b6ff2a0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:08:59 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-caf981b2-2e8e-4061-96de-498b1b6ff2a0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:08:59 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-caf981b2-2e8e-4061-96de-498b1b6ff2a0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:08:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-caf981b2-2e8e-4061-96de-498b1b6ff2a0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:08:59 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-caf981b2-2e8e-4061-96de-498b1b6ff2a0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:08:59 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-caf981b2-2e8e-4061-96de-498b1b6ff2a0 tempest-CreateVolumesFromSnapshotTest-654342443 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:08:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-caf981b2-2e8e-4061-96de-498b1b6ff2a0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ccd9c42-fef3-4e7f-bc88-f74e4d891b88 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:08:59 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b9ce22c6-b214-4c3c-b8bd-2fb0e1680567 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0874209-baa6-43e5-a151-5f29b941fb0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bf17c99-2377-4dfa-b6e1-234a9a0c4bc7', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:59 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b9ce22c6-b214-4c3c-b8bd-2fb0e1680567 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcbd45c5-75c3-4bca-91c3-fd083767d2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:08:59 devstack sudo[108215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ccd9c42-fef3-4e7f-bc88-f74e4d891b88 1073741824 Jul 30 17:08:59 devstack sudo[108215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:08:59 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-b9ce22c6-b214-4c3c-b8bd-2fb0e1680567 tempest-CreateVolumesFromSnapshotTest-654342443 None] Volume volume-5bf17c99-2377-4dfa-b6e1-234a9a0c4bc7 (5bf17c99-2377-4dfa-b6e1-234a9a0c4bc7): created successfully Jul 30 17:08:59 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b9ce22c6-b214-4c3c-b8bd-2fb0e1680567 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcbd45c5-75c3-4bca-91c3-fd083767d2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:08:59 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b9ce22c6-b214-4c3c-b8bd-2fb0e1680567 tempest-CreateVolumesFromSnapshotTest-654342443 None] Flow 'volume_create_manager' (399fd11a-bce7-40a0-a66c-566d28b1397a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:08:59 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-b9ce22c6-b214-4c3c-b8bd-2fb0e1680567 tempest-CreateVolumesFromSnapshotTest-654342443 None] Created volume successfully. Jul 30 17:09:00 devstack sudo[108215]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-caf981b2-2e8e-4061-96de-498b1b6ff2a0 tempest-CreateVolumesFromSnapshotTest-654342443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ccd9c42-fef3-4e7f-bc88-f74e4d891b88 1073741824" returned: 0 in 0.467s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-caf981b2-2e8e-4061-96de-498b1b6ff2a0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ccd9c42-fef3-4e7f-bc88-f74e4d891b88 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:00 devstack sudo[108221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ccd9c42-fef3-4e7f-bc88-f74e4d891b88 Jul 30 17:09:00 devstack sudo[108221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:00 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:09:00 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] Flow 'volume_create_manager' (0577346f-fa08-4781-b98d-59c30ca514d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:09:00 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64c71d11-46db-4db9-a5b0-bd597c89cb76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:00 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64c71d11-46db-4db9-a5b0-bd597c89cb76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:09:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-teste6050452-06bd-4c7f-9912-45178c83e379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9f56c8b-0fb4-4f83-8b50-a220707eb286,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f61df38a914ec2a6713104b0278991',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:09:00Z,use_quota=True,user_id='e4eedb818424482c9370625aced56a0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:00 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e11316b-1f3d-43eb-9f1c-1ba5cff37b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:00 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e11316b-1f3d-43eb-9f1c-1ba5cff37b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:00 devstack sudo[108221]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:00 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2579c5d1-6e13-489f-91de-3aab75b6f7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:00 devstack cinder-volume[88591]: DEBUG cinder.image.glance [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] Creating Keystone auth plugin from conf {{(pid=88591) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 30 17:09:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-caf981b2-2e8e-4061-96de-498b1b6ff2a0 tempest-CreateVolumesFromSnapshotTest-654342443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ccd9c42-fef3-4e7f-bc88-f74e4d891b88" returned: 0 in 0.284s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:00 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-caf981b2-2e8e-4061-96de-498b1b6ff2a0 tempest-CreateVolumesFromSnapshotTest-654342443 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:09:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-caf981b2-2e8e-4061-96de-498b1b6ff2a0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1cabc51e-8649-4656-9881-b512e90d976b tempest-ProjectMemberTests-1145856324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.030s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:00 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-caf981b2-2e8e-4061-96de-498b1b6ff2a0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b30f79a9-41ea-452f-a316-516258e52189) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ccd9c42-fef3-4e7f-bc88-f74e4d891b88', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:00 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-caf981b2-2e8e-4061-96de-498b1b6ff2a0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9153f235-f87e-4cf0-bcc7-470e4b0914cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:00 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-1cabc51e-8649-4656-9881-b512e90d976b tempest-ProjectMemberTests-1145856324 None] Creating offline snapshot 291193cb-fc17-48ec-a664-5527d425cbcf of volume 0f62deeb-1217-4416-854e-b6e5d09b3b63 {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:09:00 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-caf981b2-2e8e-4061-96de-498b1b6ff2a0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Volume volume-8ccd9c42-fef3-4e7f-bc88-f74e4d891b88 (8ccd9c42-fef3-4e7f-bc88-f74e4d891b88): created successfully Jul 30 17:09:00 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-caf981b2-2e8e-4061-96de-498b1b6ff2a0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9153f235-f87e-4cf0-bcc7-470e4b0914cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:00 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-caf981b2-2e8e-4061-96de-498b1b6ff2a0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Flow 'volume_create_manager' (d0b1a9cd-1195-429e-ab17-8bc8be2ad945) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:09:00 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[33aefae9-3cf0-48c9-8d99-f7e7ee86b049]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1cabc51e-8649-4656-9881-b512e90d976b tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0f62deeb-1217-4416-854e-b6e5d09b3b63 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:00 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-caf981b2-2e8e-4061-96de-498b1b6ff2a0 tempest-CreateVolumesFromSnapshotTest-654342443 None] Created volume successfully. Jul 30 17:09:00 devstack sudo[108224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0f62deeb-1217-4416-854e-b6e5d09b3b63 Jul 30 17:09:00 devstack sudo[108224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:00 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-16a7e972-72e9-40b3-8866-bd4ec459281e tempest-CreateVolumesFromSnapshotTest-654342443 None] Acquiring lock "cinder-8ccd9c42-fef3-4e7f-bc88-f74e4d891b88-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:00 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-16a7e972-72e9-40b3-8866-bd4ec459281e tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "cinder-8ccd9c42-fef3-4e7f-bc88-f74e4d891b88-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:00 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-16a7e972-72e9-40b3-8866-bd4ec459281e tempest-CreateVolumesFromSnapshotTest-654342443 None] Acquiring lock "cinder-quobyte-8ccd9c42-fef3-4e7f-bc88-f74e4d891b88" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:00 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-16a7e972-72e9-40b3-8866-bd4ec459281e tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "cinder-quobyte-8ccd9c42-fef3-4e7f-bc88-f74e4d891b88" acquired by "delete_volume" :: waited 0.021s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:00 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75677cf-98aa-49c0-be79-a25d9f4d521b]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-16a7e972-72e9-40b3-8866-bd4ec459281e tempest-CreateVolumesFromSnapshotTest-654342443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ccd9c42-fef3-4e7f-bc88-f74e4d891b88 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2579c5d1-6e13-489f-91de-3aab75b6f7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a9f56c8b-0fb4-4f83-8b50-a220707eb286', 'volume_name': 'volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286', 'volume_size': 1, 'image_id': 'b87552f3-3bd4-47cd-b111-44a103b6df79', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b87552f3-3bd4-47cd-b111-44a103b6df79', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-e6050452-06bd-4c7f-9912-45178c83e379', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd6061311f2f04ea2e11561b532ea048f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '58f61df38a914ec2a6713104b0278991', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '56289bc2e9b05a69da51476ee5e3cf2c3d63386f9b0c5ab83f510340eaa4c5df960385a5e948bea4474998eb23f1fa9ea7e4ce1c3120b1b5b1bbe58b4abae8c7', 'id': 'b87552f3-3bd4-47cd-b111-44a103b6df79', 'created_at': datetime.datetime(2026, 7, 30, 15, 8, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 15, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b87552f3-3bd4-47cd-b111-44a103b6df79/file', 'properties': {}}, 'image_service': }' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e67f4dc2-891a-4076-882b-376d2e027354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e67f4dc2-891a-4076-882b-376d2e027354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8820f25-7b9a-431d-b923-f66501635b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:01 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] Volume a9f56c8b-0fb4-4f83-8b50-a220707eb286: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286', 'volume_size': 1, 'image_id': 'b87552f3-3bd4-47cd-b111-44a103b6df79', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b87552f3-3bd4-47cd-b111-44a103b6df79', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-e6050452-06bd-4c7f-9912-45178c83e379', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd6061311f2f04ea2e11561b532ea048f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '58f61df38a914ec2a6713104b0278991', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '56289bc2e9b05a69da51476ee5e3cf2c3d63386f9b0c5ab83f510340eaa4c5df960385a5e948bea4474998eb23f1fa9ea7e4ce1c3120b1b5b1bbe58b4abae8c7', 'id': 'b87552f3-3bd4-47cd-b111-44a103b6df79', 'created_at': datetime.datetime(2026, 7, 30, 15, 8, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 15, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b87552f3-3bd4-47cd-b111-44a103b6df79/file', 'properties': {}}, 'image_service': } Jul 30 17:09:01 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] Trying to clone a9f56c8b-0fb4-4f83-8b50-a220707eb286 from image b87552f3-3bd4-47cd-b111-44a103b6df79 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b87552f3-3bd4-47cd-b111-44a103b6df79', 'metadata': {}}]). {{(pid=88591) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 30 17:09:01 devstack sudo[108227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ccd9c42-fef3-4e7f-bc88-f74e4d891b88 Jul 30 17:09:01 devstack sudo[108227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:01 devstack sudo[108224]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1cabc51e-8649-4656-9881-b512e90d976b tempest-ProjectMemberTests-1145856324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0f62deeb-1217-4416-854e-b6e5d09b3b63" returned: 0 in 0.487s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1cabc51e-8649-4656-9881-b512e90d976b tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0f62deeb-1217-4416-854e-b6e5d09b3b63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0f62deeb-1217-4416-854e-b6e5d09b3b63.291193cb-fc17-48ec-a664-5527d425cbcf 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:01 devstack sudo[108232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0f62deeb-1217-4416-854e-b6e5d09b3b63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0f62deeb-1217-4416-854e-b6e5d09b3b63.291193cb-fc17-48ec-a664-5527d425cbcf 1G Jul 30 17:09:01 devstack sudo[108232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:01 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b87552f3-3bd4-47cd-b111-44a103b6df79_1gcabu42devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88591) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 30 17:09:01 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] Image download 0.00 MB at 0.00 MB/s Jul 30 17:09:01 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[450ad067-175d-40f5-a89c-a6873c043d85]: (4, 'raw') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b87552f3-3bd4-47cd-b111-44a103b6df79_1gcabu42devstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:01 devstack sudo[108234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b87552f3-3bd4-47cd-b111-44a103b6df79_1gcabu42devstack@QuobyteHD Jul 30 17:09:01 devstack sudo[108234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:01 devstack sudo[108227]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-16a7e972-72e9-40b3-8866-bd4ec459281e tempest-CreateVolumesFromSnapshotTest-654342443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ccd9c42-fef3-4e7f-bc88-f74e4d891b88" returned: 0 in 0.455s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-16a7e972-72e9-40b3-8866-bd4ec459281e tempest-CreateVolumesFromSnapshotTest-654342443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ccd9c42-fef3-4e7f-bc88-f74e4d891b88 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:01 devstack sudo[108241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ccd9c42-fef3-4e7f-bc88-f74e4d891b88 Jul 30 17:09:01 devstack sudo[108241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:01 devstack sudo[108232]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1cabc51e-8649-4656-9881-b512e90d976b tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0f62deeb-1217-4416-854e-b6e5d09b3b63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0f62deeb-1217-4416-854e-b6e5d09b3b63.291193cb-fc17-48ec-a664-5527d425cbcf 1G" returned: 0 in 0.471s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1cabc51e-8649-4656-9881-b512e90d976b tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f62deeb-1217-4416-854e-b6e5d09b3b63 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0f62deeb-1217-4416-854e-b6e5d09b3b63.291193cb-fc17-48ec-a664-5527d425cbcf {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:01 devstack sudo[108234]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b87552f3-3bd4-47cd-b111-44a103b6df79_1gcabu42devstack@QuobyteHD" returned: 0 in 0.360s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b87552f3-3bd4-47cd-b111-44a103b6df79_1gcabu42devstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:01 devstack sudo[108246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f62deeb-1217-4416-854e-b6e5d09b3b63 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0f62deeb-1217-4416-854e-b6e5d09b3b63.291193cb-fc17-48ec-a664-5527d425cbcf Jul 30 17:09:01 devstack sudo[108246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:01 devstack sudo[108241]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-16a7e972-72e9-40b3-8866-bd4ec459281e tempest-CreateVolumesFromSnapshotTest-654342443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ccd9c42-fef3-4e7f-bc88-f74e4d891b88" returned: 0 in 0.279s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:01 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-16a7e972-72e9-40b3-8866-bd4ec459281e tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "cinder-quobyte-8ccd9c42-fef3-4e7f-bc88-f74e4d891b88" released by "delete_volume" :: held 0.801s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:01 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-16a7e972-72e9-40b3-8866-bd4ec459281e tempest-CreateVolumesFromSnapshotTest-654342443 None] Created reservations ['912c8db9-4a88-4eea-8d28-d87d88715e3d', 'fee27893-773d-4c63-ab05-dc4b4294e1fb', '97bd4659-ca85-4ce2-8373-25cb392656cd', '19468af5-f622-4339-a29f-3118e6912842'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:09:01 devstack sudo[108247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b87552f3-3bd4-47cd-b111-44a103b6df79_1gcabu42devstack@QuobyteHD Jul 30 17:09:01 devstack sudo[108247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-16a7e972-72e9-40b3-8866-bd4ec459281e tempest-CreateVolumesFromSnapshotTest-654342443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-16a7e972-72e9-40b3-8866-bd4ec459281e tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:01 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-16a7e972-72e9-40b3-8866-bd4ec459281e tempest-CreateVolumesFromSnapshotTest-654342443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:01 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-16a7e972-72e9-40b3-8866-bd4ec459281e tempest-CreateVolumesFromSnapshotTest-654342443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-16a7e972-72e9-40b3-8866-bd4ec459281e tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-16a7e972-72e9-40b3-8866-bd4ec459281e tempest-CreateVolumesFromSnapshotTest-654342443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:01 devstack sudo[108251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:09:01 devstack sudo[108251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:01 devstack sudo[108246]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1cabc51e-8649-4656-9881-b512e90d976b tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f62deeb-1217-4416-854e-b6e5d09b3b63 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0f62deeb-1217-4416-854e-b6e5d09b3b63.291193cb-fc17-48ec-a664-5527d425cbcf" returned: 0 in 0.359s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:02 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-1cabc51e-8649-4656-9881-b512e90d976b tempest-ProjectMemberTests-1145856324 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0f62deeb-1217-4416-854e-b6e5d09b3b63.291193cb-fc17-48ec-a664-5527d425cbcf is being set with open permissions: ugo+rw Jul 30 17:09:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1cabc51e-8649-4656-9881-b512e90d976b tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0f62deeb-1217-4416-854e-b6e5d09b3b63.291193cb-fc17-48ec-a664-5527d425cbcf {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:02 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9efd8dfa-76f9-4c5f-bebb-042fd6cfc387 tempest-CreateVolumesFromSnapshotTest-654342443 None] Acquiring lock "cinder-5bf17c99-2377-4dfa-b6e1-234a9a0c4bc7-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:02 devstack sudo[108260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0f62deeb-1217-4416-854e-b6e5d09b3b63.291193cb-fc17-48ec-a664-5527d425cbcf Jul 30 17:09:02 devstack sudo[108260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:02 devstack sudo[108247]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b87552f3-3bd4-47cd-b111-44a103b6df79_1gcabu42devstack@QuobyteHD" returned: 1 in 0.457s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b87552f3-3bd4-47cd-b111-44a103b6df79_1gcabu42devstack@QuobyteHD' failed. Not Retrying. {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 17:09:02 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] Temporary image b87552f3-3bd4-47cd-b111-44a103b6df79 is fetched for user e4eedb818424482c9370625aced56a0a. {{(pid=88591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 30 17:09:02 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9efd8dfa-76f9-4c5f-bebb-042fd6cfc387 tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "cinder-5bf17c99-2377-4dfa-b6e1-234a9a0c4bc7-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:02 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9efd8dfa-76f9-4c5f-bebb-042fd6cfc387 tempest-CreateVolumesFromSnapshotTest-654342443 None] Acquiring lock "cinder-quobyte-5bf17c99-2377-4dfa-b6e1-234a9a0c4bc7" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:02 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9efd8dfa-76f9-4c5f-bebb-042fd6cfc387 tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "cinder-quobyte-5bf17c99-2377-4dfa-b6e1-234a9a0c4bc7" acquired by "delete_volume" :: waited 0.020s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:02 devstack sudo[108251]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-16a7e972-72e9-40b3-8866-bd4ec459281e tempest-CreateVolumesFromSnapshotTest-654342443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.348s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:02 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-16a7e972-72e9-40b3-8866-bd4ec459281e tempest-CreateVolumesFromSnapshotTest-654342443 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:09:02 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6350c7-209b-4671-a91d-8cc317c3613b]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9efd8dfa-76f9-4c5f-bebb-042fd6cfc387 tempest-CreateVolumesFromSnapshotTest-654342443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5bf17c99-2377-4dfa-b6e1-234a9a0c4bc7 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:02 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-16a7e972-72e9-40b3-8866-bd4ec459281e tempest-CreateVolumesFromSnapshotTest-654342443 None] Deleted volume successfully. Jul 30 17:09:02 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f034b4-e94c-4037-a6c7-7e9f899c089b]: (4, 'raw') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b87552f3-3bd4-47cd-b111-44a103b6df79_1gcabu42devstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:02 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-16a7e972-72e9-40b3-8866-bd4ec459281e tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "cinder-8ccd9c42-fef3-4e7f-bc88-f74e4d891b88-delete_volume" released by "delete_volume" :: held 1.399s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:02 devstack sudo[108260]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1cabc51e-8649-4656-9881-b512e90d976b tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0f62deeb-1217-4416-854e-b6e5d09b3b63.291193cb-fc17-48ec-a664-5527d425cbcf" returned: 0 in 0.299s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1cabc51e-8649-4656-9881-b512e90d976b tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0f62deeb-1217-4416-854e-b6e5d09b3b63.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:02 devstack sudo[108263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5bf17c99-2377-4dfa-b6e1-234a9a0c4bc7 Jul 30 17:09:02 devstack sudo[108263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:02 devstack sudo[108266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0f62deeb-1217-4416-854e-b6e5d09b3b63.info Jul 30 17:09:02 devstack sudo[108266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:02 devstack sudo[108264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b87552f3-3bd4-47cd-b111-44a103b6df79_1gcabu42devstack@QuobyteHD Jul 30 17:09:02 devstack sudo[108264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:02 devstack sudo[108266]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1cabc51e-8649-4656-9881-b512e90d976b tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0f62deeb-1217-4416-854e-b6e5d09b3b63.info" returned: 0 in 0.279s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:02 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-1cabc51e-8649-4656-9881-b512e90d976b tempest-ProjectMemberTests-1145856324 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0f62deeb-1217-4416-854e-b6e5d09b3b63.info is being set with open permissions: ugo+rw Jul 30 17:09:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1cabc51e-8649-4656-9881-b512e90d976b tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0f62deeb-1217-4416-854e-b6e5d09b3b63.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:02 devstack sudo[108264]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b87552f3-3bd4-47cd-b111-44a103b6df79_1gcabu42devstack@QuobyteHD" returned: 0 in 0.378s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b87552f3-3bd4-47cd-b111-44a103b6df79_1gcabu42devstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:02 devstack sudo[108263]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:02 devstack sudo[108277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0f62deeb-1217-4416-854e-b6e5d09b3b63.info Jul 30 17:09:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9efd8dfa-76f9-4c5f-bebb-042fd6cfc387 tempest-CreateVolumesFromSnapshotTest-654342443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5bf17c99-2377-4dfa-b6e1-234a9a0c4bc7" returned: 0 in 0.418s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9efd8dfa-76f9-4c5f-bebb-042fd6cfc387 tempest-CreateVolumesFromSnapshotTest-654342443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5bf17c99-2377-4dfa-b6e1-234a9a0c4bc7 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:02 devstack sudo[108277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:02 devstack sudo[108280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5bf17c99-2377-4dfa-b6e1-234a9a0c4bc7 Jul 30 17:09:02 devstack sudo[108280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:02 devstack sudo[108278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b87552f3-3bd4-47cd-b111-44a103b6df79_1gcabu42devstack@QuobyteHD Jul 30 17:09:02 devstack sudo[108278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:02 devstack sudo[108277]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1cabc51e-8649-4656-9881-b512e90d976b tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0f62deeb-1217-4416-854e-b6e5d09b3b63.info" returned: 0 in 0.271s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:02 devstack sudo[108280]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1cabc51e-8649-4656-9881-b512e90d976b tempest-ProjectMemberTests-1145856324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.285s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8c05d144-fa5b-452b-9a21-78916edce4ea tempest-VolumeDependencyTests-500709084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.405s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:02 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-8c05d144-fa5b-452b-9a21-78916edce4ea tempest-VolumeDependencyTests-500709084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:08:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-509494833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d48bfa2-dfb0-4990-a275-d31b3723c2a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75be733264504175956c041c2312fa52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:08:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:08:59Z,use_quota=True,user_id='9ee0dab1317a4cfeafb4f6b50ca81a57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:09:02 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-8c05d144-fa5b-452b-9a21-78916edce4ea tempest-VolumeDependencyTests-500709084 None] Creating volume 2d48bfa2-dfb0-4990-a275-d31b3723c2a2 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:09:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8c05d144-fa5b-452b-9a21-78916edce4ea tempest-VolumeDependencyTests-500709084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8c05d144-fa5b-452b-9a21-78916edce4ea tempest-VolumeDependencyTests-500709084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:02 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-8c05d144-fa5b-452b-9a21-78916edce4ea tempest-VolumeDependencyTests-500709084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:02 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-8c05d144-fa5b-452b-9a21-78916edce4ea tempest-VolumeDependencyTests-500709084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8c05d144-fa5b-452b-9a21-78916edce4ea tempest-VolumeDependencyTests-500709084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:02 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-8c05d144-fa5b-452b-9a21-78916edce4ea tempest-VolumeDependencyTests-500709084 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:09:02 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-8c05d144-fa5b-452b-9a21-78916edce4ea tempest-VolumeDependencyTests-500709084 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:09:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8c05d144-fa5b-452b-9a21-78916edce4ea tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9efd8dfa-76f9-4c5f-bebb-042fd6cfc387 tempest-CreateVolumesFromSnapshotTest-654342443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-5bf17c99-2377-4dfa-b6e1-234a9a0c4bc7" returned: 0 in 0.287s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:02 devstack sudo[108285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2 1073741824 Jul 30 17:09:02 devstack sudo[108285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:02 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9efd8dfa-76f9-4c5f-bebb-042fd6cfc387 tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "cinder-quobyte-5bf17c99-2377-4dfa-b6e1-234a9a0c4bc7" released by "delete_volume" :: held 0.778s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:02 devstack sudo[108278]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:02 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-1cabc51e-8649-4656-9881-b512e90d976b tempest-ProjectMemberTests-1145856324 None] Create snapshot completed successfully Jul 30 17:09:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b87552f3-3bd4-47cd-b111-44a103b6df79_1gcabu42devstack@QuobyteHD" returned: 1 in 0.364s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b87552f3-3bd4-47cd-b111-44a103b6df79_1gcabu42devstack@QuobyteHD' failed. Not Retrying. {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 17:09:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:03 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-9efd8dfa-76f9-4c5f-bebb-042fd6cfc387 tempest-CreateVolumesFromSnapshotTest-654342443 None] Created reservations ['e92a8fba-017c-460e-a531-9a8eddd17146', '9f3d11c0-3bfd-4ee5-830b-760a8281497e', '586041ec-54cb-451c-b2da-e803ed4a0747', 'd800fa1b-ed41-43ce-995c-d3d36869bfd8'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:09:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-9efd8dfa-76f9-4c5f-bebb-042fd6cfc387 tempest-CreateVolumesFromSnapshotTest-654342443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-9efd8dfa-76f9-4c5f-bebb-042fd6cfc387 tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:03 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-9efd8dfa-76f9-4c5f-bebb-042fd6cfc387 tempest-CreateVolumesFromSnapshotTest-654342443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:03 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-9efd8dfa-76f9-4c5f-bebb-042fd6cfc387 tempest-CreateVolumesFromSnapshotTest-654342443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-9efd8dfa-76f9-4c5f-bebb-042fd6cfc387 tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9efd8dfa-76f9-4c5f-bebb-042fd6cfc387 tempest-CreateVolumesFromSnapshotTest-654342443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:03 devstack sudo[108290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:09:03 devstack sudo[108290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:03 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-a640c50a-9363-469b-aa29-5a1d04ec9d80 tempest-CreateVolumesFromSnapshotTest-654342443 None] Acquiring lock "cinder-0b76376e-a0ba-4544-82be-5be351ea5d1a-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:03 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-a640c50a-9363-469b-aa29-5a1d04ec9d80 tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "cinder-0b76376e-a0ba-4544-82be-5be351ea5d1a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:03 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-a640c50a-9363-469b-aa29-5a1d04ec9d80 tempest-CreateVolumesFromSnapshotTest-654342443 None] Acquiring lock "cinder-quobyte-0b76376e-a0ba-4544-82be-5be351ea5d1a" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:03 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-a640c50a-9363-469b-aa29-5a1d04ec9d80 tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "cinder-quobyte-0b76376e-a0ba-4544-82be-5be351ea5d1a" acquired by "delete_volume" :: waited 0.016s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:03 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[3937af18-886b-4843-a023-8079b214a899]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a640c50a-9363-469b-aa29-5a1d04ec9d80 tempest-CreateVolumesFromSnapshotTest-654342443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0b76376e-a0ba-4544-82be-5be351ea5d1a {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:03 devstack sudo[108290]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9efd8dfa-76f9-4c5f-bebb-042fd6cfc387 tempest-CreateVolumesFromSnapshotTest-654342443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.304s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:03 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-9efd8dfa-76f9-4c5f-bebb-042fd6cfc387 tempest-CreateVolumesFromSnapshotTest-654342443 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:09:03 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-9efd8dfa-76f9-4c5f-bebb-042fd6cfc387 tempest-CreateVolumesFromSnapshotTest-654342443 None] Deleted volume successfully. Jul 30 17:09:03 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9efd8dfa-76f9-4c5f-bebb-042fd6cfc387 tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "cinder-5bf17c99-2377-4dfa-b6e1-234a9a0c4bc7-delete_volume" released by "delete_volume" :: held 1.301s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:03 devstack sudo[108285]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8c05d144-fa5b-452b-9a21-78916edce4ea tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2 1073741824" returned: 0 in 0.524s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:03 devstack sudo[108296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0b76376e-a0ba-4544-82be-5be351ea5d1a Jul 30 17:09:03 devstack sudo[108296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8c05d144-fa5b-452b-9a21-78916edce4ea tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:03 devstack sudo[108299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2 Jul 30 17:09:03 devstack sudo[108299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:03 devstack sudo[108296]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a640c50a-9363-469b-aa29-5a1d04ec9d80 tempest-CreateVolumesFromSnapshotTest-654342443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0b76376e-a0ba-4544-82be-5be351ea5d1a" returned: 0 in 0.393s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:03 devstack sudo[108299]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a640c50a-9363-469b-aa29-5a1d04ec9d80 tempest-CreateVolumesFromSnapshotTest-654342443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0b76376e-a0ba-4544-82be-5be351ea5d1a {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8c05d144-fa5b-452b-9a21-78916edce4ea tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2" returned: 0 in 0.261s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:03 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-8c05d144-fa5b-452b-9a21-78916edce4ea tempest-VolumeDependencyTests-500709084 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:09:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8c05d144-fa5b-452b-9a21-78916edce4ea tempest-VolumeDependencyTests-500709084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.753s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:03 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:09:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-teste6050452-06bd-4c7f-9912-45178c83e379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9f56c8b-0fb4-4f83-8b50-a220707eb286,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f61df38a914ec2a6713104b0278991',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:09:00Z,use_quota=True,user_id='e4eedb818424482c9370625aced56a0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:09:03 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] Creating volume a9f56c8b-0fb4-4f83-8b50-a220707eb286 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:09:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:03 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:03 devstack sudo[108306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0b76376e-a0ba-4544-82be-5be351ea5d1a Jul 30 17:09:03 devstack sudo[108306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:03 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:03 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:09:03 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:09:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:03 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8c05d144-fa5b-452b-9a21-78916edce4ea tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (354ed11c-f906-4ba8-aee3-5a7786ee637d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:03 devstack sudo[108308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286 1073741824 Jul 30 17:09:03 devstack sudo[108308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:03 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8c05d144-fa5b-452b-9a21-78916edce4ea tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bceabe9a-8b6d-48aa-a7d6-60b52f510fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:03 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-8c05d144-fa5b-452b-9a21-78916edce4ea tempest-VolumeDependencyTests-500709084 None] Volume volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2 (2d48bfa2-dfb0-4990-a275-d31b3723c2a2): created successfully Jul 30 17:09:03 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8c05d144-fa5b-452b-9a21-78916edce4ea tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bceabe9a-8b6d-48aa-a7d6-60b52f510fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:03 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-8c05d144-fa5b-452b-9a21-78916edce4ea tempest-VolumeDependencyTests-500709084 None] Flow 'volume_create_manager' (9391fdd4-7b91-416d-a220-29236fd0a832) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:09:03 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9a6b5e31-ea9f-4eab-a3b5-6de54b455b1a tempest-ProjectMemberTests-1145856324 None] Acquiring lock "cinder-291193cb-fc17-48ec-a664-5527d425cbcf-delete_snapshot" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:03 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-8c05d144-fa5b-452b-9a21-78916edce4ea tempest-VolumeDependencyTests-500709084 None] Created volume successfully. Jul 30 17:09:03 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9a6b5e31-ea9f-4eab-a3b5-6de54b455b1a tempest-ProjectMemberTests-1145856324 None] Lock "cinder-291193cb-fc17-48ec-a664-5527d425cbcf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:03 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9a6b5e31-ea9f-4eab-a3b5-6de54b455b1a tempest-ProjectMemberTests-1145856324 None] Acquiring lock "cinder-quobyte-0f62deeb-1217-4416-854e-b6e5d09b3b63" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:03 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9a6b5e31-ea9f-4eab-a3b5-6de54b455b1a tempest-ProjectMemberTests-1145856324 None] Lock "cinder-quobyte-0f62deeb-1217-4416-854e-b6e5d09b3b63" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:03 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9a6b5e31-ea9f-4eab-a3b5-6de54b455b1a tempest-ProjectMemberTests-1145856324 None] Acquiring lock "cinder-quobyte-291193cb-fc17-48ec-a664-5527d425cbcf" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:03 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9a6b5e31-ea9f-4eab-a3b5-6de54b455b1a tempest-ProjectMemberTests-1145856324 None] Lock "cinder-quobyte-291193cb-fc17-48ec-a664-5527d425cbcf" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:03 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-9a6b5e31-ea9f-4eab-a3b5-6de54b455b1a tempest-ProjectMemberTests-1145856324 None] Deleting offline snapshot 291193cb-fc17-48ec-a664-5527d425cbcf of volume 0f62deeb-1217-4416-854e-b6e5d09b3b63 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:09:03 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-9a6b5e31-ea9f-4eab-a3b5-6de54b455b1a tempest-ProjectMemberTests-1145856324 None] snapshot_file for this snap is: volume-0f62deeb-1217-4416-854e-b6e5d09b3b63.291193cb-fc17-48ec-a664-5527d425cbcf {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:09:03 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[2584ce2a-495b-4e7d-ade5-b0694e9cc94a]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9a6b5e31-ea9f-4eab-a3b5-6de54b455b1a tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0f62deeb-1217-4416-854e-b6e5d09b3b63.291193cb-fc17-48ec-a664-5527d425cbcf {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:04 devstack sudo[108306]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a640c50a-9363-469b-aa29-5a1d04ec9d80 tempest-CreateVolumesFromSnapshotTest-654342443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0b76376e-a0ba-4544-82be-5be351ea5d1a" returned: 0 in 0.310s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:04 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-a640c50a-9363-469b-aa29-5a1d04ec9d80 tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "cinder-quobyte-0b76376e-a0ba-4544-82be-5be351ea5d1a" released by "delete_volume" :: held 0.745s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:04 devstack sudo[108311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0f62deeb-1217-4416-854e-b6e5d09b3b63.291193cb-fc17-48ec-a664-5527d425cbcf Jul 30 17:09:04 devstack sudo[108311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:04 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-a640c50a-9363-469b-aa29-5a1d04ec9d80 tempest-CreateVolumesFromSnapshotTest-654342443 None] Created reservations ['c498bed2-11e2-4788-8200-154d26aa1cbd', '4d4afa9a-ac31-4ca3-bd37-cd9d3a35855d', '2dbc737b-9f84-48ce-b8df-569b52fee784', '9ae868d9-ea0b-466f-80e8-05a84f7fc81d'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:09:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a640c50a-9363-469b-aa29-5a1d04ec9d80 tempest-CreateVolumesFromSnapshotTest-654342443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a640c50a-9363-469b-aa29-5a1d04ec9d80 tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:04 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a640c50a-9363-469b-aa29-5a1d04ec9d80 tempest-CreateVolumesFromSnapshotTest-654342443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:04 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a640c50a-9363-469b-aa29-5a1d04ec9d80 tempest-CreateVolumesFromSnapshotTest-654342443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a640c50a-9363-469b-aa29-5a1d04ec9d80 tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a640c50a-9363-469b-aa29-5a1d04ec9d80 tempest-CreateVolumesFromSnapshotTest-654342443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:04 devstack sudo[108317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:09:04 devstack sudo[108317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:04 devstack sudo[108308]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286 1073741824" returned: 0 in 0.526s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:04 devstack sudo[108321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286 Jul 30 17:09:04 devstack sudo[108321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:04 devstack sudo[108311]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9a6b5e31-ea9f-4eab-a3b5-6de54b455b1a tempest-ProjectMemberTests-1145856324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0f62deeb-1217-4416-854e-b6e5d09b3b63.291193cb-fc17-48ec-a664-5527d425cbcf" returned: 0 in 0.421s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:04 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-9a6b5e31-ea9f-4eab-a3b5-6de54b455b1a tempest-ProjectMemberTests-1145856324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f62deeb-1217-4416-854e-b6e5d09b3b63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:09:04 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-a6fce4bc-23c4-4185-a936-4d20f1b019a4 tempest-CreateVolumesFromSnapshotTest-654342443 None] Acquiring lock "cinder-e87ab456-a239-46b6-903d-d6444e69524d-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:04 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dac2d77-4433-405a-bf94-66e32478d47c]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9a6b5e31-ea9f-4eab-a3b5-6de54b455b1a tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0f62deeb-1217-4416-854e-b6e5d09b3b63 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:04 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-a6fce4bc-23c4-4185-a936-4d20f1b019a4 tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "cinder-e87ab456-a239-46b6-903d-d6444e69524d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:04 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-a6fce4bc-23c4-4185-a936-4d20f1b019a4 tempest-CreateVolumesFromSnapshotTest-654342443 None] Acquiring lock "cinder-quobyte-e87ab456-a239-46b6-903d-d6444e69524d" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:04 devstack sudo[108317]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a640c50a-9363-469b-aa29-5a1d04ec9d80 tempest-CreateVolumesFromSnapshotTest-654342443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.324s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:04 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-a640c50a-9363-469b-aa29-5a1d04ec9d80 tempest-CreateVolumesFromSnapshotTest-654342443 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:09:04 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-a640c50a-9363-469b-aa29-5a1d04ec9d80 tempest-CreateVolumesFromSnapshotTest-654342443 None] Deleted volume successfully. Jul 30 17:09:04 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-a6fce4bc-23c4-4185-a936-4d20f1b019a4 tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "cinder-quobyte-e87ab456-a239-46b6-903d-d6444e69524d" acquired by "delete_volume" :: waited 0.034s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:04 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0139da4-e444-4fdc-97e8-8a12fe308414]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a6fce4bc-23c4-4185-a936-4d20f1b019a4 tempest-CreateVolumesFromSnapshotTest-654342443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e87ab456-a239-46b6-903d-d6444e69524d {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:04 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-a640c50a-9363-469b-aa29-5a1d04ec9d80 tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "cinder-0b76376e-a0ba-4544-82be-5be351ea5d1a-delete_volume" released by "delete_volume" :: held 1.351s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:04 devstack sudo[108325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0f62deeb-1217-4416-854e-b6e5d09b3b63 Jul 30 17:09:04 devstack sudo[108325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:04 devstack sudo[108321]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286" returned: 0 in 0.378s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:04 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:09:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:04 devstack cinder-volume[88591]: DEBUG cinder.volume.volume_utils [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] Attempting download of b87552f3-3bd4-47cd-b111-44a103b6df79 ((None, [{'url': 'file:///opt/stack/data/glance/images/b87552f3-3bd4-47cd-b111-44a103b6df79', 'metadata': {}}])) to volume a9f56c8b-0fb4-4f83-8b50-a220707eb286. {{(pid=88591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 30 17:09:04 devstack sudo[108326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e87ab456-a239-46b6-903d-d6444e69524d Jul 30 17:09:04 devstack sudo[108326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:04 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cab79b2-6bcc-4417-97bb-eff633dd695f]: (4, 'raw') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b87552f3-3bd4-47cd-b111-44a103b6df79_9ce8b__2 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:04 devstack sudo[108325]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9a6b5e31-ea9f-4eab-a3b5-6de54b455b1a tempest-ProjectMemberTests-1145856324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0f62deeb-1217-4416-854e-b6e5d09b3b63" returned: 0 in 0.505s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9a6b5e31-ea9f-4eab-a3b5-6de54b455b1a tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0f62deeb-1217-4416-854e-b6e5d09b3b63.291193cb-fc17-48ec-a664-5527d425cbcf {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:04 devstack sudo[108330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b87552f3-3bd4-47cd-b111-44a103b6df79_9ce8b__2 Jul 30 17:09:04 devstack sudo[108330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3546a9fa-4218-4c85-ba6a-dd4df97e04bc tempest-VolumeDependencyTests-500709084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3546a9fa-4218-4c85-ba6a-dd4df97e04bc tempest-VolumeDependencyTests-500709084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:04 devstack sudo[108335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0f62deeb-1217-4416-854e-b6e5d09b3b63.291193cb-fc17-48ec-a664-5527d425cbcf Jul 30 17:09:04 devstack sudo[108335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:04 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-3546a9fa-4218-4c85-ba6a-dd4df97e04bc tempest-VolumeDependencyTests-500709084 None] Creating offline snapshot efd1ebbe-c12b-472e-ad37-525ad9769a16 of volume 2d48bfa2-dfb0-4990-a275-d31b3723c2a2 {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:09:05 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[d068b8c9-e7f1-44a7-9995-6f4d488be154]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3546a9fa-4218-4c85-ba6a-dd4df97e04bc tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:05 devstack sudo[108326]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a6fce4bc-23c4-4185-a936-4d20f1b019a4 tempest-CreateVolumesFromSnapshotTest-654342443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e87ab456-a239-46b6-903d-d6444e69524d" returned: 0 in 0.519s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a6fce4bc-23c4-4185-a936-4d20f1b019a4 tempest-CreateVolumesFromSnapshotTest-654342443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e87ab456-a239-46b6-903d-d6444e69524d {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:05 devstack sudo[108341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e87ab456-a239-46b6-903d-d6444e69524d Jul 30 17:09:05 devstack sudo[108341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:05 devstack sudo[108339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2 Jul 30 17:09:05 devstack sudo[108339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:05 devstack sudo[108330]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b87552f3-3bd4-47cd-b111-44a103b6df79_9ce8b__2" returned: 0 in 0.408s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b87552f3-3bd4-47cd-b111-44a103b6df79_9ce8b__2 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:05 devstack sudo[108348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b87552f3-3bd4-47cd-b111-44a103b6df79_9ce8b__2 Jul 30 17:09:05 devstack sudo[108348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:05 devstack sudo[108335]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9a6b5e31-ea9f-4eab-a3b5-6de54b455b1a tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0f62deeb-1217-4416-854e-b6e5d09b3b63.291193cb-fc17-48ec-a664-5527d425cbcf" returned: 0 in 0.430s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9a6b5e31-ea9f-4eab-a3b5-6de54b455b1a tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0f62deeb-1217-4416-854e-b6e5d09b3b63.291193cb-fc17-48ec-a664-5527d425cbcf {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:05 devstack sudo[108354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0f62deeb-1217-4416-854e-b6e5d09b3b63.291193cb-fc17-48ec-a664-5527d425cbcf Jul 30 17:09:05 devstack sudo[108354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:05 devstack sudo[108341]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a6fce4bc-23c4-4185-a936-4d20f1b019a4 tempest-CreateVolumesFromSnapshotTest-654342443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e87ab456-a239-46b6-903d-d6444e69524d" returned: 0 in 0.326s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:05 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-a6fce4bc-23c4-4185-a936-4d20f1b019a4 tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "cinder-quobyte-e87ab456-a239-46b6-903d-d6444e69524d" released by "delete_volume" :: held 0.893s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:05 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-a6fce4bc-23c4-4185-a936-4d20f1b019a4 tempest-CreateVolumesFromSnapshotTest-654342443 None] Created reservations ['408dc5cd-c71f-49c4-b46b-b69ee647b0b6', '08df2971-5c54-4ea1-8445-cbbcad265c5d', 'd765543d-2db8-4196-ba01-9048c56c24d1', '5f54e277-1194-423b-b130-b054f26f8135'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:09:05 devstack sudo[108339]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3546a9fa-4218-4c85-ba6a-dd4df97e04bc tempest-VolumeDependencyTests-500709084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2" returned: 0 in 0.513s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3546a9fa-4218-4c85-ba6a-dd4df97e04bc tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2.efd1ebbe-c12b-472e-ad37-525ad9769a16 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:05 devstack sudo[108358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2.efd1ebbe-c12b-472e-ad37-525ad9769a16 1G Jul 30 17:09:05 devstack sudo[108358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a6fce4bc-23c4-4185-a936-4d20f1b019a4 tempest-CreateVolumesFromSnapshotTest-654342443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a6fce4bc-23c4-4185-a936-4d20f1b019a4 tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:05 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a6fce4bc-23c4-4185-a936-4d20f1b019a4 tempest-CreateVolumesFromSnapshotTest-654342443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:05 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a6fce4bc-23c4-4185-a936-4d20f1b019a4 tempest-CreateVolumesFromSnapshotTest-654342443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a6fce4bc-23c4-4185-a936-4d20f1b019a4 tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a6fce4bc-23c4-4185-a936-4d20f1b019a4 tempest-CreateVolumesFromSnapshotTest-654342443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:05 devstack sudo[108348]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b87552f3-3bd4-47cd-b111-44a103b6df79_9ce8b__2" returned: 1 in 0.432s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b87552f3-3bd4-47cd-b111-44a103b6df79_9ce8b__2' failed. Not Retrying. {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 17:09:05 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[edebbde5-814c-4f5b-bbf0-b010337f980f]: (4, 'raw') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b87552f3-3bd4-47cd-b111-44a103b6df79_1gcabu42devstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:05 devstack sudo[108362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:09:05 devstack sudo[108362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:05 devstack sudo[108354]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9a6b5e31-ea9f-4eab-a3b5-6de54b455b1a tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0f62deeb-1217-4416-854e-b6e5d09b3b63.291193cb-fc17-48ec-a664-5527d425cbcf" returned: 0 in 0.366s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:05 devstack sudo[108364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b87552f3-3bd4-47cd-b111-44a103b6df79_1gcabu42devstack@QuobyteHD Jul 30 17:09:05 devstack sudo[108364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:05 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9a6b5e31-ea9f-4eab-a3b5-6de54b455b1a tempest-ProjectMemberTests-1145856324 None] Lock "cinder-quobyte-291193cb-fc17-48ec-a664-5527d425cbcf" released by "_delete_snapshot" :: held 1.882s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:05 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9a6b5e31-ea9f-4eab-a3b5-6de54b455b1a tempest-ProjectMemberTests-1145856324 None] Lock "cinder-quobyte-0f62deeb-1217-4416-854e-b6e5d09b3b63" released by "delete_snapshot" :: held 1.918s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:05 devstack sudo[108362]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a6fce4bc-23c4-4185-a936-4d20f1b019a4 tempest-CreateVolumesFromSnapshotTest-654342443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.271s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:05 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-a6fce4bc-23c4-4185-a936-4d20f1b019a4 tempest-CreateVolumesFromSnapshotTest-654342443 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:09:05 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-a6fce4bc-23c4-4185-a936-4d20f1b019a4 tempest-CreateVolumesFromSnapshotTest-654342443 None] Deleted volume successfully. Jul 30 17:09:05 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-9a6b5e31-ea9f-4eab-a3b5-6de54b455b1a tempest-ProjectMemberTests-1145856324 None] Created reservations ['a77411b4-112f-4b36-a73f-8eded076bbe7', 'dc7c574b-0b25-43f4-bb2f-141eff5a2c8a', '4b06c011-04b8-44d3-ae38-214245475e8e', '8ca03ffb-07df-4998-af7a-89e5e1d8e6fb'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:09:05 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-a6fce4bc-23c4-4185-a936-4d20f1b019a4 tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "cinder-e87ab456-a239-46b6-903d-d6444e69524d-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:05 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-9a6b5e31-ea9f-4eab-a3b5-6de54b455b1a tempest-ProjectMemberTests-1145856324 None] Delete snapshot completed successfully. Jul 30 17:09:06 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9a6b5e31-ea9f-4eab-a3b5-6de54b455b1a tempest-ProjectMemberTests-1145856324 None] Lock "cinder-291193cb-fc17-48ec-a664-5527d425cbcf-delete_snapshot" released by "delete_snapshot" :: held 2.120s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:06 devstack sudo[108364]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b87552f3-3bd4-47cd-b111-44a103b6df79_1gcabu42devstack@QuobyteHD" returned: 0 in 0.409s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b87552f3-3bd4-47cd-b111-44a103b6df79_1gcabu42devstack@QuobyteHD {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:06 devstack sudo[108358]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3546a9fa-4218-4c85-ba6a-dd4df97e04bc tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2.efd1ebbe-c12b-472e-ad37-525ad9769a16 1G" returned: 0 in 0.546s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3546a9fa-4218-4c85-ba6a-dd4df97e04bc tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2.efd1ebbe-c12b-472e-ad37-525ad9769a16 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:06 devstack sudo[108375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2.efd1ebbe-c12b-472e-ad37-525ad9769a16 Jul 30 17:09:06 devstack sudo[108375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:06 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7963e65d-d866-4e0e-bed6-b9ac5a03eea2 tempest-ProjectMemberTests-1145856324 None] Acquiring lock "cinder-0f62deeb-1217-4416-854e-b6e5d09b3b63-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:06 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7963e65d-d866-4e0e-bed6-b9ac5a03eea2 tempest-ProjectMemberTests-1145856324 None] Lock "cinder-0f62deeb-1217-4416-854e-b6e5d09b3b63-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:06 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7963e65d-d866-4e0e-bed6-b9ac5a03eea2 tempest-ProjectMemberTests-1145856324 None] Acquiring lock "cinder-quobyte-0f62deeb-1217-4416-854e-b6e5d09b3b63" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:06 devstack sudo[108374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b87552f3-3bd4-47cd-b111-44a103b6df79_1gcabu42devstack@QuobyteHD Jul 30 17:09:06 devstack sudo[108374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:06 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7963e65d-d866-4e0e-bed6-b9ac5a03eea2 tempest-ProjectMemberTests-1145856324 None] Lock "cinder-quobyte-0f62deeb-1217-4416-854e-b6e5d09b3b63" acquired by "delete_volume" :: waited 0.025s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:06 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25c223c-3775-46b6-9433-5563111ecc86]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7963e65d-d866-4e0e-bed6-b9ac5a03eea2 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0f62deeb-1217-4416-854e-b6e5d09b3b63 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:06 devstack sudo[108378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0f62deeb-1217-4416-854e-b6e5d09b3b63 Jul 30 17:09:06 devstack sudo[108378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:06 devstack sudo[108375]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3546a9fa-4218-4c85-ba6a-dd4df97e04bc tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2.efd1ebbe-c12b-472e-ad37-525ad9769a16" returned: 0 in 0.310s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:06 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-3546a9fa-4218-4c85-ba6a-dd4df97e04bc tempest-VolumeDependencyTests-500709084 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2.efd1ebbe-c12b-472e-ad37-525ad9769a16 is being set with open permissions: ugo+rw Jul 30 17:09:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3546a9fa-4218-4c85-ba6a-dd4df97e04bc tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2.efd1ebbe-c12b-472e-ad37-525ad9769a16 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:06 devstack sudo[108383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2.efd1ebbe-c12b-472e-ad37-525ad9769a16 Jul 30 17:09:06 devstack sudo[108383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:06 devstack sudo[108374]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b87552f3-3bd4-47cd-b111-44a103b6df79_1gcabu42devstack@QuobyteHD" returned: 1 in 0.399s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b87552f3-3bd4-47cd-b111-44a103b6df79_1gcabu42devstack@QuobyteHD' failed. Not Retrying. {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 17:09:06 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] b87552f3-3bd4-47cd-b111-44a103b6df79 was raw, converting to qcow2 {{(pid=88591) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 30 17:09:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b87552f3-3bd4-47cd-b111-44a103b6df79_1gcabu42devstack@QuobyteHD /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:06 devstack sudo[108388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b87552f3-3bd4-47cd-b111-44a103b6df79_1gcabu42devstack@QuobyteHD /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286 Jul 30 17:09:06 devstack sudo[108388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:06 devstack sudo[108383]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:06 devstack sudo[108378]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7963e65d-d866-4e0e-bed6-b9ac5a03eea2 tempest-ProjectMemberTests-1145856324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0f62deeb-1217-4416-854e-b6e5d09b3b63" returned: 0 in 0.390s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7963e65d-d866-4e0e-bed6-b9ac5a03eea2 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0f62deeb-1217-4416-854e-b6e5d09b3b63 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3546a9fa-4218-4c85-ba6a-dd4df97e04bc tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2.efd1ebbe-c12b-472e-ad37-525ad9769a16" returned: 0 in 0.283s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:06 devstack sudo[108394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0f62deeb-1217-4416-854e-b6e5d09b3b63 Jul 30 17:09:06 devstack sudo[108394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:06 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d7c4107c-2769-4d7a-9c50-9c72abe89f29 tempest-CreateVolumesFromSnapshotTest-654342443 None] Acquiring lock "cinder-a922d055-fe97-4fb4-bd07-68eb44335268-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:06 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d7c4107c-2769-4d7a-9c50-9c72abe89f29 tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "cinder-a922d055-fe97-4fb4-bd07-68eb44335268-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3546a9fa-4218-4c85-ba6a-dd4df97e04bc tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:06 devstack sudo[108399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2.info Jul 30 17:09:06 devstack sudo[108399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:06 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d7c4107c-2769-4d7a-9c50-9c72abe89f29 tempest-CreateVolumesFromSnapshotTest-654342443 None] Acquiring lock "cinder-quobyte-a922d055-fe97-4fb4-bd07-68eb44335268" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:06 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d7c4107c-2769-4d7a-9c50-9c72abe89f29 tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "cinder-quobyte-a922d055-fe97-4fb4-bd07-68eb44335268" acquired by "delete_volume" :: waited 0.020s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:06 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac41ea3a-7f61-4a9e-a3b5-2a86ae037d3d]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d7c4107c-2769-4d7a-9c50-9c72abe89f29 tempest-CreateVolumesFromSnapshotTest-654342443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a922d055-fe97-4fb4-bd07-68eb44335268 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:07 devstack sudo[108401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a922d055-fe97-4fb4-bd07-68eb44335268 Jul 30 17:09:07 devstack sudo[108401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:07 devstack sudo[108388]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b87552f3-3bd4-47cd-b111-44a103b6df79_1gcabu42devstack@QuobyteHD /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286" returned: 0 in 0.554s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:07 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b87552f3-3bd4-47cd-b111-44a103b6df79_1gcabu42devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286 {{(pid=88591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 17:09:07 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] Converted 0.00 MB image at 0.00 MB/s Jul 30 17:09:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:07 devstack sudo[108394]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7963e65d-d866-4e0e-bed6-b9ac5a03eea2 tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0f62deeb-1217-4416-854e-b6e5d09b3b63" returned: 0 in 0.390s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:07 devstack sudo[108399]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:07 devstack sudo[108405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286 1G Jul 30 17:09:07 devstack sudo[108405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3546a9fa-4218-4c85-ba6a-dd4df97e04bc tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2.info" returned: 0 in 0.321s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:07 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-3546a9fa-4218-4c85-ba6a-dd4df97e04bc tempest-VolumeDependencyTests-500709084 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2.info is being set with open permissions: ugo+rw Jul 30 17:09:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3546a9fa-4218-4c85-ba6a-dd4df97e04bc tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:07 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7963e65d-d866-4e0e-bed6-b9ac5a03eea2 tempest-ProjectMemberTests-1145856324 None] Lock "cinder-quobyte-0f62deeb-1217-4416-854e-b6e5d09b3b63" released by "delete_volume" :: held 0.854s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:07 devstack sudo[108407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2.info Jul 30 17:09:07 devstack sudo[108407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:07 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-7963e65d-d866-4e0e-bed6-b9ac5a03eea2 tempest-ProjectMemberTests-1145856324 None] Created reservations ['b9f86162-2d38-4f73-9057-b1d666f4aa7d', '390b6759-000a-419d-a7c9-a8ba87d948e4', '93a6ce55-02ce-4008-b126-1e68ac26bed7', 'd13a49b5-c83f-4718-9a97-a99c019e9552'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:09:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7963e65d-d866-4e0e-bed6-b9ac5a03eea2 tempest-ProjectMemberTests-1145856324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7963e65d-d866-4e0e-bed6-b9ac5a03eea2 tempest-ProjectMemberTests-1145856324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:07 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7963e65d-d866-4e0e-bed6-b9ac5a03eea2 tempest-ProjectMemberTests-1145856324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:07 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7963e65d-d866-4e0e-bed6-b9ac5a03eea2 tempest-ProjectMemberTests-1145856324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7963e65d-d866-4e0e-bed6-b9ac5a03eea2 tempest-ProjectMemberTests-1145856324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7963e65d-d866-4e0e-bed6-b9ac5a03eea2 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:07 devstack sudo[108411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:09:07 devstack sudo[108411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:07 devstack sudo[108401]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d7c4107c-2769-4d7a-9c50-9c72abe89f29 tempest-CreateVolumesFromSnapshotTest-654342443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a922d055-fe97-4fb4-bd07-68eb44335268" returned: 0 in 0.481s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d7c4107c-2769-4d7a-9c50-9c72abe89f29 tempest-CreateVolumesFromSnapshotTest-654342443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a922d055-fe97-4fb4-bd07-68eb44335268 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:07 devstack sudo[108419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a922d055-fe97-4fb4-bd07-68eb44335268 Jul 30 17:09:07 devstack sudo[108419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:07 devstack sudo[108407]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3546a9fa-4218-4c85-ba6a-dd4df97e04bc tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2.info" returned: 0 in 0.328s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3546a9fa-4218-4c85-ba6a-dd4df97e04bc tempest-VolumeDependencyTests-500709084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.464s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:07 devstack sudo[108405]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286 1G" returned: 0 in 0.428s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:07 devstack cinder-volume[88591]: DEBUG cinder.volume.volume_utils [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] Downloaded image b87552f3-3bd4-47cd-b111-44a103b6df79 ((None, [{'url': 'file:///opt/stack/data/glance/images/b87552f3-3bd4-47cd-b111-44a103b6df79', 'metadata': {}}])) to volume a9f56c8b-0fb4-4f83-8b50-a220707eb286 successfully. {{(pid=88591) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 30 17:09:07 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] Temporary image b87552f3-3bd4-47cd-b111-44a103b6df79 for user e4eedb818424482c9370625aced56a0a is deleted. {{(pid=88591) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 30 17:09:07 devstack cinder-volume[88591]: DEBUG cinder.volume.volume_utils [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] Marking volume a9f56c8b-0fb4-4f83-8b50-a220707eb286 as bootable. {{(pid=88591) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 30 17:09:07 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] Copying metadata from image b87552f3-3bd4-47cd-b111-44a103b6df79 to a9f56c8b-0fb4-4f83-8b50-a220707eb286. {{(pid=88591) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 30 17:09:07 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] Creating volume glance metadata for volume a9f56c8b-0fb4-4f83-8b50-a220707eb286 backed by image b87552f3-3bd4-47cd-b111-44a103b6df79 with: {'image_id': 'b87552f3-3bd4-47cd-b111-44a103b6df79', 'image_name': 'image-for-test-e6050452-06bd-4c7f-9912-45178c83e379', 'checksum': 'd6061311f2f04ea2e11561b532ea048f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88591) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 30 17:09:07 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-3546a9fa-4218-4c85-ba6a-dd4df97e04bc tempest-VolumeDependencyTests-500709084 None] Create snapshot completed successfully Jul 30 17:09:07 devstack sudo[108411]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7963e65d-d866-4e0e-bed6-b9ac5a03eea2 tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.310s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:07 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-7963e65d-d866-4e0e-bed6-b9ac5a03eea2 tempest-ProjectMemberTests-1145856324 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:09:07 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-7963e65d-d866-4e0e-bed6-b9ac5a03eea2 tempest-ProjectMemberTests-1145856324 None] Deleted volume successfully. Jul 30 17:09:07 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8820f25-7b9a-431d-b923-f66501635b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286', 'volume_size': 1, 'image_id': 'b87552f3-3bd4-47cd-b111-44a103b6df79', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b87552f3-3bd4-47cd-b111-44a103b6df79', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-e6050452-06bd-4c7f-9912-45178c83e379', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd6061311f2f04ea2e11561b532ea048f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '58f61df38a914ec2a6713104b0278991', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '56289bc2e9b05a69da51476ee5e3cf2c3d63386f9b0c5ab83f510340eaa4c5df960385a5e948bea4474998eb23f1fa9ea7e4ce1c3120b1b5b1bbe58b4abae8c7', 'id': 'b87552f3-3bd4-47cd-b111-44a103b6df79', 'created_at': datetime.datetime(2026, 7, 30, 15, 8, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 15, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b87552f3-3bd4-47cd-b111-44a103b6df79/file', 'properties': {}}, 'image_service': }' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:07 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (114f8c6d-b9d1-4dfc-a9e9-cc8f98c0c78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:07 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7963e65d-d866-4e0e-bed6-b9ac5a03eea2 tempest-ProjectMemberTests-1145856324 None] Lock "cinder-0f62deeb-1217-4416-854e-b6e5d09b3b63-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:07 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] Volume volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286 (a9f56c8b-0fb4-4f83-8b50-a220707eb286): created successfully Jul 30 17:09:07 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (114f8c6d-b9d1-4dfc-a9e9-cc8f98c0c78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:07 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] Flow 'volume_create_manager' (0577346f-fa08-4781-b98d-59c30ca514d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:09:07 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-7ad0d963-d2ca-462e-8902-0534748fe590 tempest-VolumeImageDependencyTests-1529416407 None] Created volume successfully. Jul 30 17:09:07 devstack sudo[108419]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d7c4107c-2769-4d7a-9c50-9c72abe89f29 tempest-CreateVolumesFromSnapshotTest-654342443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a922d055-fe97-4fb4-bd07-68eb44335268" returned: 0 in 0.332s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:07 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d7c4107c-2769-4d7a-9c50-9c72abe89f29 tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "cinder-quobyte-a922d055-fe97-4fb4-bd07-68eb44335268" released by "delete_volume" :: held 0.859s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:07 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-d7c4107c-2769-4d7a-9c50-9c72abe89f29 tempest-CreateVolumesFromSnapshotTest-654342443 None] Created reservations ['3683e72a-1392-461a-af7b-a28e5c700c10', '3c17330b-0d76-4f3e-bd58-a442dd4437c3', '10b33897-cb5a-493e-8d0a-06cf5e7c99aa', '89c60441-4146-40b1-b14c-00117ce63440'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:09:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d7c4107c-2769-4d7a-9c50-9c72abe89f29 tempest-CreateVolumesFromSnapshotTest-654342443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d7c4107c-2769-4d7a-9c50-9c72abe89f29 tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:07 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d7c4107c-2769-4d7a-9c50-9c72abe89f29 tempest-CreateVolumesFromSnapshotTest-654342443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:07 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d7c4107c-2769-4d7a-9c50-9c72abe89f29 tempest-CreateVolumesFromSnapshotTest-654342443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d7c4107c-2769-4d7a-9c50-9c72abe89f29 tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d7c4107c-2769-4d7a-9c50-9c72abe89f29 tempest-CreateVolumesFromSnapshotTest-654342443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:07 devstack sudo[108423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:09:07 devstack sudo[108423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:07 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-def5ca2b-bb0e-48a6-904c-f99332e649b1 tempest-CreateVolumesFromSnapshotTest-654342443 None] Acquiring lock "cinder-ac10703d-00b1-4781-aa19-c75548df31e1-delete_snapshot" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:07 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-def5ca2b-bb0e-48a6-904c-f99332e649b1 tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "cinder-ac10703d-00b1-4781-aa19-c75548df31e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:07 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-def5ca2b-bb0e-48a6-904c-f99332e649b1 tempest-CreateVolumesFromSnapshotTest-654342443 None] Acquiring lock "cinder-quobyte-e51f29ae-daaf-422b-ae26-a1ec598be3fe" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:07 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-80a03d06-3ed7-4176-8827-ca54127e1f3d tempest-ProjectMemberTests-1145856324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:09:07 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-80a03d06-3ed7-4176-8827-ca54127e1f3d tempest-ProjectMemberTests-1145856324 None] Flow 'volume_create_manager' (11201305-7406-4a52-afd9-5db4109e919d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:09:07 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-80a03d06-3ed7-4176-8827-ca54127e1f3d tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b683426f-afa7-420d-997f-2700a7d3c0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:07 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-def5ca2b-bb0e-48a6-904c-f99332e649b1 tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "cinder-quobyte-e51f29ae-daaf-422b-ae26-a1ec598be3fe" acquired by "delete_snapshot" :: waited 0.058s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:07 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-def5ca2b-bb0e-48a6-904c-f99332e649b1 tempest-CreateVolumesFromSnapshotTest-654342443 None] Acquiring lock "cinder-quobyte-ac10703d-00b1-4781-aa19-c75548df31e1" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:08 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-80a03d06-3ed7-4176-8827-ca54127e1f3d tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b683426f-afa7-420d-997f-2700a7d3c0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1734317361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e128991-f914-4ce1-afcd-ee5c94acc301,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26c22addd8364bc982bc8002f431ee32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:09:08Z,use_quota=True,user_id='c9da4889b5dd47d3bb88b442a104a944',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:08 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-80a03d06-3ed7-4176-8827-ca54127e1f3d tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12e23148-4bba-41b7-9263-aadfea019748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:08 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-80a03d06-3ed7-4176-8827-ca54127e1f3d tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12e23148-4bba-41b7-9263-aadfea019748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:08 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-80a03d06-3ed7-4176-8827-ca54127e1f3d tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (638d462c-27f8-4f77-a7d6-54ae244b7686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:08 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-80a03d06-3ed7-4176-8827-ca54127e1f3d tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (638d462c-27f8-4f77-a7d6-54ae244b7686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e128991-f914-4ce1-afcd-ee5c94acc301', 'volume_name': 'volume-0e128991-f914-4ce1-afcd-ee5c94acc301', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:08 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-80a03d06-3ed7-4176-8827-ca54127e1f3d tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4ab552b-96ae-4810-be8c-5af9992864de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:08 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-80a03d06-3ed7-4176-8827-ca54127e1f3d tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4ab552b-96ae-4810-be8c-5af9992864de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:08 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-80a03d06-3ed7-4176-8827-ca54127e1f3d tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d10adc4a-e927-4595-b469-f5e5a789f999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:08 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-80a03d06-3ed7-4176-8827-ca54127e1f3d tempest-ProjectMemberTests-1145856324 None] Volume 0e128991-f914-4ce1-afcd-ee5c94acc301: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e128991-f914-4ce1-afcd-ee5c94acc301', 'volume_size': 1} Jul 30 17:09:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-80a03d06-3ed7-4176-8827-ca54127e1f3d tempest-ProjectMemberTests-1145856324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-80a03d06-3ed7-4176-8827-ca54127e1f3d tempest-ProjectMemberTests-1145856324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:08 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-80a03d06-3ed7-4176-8827-ca54127e1f3d tempest-ProjectMemberTests-1145856324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1734317361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e128991-f914-4ce1-afcd-ee5c94acc301,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26c22addd8364bc982bc8002f431ee32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:09:08Z,use_quota=True,user_id='c9da4889b5dd47d3bb88b442a104a944',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:09:08 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-80a03d06-3ed7-4176-8827-ca54127e1f3d tempest-ProjectMemberTests-1145856324 None] Creating volume 0e128991-f914-4ce1-afcd-ee5c94acc301 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:09:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-80a03d06-3ed7-4176-8827-ca54127e1f3d tempest-ProjectMemberTests-1145856324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-80a03d06-3ed7-4176-8827-ca54127e1f3d tempest-ProjectMemberTests-1145856324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:08 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-80a03d06-3ed7-4176-8827-ca54127e1f3d tempest-ProjectMemberTests-1145856324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:08 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-80a03d06-3ed7-4176-8827-ca54127e1f3d tempest-ProjectMemberTests-1145856324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-80a03d06-3ed7-4176-8827-ca54127e1f3d tempest-ProjectMemberTests-1145856324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:08 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-80a03d06-3ed7-4176-8827-ca54127e1f3d tempest-ProjectMemberTests-1145856324 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:09:08 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-80a03d06-3ed7-4176-8827-ca54127e1f3d tempest-ProjectMemberTests-1145856324 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:09:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-80a03d06-3ed7-4176-8827-ca54127e1f3d tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e128991-f914-4ce1-afcd-ee5c94acc301 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:08 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-def5ca2b-bb0e-48a6-904c-f99332e649b1 tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "cinder-quobyte-ac10703d-00b1-4781-aa19-c75548df31e1" acquired by "_delete_snapshot" :: waited 0.105s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:08 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-def5ca2b-bb0e-48a6-904c-f99332e649b1 tempest-CreateVolumesFromSnapshotTest-654342443 None] Deleting offline snapshot ac10703d-00b1-4781-aa19-c75548df31e1 of volume e51f29ae-daaf-422b-ae26-a1ec598be3fe {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:09:08 devstack sudo[108425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e128991-f914-4ce1-afcd-ee5c94acc301 1073741824 Jul 30 17:09:08 devstack sudo[108425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:08 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-def5ca2b-bb0e-48a6-904c-f99332e649b1 tempest-CreateVolumesFromSnapshotTest-654342443 None] snapshot_file for this snap is: volume-e51f29ae-daaf-422b-ae26-a1ec598be3fe.ac10703d-00b1-4781-aa19-c75548df31e1 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:09:08 devstack sudo[108423]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d7c4107c-2769-4d7a-9c50-9c72abe89f29 tempest-CreateVolumesFromSnapshotTest-654342443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.324s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:08 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-d7c4107c-2769-4d7a-9c50-9c72abe89f29 tempest-CreateVolumesFromSnapshotTest-654342443 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:09:08 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c21004-d164-40ab-a21d-acf346379d0e]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-def5ca2b-bb0e-48a6-904c-f99332e649b1 tempest-CreateVolumesFromSnapshotTest-654342443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e51f29ae-daaf-422b-ae26-a1ec598be3fe.ac10703d-00b1-4781-aa19-c75548df31e1 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:08 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-d7c4107c-2769-4d7a-9c50-9c72abe89f29 tempest-CreateVolumesFromSnapshotTest-654342443 None] Deleted volume successfully. Jul 30 17:09:08 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d7c4107c-2769-4d7a-9c50-9c72abe89f29 tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "cinder-a922d055-fe97-4fb4-bd07-68eb44335268-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:08 devstack sudo[108428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e51f29ae-daaf-422b-ae26-a1ec598be3fe.ac10703d-00b1-4781-aa19-c75548df31e1 Jul 30 17:09:08 devstack sudo[108428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-6a520143-e225-4f74-828f-df6f750989b3 tempest-VolumeImageDependencyTests-1529416407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:08 devstack sudo[108428]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-def5ca2b-bb0e-48a6-904c-f99332e649b1 tempest-CreateVolumesFromSnapshotTest-654342443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e51f29ae-daaf-422b-ae26-a1ec598be3fe.ac10703d-00b1-4781-aa19-c75548df31e1" returned: 0 in 0.481s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:08 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-def5ca2b-bb0e-48a6-904c-f99332e649b1 tempest-CreateVolumesFromSnapshotTest-654342443 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e51f29ae-daaf-422b-ae26-a1ec598be3fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:09:08 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[91fe0150-4f0e-479d-b11c-b4ea98177ee4]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-def5ca2b-bb0e-48a6-904c-f99332e649b1 tempest-CreateVolumesFromSnapshotTest-654342443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e51f29ae-daaf-422b-ae26-a1ec598be3fe {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:08 devstack sudo[108425]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-80a03d06-3ed7-4176-8827-ca54127e1f3d tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e128991-f914-4ce1-afcd-ee5c94acc301 1073741824" returned: 0 in 0.635s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:08 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdae5af5-e4b8-4dec-9e3a-c3d6c13b315f tempest-VolumeDependencyTests-500709084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:09:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-80a03d06-3ed7-4176-8827-ca54127e1f3d tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e128991-f914-4ce1-afcd-ee5c94acc301 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:08 devstack sudo[108439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e128991-f914-4ce1-afcd-ee5c94acc301 Jul 30 17:09:08 devstack sudo[108439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:08 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bdae5af5-e4b8-4dec-9e3a-c3d6c13b315f tempest-VolumeDependencyTests-500709084 None] Flow 'volume_create_manager' (4dc76816-5c4c-412f-94e9-86bcdbb5d07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:09:08 devstack sudo[108438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e51f29ae-daaf-422b-ae26-a1ec598be3fe Jul 30 17:09:08 devstack sudo[108438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:08 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bdae5af5-e4b8-4dec-9e3a-c3d6c13b315f tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70543b08-08f9-4edc-95c5-1ab01201a8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:08 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bdae5af5-e4b8-4dec-9e3a-c3d6c13b315f tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70543b08-08f9-4edc-95c5-1ab01201a8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-221849747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad9d489b-be22-4b8d-8480-c74bf5af8bff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75be733264504175956c041c2312fa52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=efd1ebbe-c12b-472e-ad37-525ad9769a16,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:09:09Z,use_quota=True,user_id='9ee0dab1317a4cfeafb4f6b50ca81a57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:08 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bdae5af5-e4b8-4dec-9e3a-c3d6c13b315f tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf3e41ad-dfbc-4ee8-a5cf-f794faf9d25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:08 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bdae5af5-e4b8-4dec-9e3a-c3d6c13b315f tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf3e41ad-dfbc-4ee8-a5cf-f794faf9d25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:08 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bdae5af5-e4b8-4dec-9e3a-c3d6c13b315f tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (785dfa66-9132-4343-b31b-2ef7529a5e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:08 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bdae5af5-e4b8-4dec-9e3a-c3d6c13b315f tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (785dfa66-9132-4343-b31b-2ef7529a5e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ad9d489b-be22-4b8d-8480-c74bf5af8bff', 'volume_name': 'volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff', 'volume_size': 1, 'snapshot_id': 'efd1ebbe-c12b-472e-ad37-525ad9769a16'}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:08 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bdae5af5-e4b8-4dec-9e3a-c3d6c13b315f tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0fceb85-1f00-4b4c-89d7-ad3bf7ac5162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:08 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bdae5af5-e4b8-4dec-9e3a-c3d6c13b315f tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0fceb85-1f00-4b4c-89d7-ad3bf7ac5162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:08 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bdae5af5-e4b8-4dec-9e3a-c3d6c13b315f tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9433b8a2-6bd6-488a-ba99-e831b60e267f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:08 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-bdae5af5-e4b8-4dec-9e3a-c3d6c13b315f tempest-VolumeDependencyTests-500709084 None] Volume ad9d489b-be22-4b8d-8480-c74bf5af8bff: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff', 'volume_size': 1, 'snapshot_id': 'efd1ebbe-c12b-472e-ad37-525ad9769a16'} Jul 30 17:09:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-bdae5af5-e4b8-4dec-9e3a-c3d6c13b315f tempest-VolumeDependencyTests-500709084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:09 devstack sudo[108439]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-80a03d06-3ed7-4176-8827-ca54127e1f3d tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e128991-f914-4ce1-afcd-ee5c94acc301" returned: 0 in 0.281s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:09 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-80a03d06-3ed7-4176-8827-ca54127e1f3d tempest-ProjectMemberTests-1145856324 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:09:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-80a03d06-3ed7-4176-8827-ca54127e1f3d tempest-ProjectMemberTests-1145856324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-6a520143-e225-4f74-828f-df6f750989b3 tempest-VolumeImageDependencyTests-1529416407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.643s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:09 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-80a03d06-3ed7-4176-8827-ca54127e1f3d tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d10adc4a-e927-4595-b469-f5e5a789f999) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e128991-f914-4ce1-afcd-ee5c94acc301', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:09 devstack sudo[108438]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:09 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-80a03d06-3ed7-4176-8827-ca54127e1f3d tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84233990-b11e-43ea-9de5-2918ad6daf77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:09 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-6a520143-e225-4f74-828f-df6f750989b3 tempest-VolumeImageDependencyTests-1529416407 None] Creating offline snapshot 55fbf6ca-597f-49fe-bb92-424af09ab2e1 of volume a9f56c8b-0fb4-4f83-8b50-a220707eb286 {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:09:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-def5ca2b-bb0e-48a6-904c-f99332e649b1 tempest-CreateVolumesFromSnapshotTest-654342443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e51f29ae-daaf-422b-ae26-a1ec598be3fe" returned: 0 in 0.395s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-def5ca2b-bb0e-48a6-904c-f99332e649b1 tempest-CreateVolumesFromSnapshotTest-654342443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e51f29ae-daaf-422b-ae26-a1ec598be3fe.ac10703d-00b1-4781-aa19-c75548df31e1 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:09 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5c3257-a0d1-4a45-9cc3-bc0a62c411ef]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6a520143-e225-4f74-828f-df6f750989b3 tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:09 devstack sudo[108446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e51f29ae-daaf-422b-ae26-a1ec598be3fe.ac10703d-00b1-4781-aa19-c75548df31e1 Jul 30 17:09:09 devstack sudo[108446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:09 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-80a03d06-3ed7-4176-8827-ca54127e1f3d tempest-ProjectMemberTests-1145856324 None] Volume volume-0e128991-f914-4ce1-afcd-ee5c94acc301 (0e128991-f914-4ce1-afcd-ee5c94acc301): created successfully Jul 30 17:09:09 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-80a03d06-3ed7-4176-8827-ca54127e1f3d tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84233990-b11e-43ea-9de5-2918ad6daf77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:09 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-80a03d06-3ed7-4176-8827-ca54127e1f3d tempest-ProjectMemberTests-1145856324 None] Flow 'volume_create_manager' (11201305-7406-4a52-afd9-5db4109e919d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:09:09 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-80a03d06-3ed7-4176-8827-ca54127e1f3d tempest-ProjectMemberTests-1145856324 None] Created volume successfully. Jul 30 17:09:09 devstack sudo[108447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286 Jul 30 17:09:09 devstack sudo[108447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:09 devstack sudo[108446]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-def5ca2b-bb0e-48a6-904c-f99332e649b1 tempest-CreateVolumesFromSnapshotTest-654342443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e51f29ae-daaf-422b-ae26-a1ec598be3fe.ac10703d-00b1-4781-aa19-c75548df31e1" returned: 0 in 0.359s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-def5ca2b-bb0e-48a6-904c-f99332e649b1 tempest-CreateVolumesFromSnapshotTest-654342443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e51f29ae-daaf-422b-ae26-a1ec598be3fe.ac10703d-00b1-4781-aa19-c75548df31e1 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:09 devstack sudo[108457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e51f29ae-daaf-422b-ae26-a1ec598be3fe.ac10703d-00b1-4781-aa19-c75548df31e1 Jul 30 17:09:09 devstack sudo[108457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:09 devstack sudo[108447]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6a520143-e225-4f74-828f-df6f750989b3 tempest-VolumeImageDependencyTests-1529416407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286" returned: 0 in 0.386s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6a520143-e225-4f74-828f-df6f750989b3 tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286.55fbf6ca-597f-49fe-bb92-424af09ab2e1 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:09 devstack sudo[108459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286.55fbf6ca-597f-49fe-bb92-424af09ab2e1 1G Jul 30 17:09:09 devstack sudo[108459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:09 devstack sudo[108457]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-def5ca2b-bb0e-48a6-904c-f99332e649b1 tempest-CreateVolumesFromSnapshotTest-654342443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e51f29ae-daaf-422b-ae26-a1ec598be3fe.ac10703d-00b1-4781-aa19-c75548df31e1" returned: 0 in 0.270s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:09 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:SELECT=216,cinder:UPDATE=262,cinder:INSERT=93,cinder:DELETE=21 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:09:09 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-def5ca2b-bb0e-48a6-904c-f99332e649b1 tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "cinder-quobyte-ac10703d-00b1-4781-aa19-c75548df31e1" released by "_delete_snapshot" :: held 1.650s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:09 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-def5ca2b-bb0e-48a6-904c-f99332e649b1 tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "cinder-quobyte-e51f29ae-daaf-422b-ae26-a1ec598be3fe" released by "delete_snapshot" :: held 1.776s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:09 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-def5ca2b-bb0e-48a6-904c-f99332e649b1 tempest-CreateVolumesFromSnapshotTest-654342443 None] Created reservations ['614f0f19-8e22-4f25-b39e-54e16d3020e2', 'c214f63a-f89d-4c3b-9767-117e8a2154ae', 'ec7517a1-e4ce-4041-b20f-6a9c4a45f8ac', '9b2146da-244d-472d-b6cc-1c899850de24'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:09:09 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-def5ca2b-bb0e-48a6-904c-f99332e649b1 tempest-CreateVolumesFromSnapshotTest-654342443 None] Delete snapshot completed successfully. Jul 30 17:09:09 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-def5ca2b-bb0e-48a6-904c-f99332e649b1 tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "cinder-ac10703d-00b1-4781-aa19-c75548df31e1-delete_snapshot" released by "delete_snapshot" :: held 1.958s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:09 devstack sudo[108459]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6a520143-e225-4f74-828f-df6f750989b3 tempest-VolumeImageDependencyTests-1529416407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286.55fbf6ca-597f-49fe-bb92-424af09ab2e1 1G" returned: 0 in 0.455s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6a520143-e225-4f74-828f-df6f750989b3 tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286.55fbf6ca-597f-49fe-bb92-424af09ab2e1 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:09 devstack sudo[108466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286.55fbf6ca-597f-49fe-bb92-424af09ab2e1 Jul 30 17:09:09 devstack sudo[108466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:10 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-84e6e0fb-6208-4471-a564-1313f32743c7 tempest-CreateVolumesFromSnapshotTest-654342443 None] Acquiring lock "cinder-e51f29ae-daaf-422b-ae26-a1ec598be3fe-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:10 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-84e6e0fb-6208-4471-a564-1313f32743c7 tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "cinder-e51f29ae-daaf-422b-ae26-a1ec598be3fe-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:10 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:SELECT=230,cinder:UPDATE=276,cinder:INSERT=81,cinder:DELETE=28 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:09:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f41f6cf0-ca3a-48b6-be4f-1be05cf04fd9 tempest-ProjectMemberTests-1145856324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:10 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-84e6e0fb-6208-4471-a564-1313f32743c7 tempest-CreateVolumesFromSnapshotTest-654342443 None] Acquiring lock "cinder-quobyte-e51f29ae-daaf-422b-ae26-a1ec598be3fe" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:10 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-84e6e0fb-6208-4471-a564-1313f32743c7 tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "cinder-quobyte-e51f29ae-daaf-422b-ae26-a1ec598be3fe" acquired by "delete_volume" :: waited 0.016s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:10 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[05191676-c923-4474-bf05-52c9dbae8d4e]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-84e6e0fb-6208-4471-a564-1313f32743c7 tempest-CreateVolumesFromSnapshotTest-654342443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e51f29ae-daaf-422b-ae26-a1ec598be3fe {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:10 devstack sudo[108466]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6a520143-e225-4f74-828f-df6f750989b3 tempest-VolumeImageDependencyTests-1529416407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286.55fbf6ca-597f-49fe-bb92-424af09ab2e1" returned: 0 in 0.373s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:10 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-6a520143-e225-4f74-828f-df6f750989b3 tempest-VolumeImageDependencyTests-1529416407 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286.55fbf6ca-597f-49fe-bb92-424af09ab2e1 is being set with open permissions: ugo+rw Jul 30 17:09:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6a520143-e225-4f74-828f-df6f750989b3 tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286.55fbf6ca-597f-49fe-bb92-424af09ab2e1 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:10 devstack sudo[108473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286.55fbf6ca-597f-49fe-bb92-424af09ab2e1 Jul 30 17:09:10 devstack sudo[108473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:10 devstack sudo[108472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e51f29ae-daaf-422b-ae26-a1ec598be3fe Jul 30 17:09:10 devstack sudo[108472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:10 devstack sudo[108473]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6a520143-e225-4f74-828f-df6f750989b3 tempest-VolumeImageDependencyTests-1529416407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286.55fbf6ca-597f-49fe-bb92-424af09ab2e1" returned: 0 in 0.247s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6a520143-e225-4f74-828f-df6f750989b3 tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:10 devstack sudo[108480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286.info Jul 30 17:09:10 devstack sudo[108480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:10 devstack sudo[108472]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-84e6e0fb-6208-4471-a564-1313f32743c7 tempest-CreateVolumesFromSnapshotTest-654342443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e51f29ae-daaf-422b-ae26-a1ec598be3fe" returned: 0 in 0.364s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-84e6e0fb-6208-4471-a564-1313f32743c7 tempest-CreateVolumesFromSnapshotTest-654342443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e51f29ae-daaf-422b-ae26-a1ec598be3fe {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:10 devstack sudo[108482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e51f29ae-daaf-422b-ae26-a1ec598be3fe Jul 30 17:09:10 devstack sudo[108482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:10 devstack sudo[108480]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6a520143-e225-4f74-828f-df6f750989b3 tempest-VolumeImageDependencyTests-1529416407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286.info" returned: 0 in 0.258s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:10 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-6a520143-e225-4f74-828f-df6f750989b3 tempest-VolumeImageDependencyTests-1529416407 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286.info is being set with open permissions: ugo+rw Jul 30 17:09:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6a520143-e225-4f74-828f-df6f750989b3 tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:10 devstack sudo[108486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286.info Jul 30 17:09:10 devstack sudo[108486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:10 devstack sudo[108482]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-84e6e0fb-6208-4471-a564-1313f32743c7 tempest-CreateVolumesFromSnapshotTest-654342443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e51f29ae-daaf-422b-ae26-a1ec598be3fe" returned: 0 in 0.259s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:10 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-84e6e0fb-6208-4471-a564-1313f32743c7 tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "cinder-quobyte-e51f29ae-daaf-422b-ae26-a1ec598be3fe" released by "delete_volume" :: held 0.675s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:10 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-84e6e0fb-6208-4471-a564-1313f32743c7 tempest-CreateVolumesFromSnapshotTest-654342443 None] Created reservations ['77492e84-77bd-4ff2-889e-e03d95637fcf', '54045954-7f32-41bb-b265-fa86a6fcc1af', '40719a0e-f42e-4e43-b4bc-74b2c0b93377', '6a3a866f-21fa-403a-8704-9a4c52ca671a'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:09:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-84e6e0fb-6208-4471-a564-1313f32743c7 tempest-CreateVolumesFromSnapshotTest-654342443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-84e6e0fb-6208-4471-a564-1313f32743c7 tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:11 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-84e6e0fb-6208-4471-a564-1313f32743c7 tempest-CreateVolumesFromSnapshotTest-654342443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:11 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-84e6e0fb-6208-4471-a564-1313f32743c7 tempest-CreateVolumesFromSnapshotTest-654342443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-84e6e0fb-6208-4471-a564-1313f32743c7 tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-84e6e0fb-6208-4471-a564-1313f32743c7 tempest-CreateVolumesFromSnapshotTest-654342443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:11 devstack sudo[108488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:09:11 devstack sudo[108488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:11 devstack sudo[108486]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6a520143-e225-4f74-828f-df6f750989b3 tempest-VolumeImageDependencyTests-1529416407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286.info" returned: 0 in 0.257s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-6a520143-e225-4f74-828f-df6f750989b3 tempest-VolumeImageDependencyTests-1529416407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.083s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-bdae5af5-e4b8-4dec-9e3a-c3d6c13b315f tempest-VolumeDependencyTests-500709084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.258s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:11 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-bdae5af5-e4b8-4dec-9e3a-c3d6c13b315f tempest-VolumeDependencyTests-500709084 None] Acquiring lock "cinder-quobyte-efd1ebbe-c12b-472e-ad37-525ad9769a16-ad9d489b-be22-4b8d-8480-c74bf5af8bff" by "_create_volume_from_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:11 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-bdae5af5-e4b8-4dec-9e3a-c3d6c13b315f tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-efd1ebbe-c12b-472e-ad37-525ad9769a16-ad9d489b-be22-4b8d-8480-c74bf5af8bff" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:11 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-bdae5af5-e4b8-4dec-9e3a-c3d6c13b315f tempest-VolumeDependencyTests-500709084 None] Creating volume ad9d489b-be22-4b8d-8480-c74bf5af8bff from snapshot efd1ebbe-c12b-472e-ad37-525ad9769a16 {{(pid=88591) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 30 17:09:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-bdae5af5-e4b8-4dec-9e3a-c3d6c13b315f tempest-VolumeDependencyTests-500709084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-bdae5af5-e4b8-4dec-9e3a-c3d6c13b315f tempest-VolumeDependencyTests-500709084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:11 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-bdae5af5-e4b8-4dec-9e3a-c3d6c13b315f tempest-VolumeDependencyTests-500709084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:11 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-bdae5af5-e4b8-4dec-9e3a-c3d6c13b315f tempest-VolumeDependencyTests-500709084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-bdae5af5-e4b8-4dec-9e3a-c3d6c13b315f tempest-VolumeDependencyTests-500709084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:11 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-bdae5af5-e4b8-4dec-9e3a-c3d6c13b315f tempest-VolumeDependencyTests-500709084 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:09:11 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-bdae5af5-e4b8-4dec-9e3a-c3d6c13b315f tempest-VolumeDependencyTests-500709084 None] Acquiring lock "cinder-quobyte-ad9d489b-be22-4b8d-8480-c74bf5af8bff" by "_copy_volume_from_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:11 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-bdae5af5-e4b8-4dec-9e3a-c3d6c13b315f tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-ad9d489b-be22-4b8d-8480-c74bf5af8bff" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:11 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-bdae5af5-e4b8-4dec-9e3a-c3d6c13b315f tempest-VolumeDependencyTests-500709084 None] snapshot: efd1ebbe-c12b-472e-ad37-525ad9769a16, volume: ad9d489b-be22-4b8d-8480-c74bf5af8bff, {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 17:09:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-bdae5af5-e4b8-4dec-9e3a-c3d6c13b315f tempest-VolumeDependencyTests-500709084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-bdae5af5-e4b8-4dec-9e3a-c3d6c13b315f tempest-VolumeDependencyTests-500709084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:11 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-bdae5af5-e4b8-4dec-9e3a-c3d6c13b315f tempest-VolumeDependencyTests-500709084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:11 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-bdae5af5-e4b8-4dec-9e3a-c3d6c13b315f tempest-VolumeDependencyTests-500709084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-bdae5af5-e4b8-4dec-9e3a-c3d6c13b315f tempest-VolumeDependencyTests-500709084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:11 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[184e131a-8deb-4dc1-a461-e9cadfd7a328]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bdae5af5-e4b8-4dec-9e3a-c3d6c13b315f tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2.efd1ebbe-c12b-472e-ad37-525ad9769a16 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:11 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-6a520143-e225-4f74-828f-df6f750989b3 tempest-VolumeImageDependencyTests-1529416407 None] Create snapshot completed successfully Jul 30 17:09:11 devstack sudo[108488]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-84e6e0fb-6208-4471-a564-1313f32743c7 tempest-CreateVolumesFromSnapshotTest-654342443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.299s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:11 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-84e6e0fb-6208-4471-a564-1313f32743c7 tempest-CreateVolumesFromSnapshotTest-654342443 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:09:11 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-84e6e0fb-6208-4471-a564-1313f32743c7 tempest-CreateVolumesFromSnapshotTest-654342443 None] Deleted volume successfully. Jul 30 17:09:11 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-84e6e0fb-6208-4471-a564-1313f32743c7 tempest-CreateVolumesFromSnapshotTest-654342443 None] Lock "cinder-e51f29ae-daaf-422b-ae26-a1ec598be3fe-delete_volume" released by "delete_volume" :: held 1.214s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:11 devstack sudo[108492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2.efd1ebbe-c12b-472e-ad37-525ad9769a16 Jul 30 17:09:11 devstack sudo[108492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:11 devstack sudo[108492]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bdae5af5-e4b8-4dec-9e3a-c3d6c13b315f tempest-VolumeDependencyTests-500709084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2.efd1ebbe-c12b-472e-ad37-525ad9769a16" returned: 0 in 0.413s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:11 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-bdae5af5-e4b8-4dec-9e3a-c3d6c13b315f tempest-VolumeDependencyTests-500709084 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:09:11 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d66e4f0-b60d-426b-9603-90e2240cfdca]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bdae5af5-e4b8-4dec-9e3a-c3d6c13b315f tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:11 devstack sudo[108497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2 Jul 30 17:09:11 devstack sudo[108497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:12 devstack sudo[108497]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bdae5af5-e4b8-4dec-9e3a-c3d6c13b315f tempest-VolumeDependencyTests-500709084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2" returned: 0 in 0.454s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-bdae5af5-e4b8-4dec-9e3a-c3d6c13b315f tempest-VolumeDependencyTests-500709084 None] will copy from snapshot at /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2 {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 17:09:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-bdae5af5-e4b8-4dec-9e3a-c3d6c13b315f tempest-VolumeDependencyTests-500709084 None] Creating direct copy from snapshot {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 17:09:12 devstack cinder-volume[88591]: DEBUG cinder.utils [None req-bdae5af5-e4b8-4dec-9e3a-c3d6c13b315f tempest-VolumeDependencyTests-500709084 None] Path /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff not found in is_blk_device check {{(pid=88591) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 17:09:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bdae5af5-e4b8-4dec-9e3a-c3d6c13b315f tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:12 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c164dc2-b020-48b6-9fb0-f4b7b0c7c05a tempest-VolumeImageDependencyTests-1529416407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:09:12 devstack sudo[108502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff Jul 30 17:09:12 devstack sudo[108502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7c164dc2-b020-48b6-9fb0-f4b7b0c7c05a tempest-VolumeImageDependencyTests-1529416407 None] Flow 'volume_create_manager' (2d1b1427-8ec0-4744-bc1e-672d35083261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:09:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7c164dc2-b020-48b6-9fb0-f4b7b0c7c05a tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70da83fc-c926-4377-a4c2-6ea537ffa09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7c164dc2-b020-48b6-9fb0-f4b7b0c7c05a tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70da83fc-c926-4377-a4c2-6ea537ffa09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume2-for-test-e6050452-06bd-4c7f-9912-45178c83e379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6212e360-87db-4447-bf66-2db389a7ba35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f61df38a914ec2a6713104b0278991',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=55fbf6ca-597f-49fe-bb92-424af09ab2e1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:09:12Z,use_quota=True,user_id='e4eedb818424482c9370625aced56a0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7c164dc2-b020-48b6-9fb0-f4b7b0c7c05a tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de3c87a3-6428-4995-b9f1-665e8508a8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7c164dc2-b020-48b6-9fb0-f4b7b0c7c05a tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de3c87a3-6428-4995-b9f1-665e8508a8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7c164dc2-b020-48b6-9fb0-f4b7b0c7c05a tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f5198e4-7976-4fcb-9b30-9487c3b44824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7c164dc2-b020-48b6-9fb0-f4b7b0c7c05a tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f5198e4-7976-4fcb-9b30-9487c3b44824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6212e360-87db-4447-bf66-2db389a7ba35', 'volume_name': 'volume-6212e360-87db-4447-bf66-2db389a7ba35', 'volume_size': 1, 'snapshot_id': '55fbf6ca-597f-49fe-bb92-424af09ab2e1'}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7c164dc2-b020-48b6-9fb0-f4b7b0c7c05a tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d62ddf42-5935-4ca4-bd1a-79da63720e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7c164dc2-b020-48b6-9fb0-f4b7b0c7c05a tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d62ddf42-5935-4ca4-bd1a-79da63720e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7c164dc2-b020-48b6-9fb0-f4b7b0c7c05a tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (592002ed-07f5-47b7-9364-247f5aff1448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:12 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-7c164dc2-b020-48b6-9fb0-f4b7b0c7c05a tempest-VolumeImageDependencyTests-1529416407 None] Volume 6212e360-87db-4447-bf66-2db389a7ba35: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6212e360-87db-4447-bf66-2db389a7ba35', 'volume_size': 1, 'snapshot_id': '55fbf6ca-597f-49fe-bb92-424af09ab2e1'} Jul 30 17:09:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7c164dc2-b020-48b6-9fb0-f4b7b0c7c05a tempest-VolumeImageDependencyTests-1529416407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:12 devstack cinder-volume[88591]: DEBUG oslo_service.periodic_task [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 17:09:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:12 devstack sudo[108517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:09:12 devstack sudo[108517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:13 devstack sudo[108517]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.607s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:13 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:09:13 devstack cinder-volume[88591]: DEBUG oslo_service.periodic_task [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running periodic task VolumeManager._thread_info {{(pid=88591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 17:09:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] thread count: 28 {{(pid=88591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 17:09:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] thread info: [<_MainThread(MainThread, started 140677178003584)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 17:09:16 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea289707-16f7-4a7c-9c46-c37e5b7126f2 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:09:16 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ea289707-16f7-4a7c-9c46-c37e5b7126f2 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Flow 'volume_create_manager' (bdc8634a-7069-4b67-a7f8-d72d7fdf7cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:09:16 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ea289707-16f7-4a7c-9c46-c37e5b7126f2 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (994a0c51-27a4-41fc-8d38-68a170343929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:16 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ea289707-16f7-4a7c-9c46-c37e5b7126f2 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (994a0c51-27a4-41fc-8d38-68a170343929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1335877320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06210903-8f4e-46fe-9f65-56c2dd123b1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea66f9219b4644f59fff959929a1ef22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:09:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:09:17Z,use_quota=True,user_id='c2b9de048ee84761b71c9bf4fda93c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:16 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ea289707-16f7-4a7c-9c46-c37e5b7126f2 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30de8c99-9263-4bac-947e-af4a8e119e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:16 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ea289707-16f7-4a7c-9c46-c37e5b7126f2 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30de8c99-9263-4bac-947e-af4a8e119e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:16 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ea289707-16f7-4a7c-9c46-c37e5b7126f2 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c078be66-d532-4147-b0b6-4485d51467ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:16 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ea289707-16f7-4a7c-9c46-c37e5b7126f2 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c078be66-d532-4147-b0b6-4485d51467ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06210903-8f4e-46fe-9f65-56c2dd123b1f', 'volume_name': 'volume-06210903-8f4e-46fe-9f65-56c2dd123b1f', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:16 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ea289707-16f7-4a7c-9c46-c37e5b7126f2 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bb2ff91-3400-4743-b7f1-4ba9414c2d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:16 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ea289707-16f7-4a7c-9c46-c37e5b7126f2 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bb2ff91-3400-4743-b7f1-4ba9414c2d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:16 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ea289707-16f7-4a7c-9c46-c37e5b7126f2 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdf8855c-1d64-450d-a29e-12f73de9256d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:16 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-ea289707-16f7-4a7c-9c46-c37e5b7126f2 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Volume 06210903-8f4e-46fe-9f65-56c2dd123b1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06210903-8f4e-46fe-9f65-56c2dd123b1f', 'volume_size': 1} Jul 30 17:09:16 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ea289707-16f7-4a7c-9c46-c37e5b7126f2 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:17 devstack sudo[108502]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bdae5af5-e4b8-4dec-9e3a-c3d6c13b315f tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff" returned: 0 in 5.026s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:17 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-bdae5af5-e4b8-4dec-9e3a-c3d6c13b315f tempest-VolumeDependencyTests-500709084 None] Image conversion details: src /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2, size 1024.00 MB, duration 5.03 sec, destination /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff {{(pid=88591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 17:09:17 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-bdae5af5-e4b8-4dec-9e3a-c3d6c13b315f tempest-VolumeDependencyTests-500709084 None] Converted 1024.00 MB image at 203.71 MB/s Jul 30 17:09:17 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-bdae5af5-e4b8-4dec-9e3a-c3d6c13b315f tempest-VolumeDependencyTests-500709084 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff is being set with open permissions: ugo+rw Jul 30 17:09:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bdae5af5-e4b8-4dec-9e3a-c3d6c13b315f tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:17 devstack sudo[108522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff Jul 30 17:09:17 devstack sudo[108522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:17 devstack sudo[108522]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bdae5af5-e4b8-4dec-9e3a-c3d6c13b315f tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff" returned: 0 in 0.239s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:17 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-bdae5af5-e4b8-4dec-9e3a-c3d6c13b315f tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-ad9d489b-be22-4b8d-8480-c74bf5af8bff" released by "_copy_volume_from_snapshot" :: held 6.240s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:17 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-bdae5af5-e4b8-4dec-9e3a-c3d6c13b315f tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-efd1ebbe-c12b-472e-ad37-525ad9769a16-ad9d489b-be22-4b8d-8480-c74bf5af8bff" released by "_create_volume_from_snapshot" :: held 6.314s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-bdae5af5-e4b8-4dec-9e3a-c3d6c13b315f tempest-VolumeDependencyTests-500709084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.343s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f41f6cf0-ca3a-48b6-be4f-1be05cf04fd9 tempest-ProjectMemberTests-1145856324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.266s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:17 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-f41f6cf0-ca3a-48b6-be4f-1be05cf04fd9 tempest-ProjectMemberTests-1145856324 None] Creating offline snapshot 97bf9932-af96-4d58-8c5c-bfe6c75323b4 of volume 0e128991-f914-4ce1-afcd-ee5c94acc301 {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:09:17 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bdae5af5-e4b8-4dec-9e3a-c3d6c13b315f tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9433b8a2-6bd6-488a-ba99-e831b60e267f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff', 'volume_size': 1, 'snapshot_id': 'efd1ebbe-c12b-472e-ad37-525ad9769a16'}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:17 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bdae5af5-e4b8-4dec-9e3a-c3d6c13b315f tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2db3514d-abdc-4aaf-8b40-042f05f7a368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:17 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5605dc24-9171-4052-a4dd-58bd4ddb3a6c]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f41f6cf0-ca3a-48b6-be4f-1be05cf04fd9 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e128991-f914-4ce1-afcd-ee5c94acc301 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:17 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-bdae5af5-e4b8-4dec-9e3a-c3d6c13b315f tempest-VolumeDependencyTests-500709084 None] Volume volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff (ad9d489b-be22-4b8d-8480-c74bf5af8bff): created successfully Jul 30 17:09:17 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bdae5af5-e4b8-4dec-9e3a-c3d6c13b315f tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2db3514d-abdc-4aaf-8b40-042f05f7a368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:17 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bdae5af5-e4b8-4dec-9e3a-c3d6c13b315f tempest-VolumeDependencyTests-500709084 None] Flow 'volume_create_manager' (4dc76816-5c4c-412f-94e9-86bcdbb5d07e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:09:17 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-bdae5af5-e4b8-4dec-9e3a-c3d6c13b315f tempest-VolumeDependencyTests-500709084 None] Created volume successfully. Jul 30 17:09:17 devstack sudo[108525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e128991-f914-4ce1-afcd-ee5c94acc301 Jul 30 17:09:17 devstack sudo[108525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:17 devstack sudo[108525]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f41f6cf0-ca3a-48b6-be4f-1be05cf04fd9 tempest-ProjectMemberTests-1145856324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e128991-f914-4ce1-afcd-ee5c94acc301" returned: 0 in 0.376s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f41f6cf0-ca3a-48b6-be4f-1be05cf04fd9 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e128991-f914-4ce1-afcd-ee5c94acc301,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e128991-f914-4ce1-afcd-ee5c94acc301.97bf9932-af96-4d58-8c5c-bfe6c75323b4 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:17 devstack sudo[108530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e128991-f914-4ce1-afcd-ee5c94acc301,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e128991-f914-4ce1-afcd-ee5c94acc301.97bf9932-af96-4d58-8c5c-bfe6c75323b4 1G Jul 30 17:09:17 devstack sudo[108530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:18 devstack sudo[108530]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f41f6cf0-ca3a-48b6-be4f-1be05cf04fd9 tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e128991-f914-4ce1-afcd-ee5c94acc301,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e128991-f914-4ce1-afcd-ee5c94acc301.97bf9932-af96-4d58-8c5c-bfe6c75323b4 1G" returned: 0 in 0.381s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f41f6cf0-ca3a-48b6-be4f-1be05cf04fd9 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e128991-f914-4ce1-afcd-ee5c94acc301 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e128991-f914-4ce1-afcd-ee5c94acc301.97bf9932-af96-4d58-8c5c-bfe6c75323b4 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:18 devstack sudo[108537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e128991-f914-4ce1-afcd-ee5c94acc301 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e128991-f914-4ce1-afcd-ee5c94acc301.97bf9932-af96-4d58-8c5c-bfe6c75323b4 Jul 30 17:09:18 devstack sudo[108537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:18 devstack sudo[108537]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f41f6cf0-ca3a-48b6-be4f-1be05cf04fd9 tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e128991-f914-4ce1-afcd-ee5c94acc301 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e128991-f914-4ce1-afcd-ee5c94acc301.97bf9932-af96-4d58-8c5c-bfe6c75323b4" returned: 0 in 0.299s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:18 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-f41f6cf0-ca3a-48b6-be4f-1be05cf04fd9 tempest-ProjectMemberTests-1145856324 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e128991-f914-4ce1-afcd-ee5c94acc301.97bf9932-af96-4d58-8c5c-bfe6c75323b4 is being set with open permissions: ugo+rw Jul 30 17:09:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f41f6cf0-ca3a-48b6-be4f-1be05cf04fd9 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e128991-f914-4ce1-afcd-ee5c94acc301.97bf9932-af96-4d58-8c5c-bfe6c75323b4 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:18 devstack sudo[108542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e128991-f914-4ce1-afcd-ee5c94acc301.97bf9932-af96-4d58-8c5c-bfe6c75323b4 Jul 30 17:09:18 devstack sudo[108542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:18 devstack sudo[108542]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f41f6cf0-ca3a-48b6-be4f-1be05cf04fd9 tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e128991-f914-4ce1-afcd-ee5c94acc301.97bf9932-af96-4d58-8c5c-bfe6c75323b4" returned: 0 in 0.253s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f41f6cf0-ca3a-48b6-be4f-1be05cf04fd9 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e128991-f914-4ce1-afcd-ee5c94acc301.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:18 devstack sudo[108545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e128991-f914-4ce1-afcd-ee5c94acc301.info Jul 30 17:09:18 devstack sudo[108545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-fbeba419-eab5-4f6e-afa9-c537a447353b tempest-VolumeDependencyTests-500709084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:19 devstack sudo[108545]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f41f6cf0-ca3a-48b6-be4f-1be05cf04fd9 tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e128991-f914-4ce1-afcd-ee5c94acc301.info" returned: 0 in 0.255s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:19 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-f41f6cf0-ca3a-48b6-be4f-1be05cf04fd9 tempest-ProjectMemberTests-1145856324 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e128991-f914-4ce1-afcd-ee5c94acc301.info is being set with open permissions: ugo+rw Jul 30 17:09:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f41f6cf0-ca3a-48b6-be4f-1be05cf04fd9 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e128991-f914-4ce1-afcd-ee5c94acc301.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:19 devstack sudo[108548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e128991-f914-4ce1-afcd-ee5c94acc301.info Jul 30 17:09:19 devstack sudo[108548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:19 devstack sudo[108548]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f41f6cf0-ca3a-48b6-be4f-1be05cf04fd9 tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e128991-f914-4ce1-afcd-ee5c94acc301.info" returned: 0 in 0.244s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f41f6cf0-ca3a-48b6-be4f-1be05cf04fd9 tempest-ProjectMemberTests-1145856324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.915s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7c164dc2-b020-48b6-9fb0-f4b7b0c7c05a tempest-VolumeImageDependencyTests-1529416407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 7.068s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:19 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7c164dc2-b020-48b6-9fb0-f4b7b0c7c05a tempest-VolumeImageDependencyTests-1529416407 None] Acquiring lock "cinder-quobyte-55fbf6ca-597f-49fe-bb92-424af09ab2e1-6212e360-87db-4447-bf66-2db389a7ba35" by "_create_volume_from_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:19 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7c164dc2-b020-48b6-9fb0-f4b7b0c7c05a tempest-VolumeImageDependencyTests-1529416407 None] Lock "cinder-quobyte-55fbf6ca-597f-49fe-bb92-424af09ab2e1-6212e360-87db-4447-bf66-2db389a7ba35" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:19 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7c164dc2-b020-48b6-9fb0-f4b7b0c7c05a tempest-VolumeImageDependencyTests-1529416407 None] Creating volume 6212e360-87db-4447-bf66-2db389a7ba35 from snapshot 55fbf6ca-597f-49fe-bb92-424af09ab2e1 {{(pid=88591) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 30 17:09:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7c164dc2-b020-48b6-9fb0-f4b7b0c7c05a tempest-VolumeImageDependencyTests-1529416407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7c164dc2-b020-48b6-9fb0-f4b7b0c7c05a tempest-VolumeImageDependencyTests-1529416407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:19 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7c164dc2-b020-48b6-9fb0-f4b7b0c7c05a tempest-VolumeImageDependencyTests-1529416407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:19 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7c164dc2-b020-48b6-9fb0-f4b7b0c7c05a tempest-VolumeImageDependencyTests-1529416407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7c164dc2-b020-48b6-9fb0-f4b7b0c7c05a tempest-VolumeImageDependencyTests-1529416407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:19 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7c164dc2-b020-48b6-9fb0-f4b7b0c7c05a tempest-VolumeImageDependencyTests-1529416407 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:09:19 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7c164dc2-b020-48b6-9fb0-f4b7b0c7c05a tempest-VolumeImageDependencyTests-1529416407 None] Acquiring lock "cinder-quobyte-6212e360-87db-4447-bf66-2db389a7ba35" by "_copy_volume_from_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:19 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-f41f6cf0-ca3a-48b6-be4f-1be05cf04fd9 tempest-ProjectMemberTests-1145856324 None] Create snapshot completed successfully Jul 30 17:09:19 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7c164dc2-b020-48b6-9fb0-f4b7b0c7c05a tempest-VolumeImageDependencyTests-1529416407 None] Lock "cinder-quobyte-6212e360-87db-4447-bf66-2db389a7ba35" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:19 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7c164dc2-b020-48b6-9fb0-f4b7b0c7c05a tempest-VolumeImageDependencyTests-1529416407 None] snapshot: 55fbf6ca-597f-49fe-bb92-424af09ab2e1, volume: 6212e360-87db-4447-bf66-2db389a7ba35, {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 17:09:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7c164dc2-b020-48b6-9fb0-f4b7b0c7c05a tempest-VolumeImageDependencyTests-1529416407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7c164dc2-b020-48b6-9fb0-f4b7b0c7c05a tempest-VolumeImageDependencyTests-1529416407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:19 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7c164dc2-b020-48b6-9fb0-f4b7b0c7c05a tempest-VolumeImageDependencyTests-1529416407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:19 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7c164dc2-b020-48b6-9fb0-f4b7b0c7c05a tempest-VolumeImageDependencyTests-1529416407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7c164dc2-b020-48b6-9fb0-f4b7b0c7c05a tempest-VolumeImageDependencyTests-1529416407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:19 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[00cd247d-2ecc-4a5a-9d5d-6af3dc1957d7]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7c164dc2-b020-48b6-9fb0-f4b7b0c7c05a tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286.55fbf6ca-597f-49fe-bb92-424af09ab2e1 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:19 devstack sudo[108551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286.55fbf6ca-597f-49fe-bb92-424af09ab2e1 Jul 30 17:09:19 devstack sudo[108551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:19 devstack sudo[108551]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7c164dc2-b020-48b6-9fb0-f4b7b0c7c05a tempest-VolumeImageDependencyTests-1529416407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286.55fbf6ca-597f-49fe-bb92-424af09ab2e1" returned: 0 in 0.370s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:19 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-7c164dc2-b020-48b6-9fb0-f4b7b0c7c05a tempest-VolumeImageDependencyTests-1529416407 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:09:19 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[016f5657-fc52-4225-a987-ccfabfad8a1f]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7c164dc2-b020-48b6-9fb0-f4b7b0c7c05a tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:19 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9c8c1094-22a8-4dc4-a099-f6d51a1eb761 tempest-ProjectMemberTests-1145856324 None] Acquiring lock "cinder-97bf9932-af96-4d58-8c5c-bfe6c75323b4-delete_snapshot" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:19 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9c8c1094-22a8-4dc4-a099-f6d51a1eb761 tempest-ProjectMemberTests-1145856324 None] Lock "cinder-97bf9932-af96-4d58-8c5c-bfe6c75323b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:19 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9c8c1094-22a8-4dc4-a099-f6d51a1eb761 tempest-ProjectMemberTests-1145856324 None] Acquiring lock "cinder-quobyte-0e128991-f914-4ce1-afcd-ee5c94acc301" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:19 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9c8c1094-22a8-4dc4-a099-f6d51a1eb761 tempest-ProjectMemberTests-1145856324 None] Lock "cinder-quobyte-0e128991-f914-4ce1-afcd-ee5c94acc301" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:19 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9c8c1094-22a8-4dc4-a099-f6d51a1eb761 tempest-ProjectMemberTests-1145856324 None] Acquiring lock "cinder-quobyte-97bf9932-af96-4d58-8c5c-bfe6c75323b4" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:19 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9c8c1094-22a8-4dc4-a099-f6d51a1eb761 tempest-ProjectMemberTests-1145856324 None] Lock "cinder-quobyte-97bf9932-af96-4d58-8c5c-bfe6c75323b4" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:19 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-9c8c1094-22a8-4dc4-a099-f6d51a1eb761 tempest-ProjectMemberTests-1145856324 None] Deleting offline snapshot 97bf9932-af96-4d58-8c5c-bfe6c75323b4 of volume 0e128991-f914-4ce1-afcd-ee5c94acc301 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:09:19 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-9c8c1094-22a8-4dc4-a099-f6d51a1eb761 tempest-ProjectMemberTests-1145856324 None] snapshot_file for this snap is: volume-0e128991-f914-4ce1-afcd-ee5c94acc301.97bf9932-af96-4d58-8c5c-bfe6c75323b4 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:09:19 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cae46f8-7827-4e62-b1e5-8f66f93a37e0]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9c8c1094-22a8-4dc4-a099-f6d51a1eb761 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e128991-f914-4ce1-afcd-ee5c94acc301.97bf9932-af96-4d58-8c5c-bfe6c75323b4 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:20 devstack sudo[108556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286 Jul 30 17:09:20 devstack sudo[108556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:20 devstack sudo[108557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e128991-f914-4ce1-afcd-ee5c94acc301.97bf9932-af96-4d58-8c5c-bfe6c75323b4 Jul 30 17:09:20 devstack sudo[108557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:20 devstack sudo[108556]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7c164dc2-b020-48b6-9fb0-f4b7b0c7c05a tempest-VolumeImageDependencyTests-1529416407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286" returned: 0 in 0.367s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:20 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7c164dc2-b020-48b6-9fb0-f4b7b0c7c05a tempest-VolumeImageDependencyTests-1529416407 None] will copy from snapshot at /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286 {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 17:09:20 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7c164dc2-b020-48b6-9fb0-f4b7b0c7c05a tempest-VolumeImageDependencyTests-1529416407 None] Creating direct copy from snapshot {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 17:09:20 devstack cinder-volume[88591]: DEBUG cinder.utils [None req-7c164dc2-b020-48b6-9fb0-f4b7b0c7c05a tempest-VolumeImageDependencyTests-1529416407 None] Path /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-6212e360-87db-4447-bf66-2db389a7ba35 not found in is_blk_device check {{(pid=88591) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 17:09:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7c164dc2-b020-48b6-9fb0-f4b7b0c7c05a tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-6212e360-87db-4447-bf66-2db389a7ba35 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:20 devstack sudo[108563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-6212e360-87db-4447-bf66-2db389a7ba35 Jul 30 17:09:20 devstack sudo[108563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:20 devstack sudo[108557]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9c8c1094-22a8-4dc4-a099-f6d51a1eb761 tempest-ProjectMemberTests-1145856324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e128991-f914-4ce1-afcd-ee5c94acc301.97bf9932-af96-4d58-8c5c-bfe6c75323b4" returned: 0 in 0.365s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:20 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-9c8c1094-22a8-4dc4-a099-f6d51a1eb761 tempest-ProjectMemberTests-1145856324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e128991-f914-4ce1-afcd-ee5c94acc301(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:09:20 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[29548389-9273-4095-996e-9e9d4a0bac1d]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9c8c1094-22a8-4dc4-a099-f6d51a1eb761 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e128991-f914-4ce1-afcd-ee5c94acc301 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:20 devstack sudo[108568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e128991-f914-4ce1-afcd-ee5c94acc301 Jul 30 17:09:20 devstack sudo[108568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:20 devstack sudo[108563]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7c164dc2-b020-48b6-9fb0-f4b7b0c7c05a tempest-VolumeImageDependencyTests-1529416407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-6212e360-87db-4447-bf66-2db389a7ba35" returned: 0 in 0.468s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:20 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-7c164dc2-b020-48b6-9fb0-f4b7b0c7c05a tempest-VolumeImageDependencyTests-1529416407 None] Image conversion details: src /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-6212e360-87db-4447-bf66-2db389a7ba35 {{(pid=88591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 17:09:20 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-7c164dc2-b020-48b6-9fb0-f4b7b0c7c05a tempest-VolumeImageDependencyTests-1529416407 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 30 17:09:20 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-7c164dc2-b020-48b6-9fb0-f4b7b0c7c05a tempest-VolumeImageDependencyTests-1529416407 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-6212e360-87db-4447-bf66-2db389a7ba35 is being set with open permissions: ugo+rw Jul 30 17:09:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7c164dc2-b020-48b6-9fb0-f4b7b0c7c05a tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-6212e360-87db-4447-bf66-2db389a7ba35 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:20 devstack sudo[108568]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9c8c1094-22a8-4dc4-a099-f6d51a1eb761 tempest-ProjectMemberTests-1145856324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e128991-f914-4ce1-afcd-ee5c94acc301" returned: 0 in 0.361s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9c8c1094-22a8-4dc4-a099-f6d51a1eb761 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e128991-f914-4ce1-afcd-ee5c94acc301.97bf9932-af96-4d58-8c5c-bfe6c75323b4 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:20 devstack sudo[108577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-6212e360-87db-4447-bf66-2db389a7ba35 Jul 30 17:09:20 devstack sudo[108577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:20 devstack sudo[108579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e128991-f914-4ce1-afcd-ee5c94acc301.97bf9932-af96-4d58-8c5c-bfe6c75323b4 Jul 30 17:09:20 devstack sudo[108579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:20 devstack sudo[108577]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7c164dc2-b020-48b6-9fb0-f4b7b0c7c05a tempest-VolumeImageDependencyTests-1529416407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-6212e360-87db-4447-bf66-2db389a7ba35" returned: 0 in 0.260s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:20 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7c164dc2-b020-48b6-9fb0-f4b7b0c7c05a tempest-VolumeImageDependencyTests-1529416407 None] Lock "cinder-quobyte-6212e360-87db-4447-bf66-2db389a7ba35" released by "_copy_volume_from_snapshot" :: held 1.543s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:21 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7c164dc2-b020-48b6-9fb0-f4b7b0c7c05a tempest-VolumeImageDependencyTests-1529416407 None] Lock "cinder-quobyte-55fbf6ca-597f-49fe-bb92-424af09ab2e1-6212e360-87db-4447-bf66-2db389a7ba35" released by "_create_volume_from_snapshot" :: held 1.608s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7c164dc2-b020-48b6-9fb0-f4b7b0c7c05a tempest-VolumeImageDependencyTests-1529416407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 1.637s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ea289707-16f7-4a7c-9c46-c37e5b7126f2 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.094s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:21 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ea289707-16f7-4a7c-9c46-c37e5b7126f2 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1335877320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06210903-8f4e-46fe-9f65-56c2dd123b1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea66f9219b4644f59fff959929a1ef22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:09:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:09:17Z,use_quota=True,user_id='c2b9de048ee84761b71c9bf4fda93c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:09:21 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-ea289707-16f7-4a7c-9c46-c37e5b7126f2 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Creating volume 06210903-8f4e-46fe-9f65-56c2dd123b1f {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:09:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ea289707-16f7-4a7c-9c46-c37e5b7126f2 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ea289707-16f7-4a7c-9c46-c37e5b7126f2 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:21 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ea289707-16f7-4a7c-9c46-c37e5b7126f2 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:21 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ea289707-16f7-4a7c-9c46-c37e5b7126f2 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ea289707-16f7-4a7c-9c46-c37e5b7126f2 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:21 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ea289707-16f7-4a7c-9c46-c37e5b7126f2 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:09:21 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-ea289707-16f7-4a7c-9c46-c37e5b7126f2 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:09:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ea289707-16f7-4a7c-9c46-c37e5b7126f2 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-06210903-8f4e-46fe-9f65-56c2dd123b1f 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:21 devstack cinder-volume[88591]: DEBUG cinder.volume.volume_utils [None req-7c164dc2-b020-48b6-9fb0-f4b7b0c7c05a tempest-VolumeImageDependencyTests-1529416407 None] Marking volume 6212e360-87db-4447-bf66-2db389a7ba35 as bootable. {{(pid=88591) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 30 17:09:21 devstack sudo[108585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-06210903-8f4e-46fe-9f65-56c2dd123b1f 1073741824 Jul 30 17:09:21 devstack sudo[108585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:21 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c164dc2-b020-48b6-9fb0-f4b7b0c7c05a tempest-VolumeImageDependencyTests-1529416407 None] Copying metadata from snapshot 55fbf6ca-597f-49fe-bb92-424af09ab2e1 to 6212e360-87db-4447-bf66-2db389a7ba35. {{(pid=88591) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:429}} Jul 30 17:09:21 devstack sudo[108579]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7c164dc2-b020-48b6-9fb0-f4b7b0c7c05a tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (592002ed-07f5-47b7-9364-247f5aff1448) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6212e360-87db-4447-bf66-2db389a7ba35', 'volume_size': 1, 'snapshot_id': '55fbf6ca-597f-49fe-bb92-424af09ab2e1'}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7c164dc2-b020-48b6-9fb0-f4b7b0c7c05a tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3822645-549b-4e6d-943a-f01450302c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9c8c1094-22a8-4dc4-a099-f6d51a1eb761 tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e128991-f914-4ce1-afcd-ee5c94acc301.97bf9932-af96-4d58-8c5c-bfe6c75323b4" returned: 0 in 0.387s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9c8c1094-22a8-4dc4-a099-f6d51a1eb761 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e128991-f914-4ce1-afcd-ee5c94acc301.97bf9932-af96-4d58-8c5c-bfe6c75323b4 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:21 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-7c164dc2-b020-48b6-9fb0-f4b7b0c7c05a tempest-VolumeImageDependencyTests-1529416407 None] Volume volume-6212e360-87db-4447-bf66-2db389a7ba35 (6212e360-87db-4447-bf66-2db389a7ba35): created successfully Jul 30 17:09:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7c164dc2-b020-48b6-9fb0-f4b7b0c7c05a tempest-VolumeImageDependencyTests-1529416407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3822645-549b-4e6d-943a-f01450302c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:21 devstack sudo[108588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e128991-f914-4ce1-afcd-ee5c94acc301.97bf9932-af96-4d58-8c5c-bfe6c75323b4 Jul 30 17:09:21 devstack sudo[108588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7c164dc2-b020-48b6-9fb0-f4b7b0c7c05a tempest-VolumeImageDependencyTests-1529416407 None] Flow 'volume_create_manager' (2d1b1427-8ec0-4744-bc1e-672d35083261) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:09:21 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-7c164dc2-b020-48b6-9fb0-f4b7b0c7c05a tempest-VolumeImageDependencyTests-1529416407 None] Created volume successfully. Jul 30 17:09:21 devstack sudo[108588]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9c8c1094-22a8-4dc4-a099-f6d51a1eb761 tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e128991-f914-4ce1-afcd-ee5c94acc301.97bf9932-af96-4d58-8c5c-bfe6c75323b4" returned: 0 in 0.257s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:21 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9c8c1094-22a8-4dc4-a099-f6d51a1eb761 tempest-ProjectMemberTests-1145856324 None] Lock "cinder-quobyte-97bf9932-af96-4d58-8c5c-bfe6c75323b4" released by "_delete_snapshot" :: held 1.463s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:21 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9c8c1094-22a8-4dc4-a099-f6d51a1eb761 tempest-ProjectMemberTests-1145856324 None] Lock "cinder-quobyte-0e128991-f914-4ce1-afcd-ee5c94acc301" released by "delete_snapshot" :: held 1.488s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:21 devstack sudo[108585]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ea289707-16f7-4a7c-9c46-c37e5b7126f2 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-06210903-8f4e-46fe-9f65-56c2dd123b1f 1073741824" returned: 0 in 0.442s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:21 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-9c8c1094-22a8-4dc4-a099-f6d51a1eb761 tempest-ProjectMemberTests-1145856324 None] Created reservations ['807ab2fa-7e11-4aab-ba56-d8cd1c8175ad', '7e6650b0-ff5c-40b6-96ae-8191fffc256d', '309c9148-8ac9-4faa-9b76-eb7f60f032e1', 'c7f2a2d1-9777-418e-a29b-7f754950d5bd'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:09:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ea289707-16f7-4a7c-9c46-c37e5b7126f2 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-06210903-8f4e-46fe-9f65-56c2dd123b1f {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:21 devstack sudo[108594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-06210903-8f4e-46fe-9f65-56c2dd123b1f Jul 30 17:09:21 devstack sudo[108594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:21 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-9c8c1094-22a8-4dc4-a099-f6d51a1eb761 tempest-ProjectMemberTests-1145856324 None] Delete snapshot completed successfully. Jul 30 17:09:21 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9c8c1094-22a8-4dc4-a099-f6d51a1eb761 tempest-ProjectMemberTests-1145856324 None] Lock "cinder-97bf9932-af96-4d58-8c5c-bfe6c75323b4-delete_snapshot" released by "delete_snapshot" :: held 1.646s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:21 devstack sudo[108594]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ea289707-16f7-4a7c-9c46-c37e5b7126f2 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-06210903-8f4e-46fe-9f65-56c2dd123b1f" returned: 0 in 0.257s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:21 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ea289707-16f7-4a7c-9c46-c37e5b7126f2 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:09:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ea289707-16f7-4a7c-9c46-c37e5b7126f2 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-fbeba419-eab5-4f6e-afa9-c537a447353b tempest-VolumeDependencyTests-500709084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.868s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ea289707-16f7-4a7c-9c46-c37e5b7126f2 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdf8855c-1d64-450d-a29e-12f73de9256d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06210903-8f4e-46fe-9f65-56c2dd123b1f', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ea289707-16f7-4a7c-9c46-c37e5b7126f2 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6f4f97f-f2d3-44a8-9ca1-3aba3953c007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:21 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-fbeba419-eab5-4f6e-afa9-c537a447353b tempest-VolumeDependencyTests-500709084 None] Creating offline snapshot b6f56336-1c43-459d-a07c-946ff751c3ca of volume ad9d489b-be22-4b8d-8480-c74bf5af8bff {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:09:21 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-ea289707-16f7-4a7c-9c46-c37e5b7126f2 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Volume volume-06210903-8f4e-46fe-9f65-56c2dd123b1f (06210903-8f4e-46fe-9f65-56c2dd123b1f): created successfully Jul 30 17:09:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ea289707-16f7-4a7c-9c46-c37e5b7126f2 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6f4f97f-f2d3-44a8-9ca1-3aba3953c007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ea289707-16f7-4a7c-9c46-c37e5b7126f2 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Flow 'volume_create_manager' (bdc8634a-7069-4b67-a7f8-d72d7fdf7cae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:09:21 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcac7497-0b89-4975-9132-9f7c1ba9db1a]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fbeba419-eab5-4f6e-afa9-c537a447353b tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:21 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-ea289707-16f7-4a7c-9c46-c37e5b7126f2 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Created volume successfully. Jul 30 17:09:21 devstack sudo[108597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff Jul 30 17:09:21 devstack sudo[108597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:22 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-63c0a0ff-4449-4edc-a479-1b90df270bda tempest-ProjectMemberTests-1145856324 None] Acquiring lock "cinder-0e128991-f914-4ce1-afcd-ee5c94acc301-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:22 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9e9ad716-1b11-420c-9d67-72289aafa325 tempest-VolumeImageDependencyTests-1529416407 None] Acquiring lock "cinder-55fbf6ca-597f-49fe-bb92-424af09ab2e1-delete_snapshot" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:22 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-63c0a0ff-4449-4edc-a479-1b90df270bda tempest-ProjectMemberTests-1145856324 None] Lock "cinder-0e128991-f914-4ce1-afcd-ee5c94acc301-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:22 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9e9ad716-1b11-420c-9d67-72289aafa325 tempest-VolumeImageDependencyTests-1529416407 None] Lock "cinder-55fbf6ca-597f-49fe-bb92-424af09ab2e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:22 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9e9ad716-1b11-420c-9d67-72289aafa325 tempest-VolumeImageDependencyTests-1529416407 None] Acquiring lock "cinder-quobyte-a9f56c8b-0fb4-4f83-8b50-a220707eb286" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:22 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9e9ad716-1b11-420c-9d67-72289aafa325 tempest-VolumeImageDependencyTests-1529416407 None] Lock "cinder-quobyte-a9f56c8b-0fb4-4f83-8b50-a220707eb286" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:22 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9e9ad716-1b11-420c-9d67-72289aafa325 tempest-VolumeImageDependencyTests-1529416407 None] Acquiring lock "cinder-quobyte-55fbf6ca-597f-49fe-bb92-424af09ab2e1" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:22 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9e9ad716-1b11-420c-9d67-72289aafa325 tempest-VolumeImageDependencyTests-1529416407 None] Lock "cinder-quobyte-55fbf6ca-597f-49fe-bb92-424af09ab2e1" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:22 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-9e9ad716-1b11-420c-9d67-72289aafa325 tempest-VolumeImageDependencyTests-1529416407 None] Deleting offline snapshot 55fbf6ca-597f-49fe-bb92-424af09ab2e1 of volume a9f56c8b-0fb4-4f83-8b50-a220707eb286 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:09:22 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-9e9ad716-1b11-420c-9d67-72289aafa325 tempest-VolumeImageDependencyTests-1529416407 None] snapshot_file for this snap is: volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286.55fbf6ca-597f-49fe-bb92-424af09ab2e1 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:09:22 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-63c0a0ff-4449-4edc-a479-1b90df270bda tempest-ProjectMemberTests-1145856324 None] Acquiring lock "cinder-quobyte-0e128991-f914-4ce1-afcd-ee5c94acc301" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:22 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e77bc6-c54b-49fb-92e8-a1c5aa7f4296]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9e9ad716-1b11-420c-9d67-72289aafa325 tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286.55fbf6ca-597f-49fe-bb92-424af09ab2e1 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:22 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-63c0a0ff-4449-4edc-a479-1b90df270bda tempest-ProjectMemberTests-1145856324 None] Lock "cinder-quobyte-0e128991-f914-4ce1-afcd-ee5c94acc301" acquired by "delete_volume" :: waited 0.038s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:22 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[271bb5fd-337d-4559-925e-5deacf3590ee]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:22 devstack sudo[108597]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-63c0a0ff-4449-4edc-a479-1b90df270bda tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e128991-f914-4ce1-afcd-ee5c94acc301 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fbeba419-eab5-4f6e-afa9-c537a447353b tempest-VolumeDependencyTests-500709084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff" returned: 0 in 0.463s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fbeba419-eab5-4f6e-afa9-c537a447353b tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff.b6f56336-1c43-459d-a07c-946ff751c3ca 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:22 devstack sudo[108605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff.b6f56336-1c43-459d-a07c-946ff751c3ca 1G Jul 30 17:09:22 devstack sudo[108602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286.55fbf6ca-597f-49fe-bb92-424af09ab2e1 Jul 30 17:09:22 devstack sudo[108602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:22 devstack sudo[108605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:22 devstack sudo[108604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e128991-f914-4ce1-afcd-ee5c94acc301 Jul 30 17:09:22 devstack sudo[108604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:22 devstack sudo[108602]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9e9ad716-1b11-420c-9d67-72289aafa325 tempest-VolumeImageDependencyTests-1529416407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286.55fbf6ca-597f-49fe-bb92-424af09ab2e1" returned: 0 in 0.383s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:22 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-9e9ad716-1b11-420c-9d67-72289aafa325 tempest-VolumeImageDependencyTests-1529416407 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:09:22 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[724139a4-51cc-4ae9-af36-7a97bf7926d0]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9e9ad716-1b11-420c-9d67-72289aafa325 tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:22 devstack sudo[108604]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-63c0a0ff-4449-4edc-a479-1b90df270bda tempest-ProjectMemberTests-1145856324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e128991-f914-4ce1-afcd-ee5c94acc301" returned: 0 in 0.392s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-63c0a0ff-4449-4edc-a479-1b90df270bda tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e128991-f914-4ce1-afcd-ee5c94acc301 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:22 devstack sudo[108622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e128991-f914-4ce1-afcd-ee5c94acc301 Jul 30 17:09:22 devstack sudo[108622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:22 devstack sudo[108605]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fbeba419-eab5-4f6e-afa9-c537a447353b tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff.b6f56336-1c43-459d-a07c-946ff751c3ca 1G" returned: 0 in 0.414s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fbeba419-eab5-4f6e-afa9-c537a447353b tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff.b6f56336-1c43-459d-a07c-946ff751c3ca {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:22 devstack sudo[108624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff.b6f56336-1c43-459d-a07c-946ff751c3ca Jul 30 17:09:22 devstack sudo[108624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:22 devstack sudo[108620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286 Jul 30 17:09:22 devstack sudo[108620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:22 devstack sudo[108622]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-63c0a0ff-4449-4edc-a479-1b90df270bda tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e128991-f914-4ce1-afcd-ee5c94acc301" returned: 0 in 0.295s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:23 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-63c0a0ff-4449-4edc-a479-1b90df270bda tempest-ProjectMemberTests-1145856324 None] Lock "cinder-quobyte-0e128991-f914-4ce1-afcd-ee5c94acc301" released by "delete_volume" :: held 0.759s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:23 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-63c0a0ff-4449-4edc-a479-1b90df270bda tempest-ProjectMemberTests-1145856324 None] Created reservations ['80cd70be-1268-48b0-9c9e-475081c2b96e', '7cff4707-712c-4b6d-9122-95ccdf0cbe25', 'd338e909-3417-4825-9ab4-df92cd49aad8', '5df72abd-b735-4306-8a7b-397cfb93bf5d'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:09:23 devstack sudo[108620]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9e9ad716-1b11-420c-9d67-72289aafa325 tempest-VolumeImageDependencyTests-1529416407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286" returned: 0 in 0.442s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9e9ad716-1b11-420c-9d67-72289aafa325 tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286.55fbf6ca-597f-49fe-bb92-424af09ab2e1 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:23 devstack sudo[108624]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fbeba419-eab5-4f6e-afa9-c537a447353b tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff.b6f56336-1c43-459d-a07c-946ff751c3ca" returned: 0 in 0.376s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:23 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-fbeba419-eab5-4f6e-afa9-c537a447353b tempest-VolumeDependencyTests-500709084 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff.b6f56336-1c43-459d-a07c-946ff751c3ca is being set with open permissions: ugo+rw Jul 30 17:09:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fbeba419-eab5-4f6e-afa9-c537a447353b tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff.b6f56336-1c43-459d-a07c-946ff751c3ca {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:23 devstack sudo[108634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286.55fbf6ca-597f-49fe-bb92-424af09ab2e1 Jul 30 17:09:23 devstack sudo[108634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:23 devstack sudo[108636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff.b6f56336-1c43-459d-a07c-946ff751c3ca Jul 30 17:09:23 devstack sudo[108636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-63c0a0ff-4449-4edc-a479-1b90df270bda tempest-ProjectMemberTests-1145856324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-63c0a0ff-4449-4edc-a479-1b90df270bda tempest-ProjectMemberTests-1145856324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:23 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-63c0a0ff-4449-4edc-a479-1b90df270bda tempest-ProjectMemberTests-1145856324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:23 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-63c0a0ff-4449-4edc-a479-1b90df270bda tempest-ProjectMemberTests-1145856324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-63c0a0ff-4449-4edc-a479-1b90df270bda tempest-ProjectMemberTests-1145856324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-63c0a0ff-4449-4edc-a479-1b90df270bda tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:23 devstack sudo[108638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:09:23 devstack sudo[108638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:23 devstack sudo[108634]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9e9ad716-1b11-420c-9d67-72289aafa325 tempest-VolumeImageDependencyTests-1529416407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286.55fbf6ca-597f-49fe-bb92-424af09ab2e1" returned: 0 in 0.433s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9e9ad716-1b11-420c-9d67-72289aafa325 tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286.55fbf6ca-597f-49fe-bb92-424af09ab2e1 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:23 devstack sudo[108638]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-63c0a0ff-4449-4edc-a479-1b90df270bda tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.337s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:23 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-63c0a0ff-4449-4edc-a479-1b90df270bda tempest-ProjectMemberTests-1145856324 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:09:23 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-63c0a0ff-4449-4edc-a479-1b90df270bda tempest-ProjectMemberTests-1145856324 None] Deleted volume successfully. Jul 30 17:09:23 devstack sudo[108646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286.55fbf6ca-597f-49fe-bb92-424af09ab2e1 Jul 30 17:09:23 devstack sudo[108646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:23 devstack sudo[108636]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fbeba419-eab5-4f6e-afa9-c537a447353b tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff.b6f56336-1c43-459d-a07c-946ff751c3ca" returned: 0 in 0.488s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:23 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-63c0a0ff-4449-4edc-a479-1b90df270bda tempest-ProjectMemberTests-1145856324 None] Lock "cinder-0e128991-f914-4ce1-afcd-ee5c94acc301-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fbeba419-eab5-4f6e-afa9-c537a447353b tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:23 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd299992-ff58-4cf9-ba6c-85b25b91c819 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:09:23 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-dd299992-ff58-4cf9-ba6c-85b25b91c819 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Flow 'volume_create_manager' (a381600a-c350-4653-b34e-6d32c4fe38d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:09:23 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-dd299992-ff58-4cf9-ba6c-85b25b91c819 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c11adef5-9451-4833-9ff9-016d88f2585c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:23 devstack sudo[108648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff.info Jul 30 17:09:23 devstack sudo[108648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:23 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-dd299992-ff58-4cf9-ba6c-85b25b91c819 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c11adef5-9451-4833-9ff9-016d88f2585c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1164665379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=679c27e4-300b-4482-82fb-2a7e06656390,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea66f9219b4644f59fff959929a1ef22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:09:24Z,use_quota=True,user_id='c2b9de048ee84761b71c9bf4fda93c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:23 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-dd299992-ff58-4cf9-ba6c-85b25b91c819 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4f0f839-a846-417c-8a1d-59af0c738a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:23 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-dd299992-ff58-4cf9-ba6c-85b25b91c819 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4f0f839-a846-417c-8a1d-59af0c738a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:23 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-dd299992-ff58-4cf9-ba6c-85b25b91c819 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74cca879-888e-4e07-b522-bc128b7996d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:23 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-dd299992-ff58-4cf9-ba6c-85b25b91c819 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74cca879-888e-4e07-b522-bc128b7996d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '679c27e4-300b-4482-82fb-2a7e06656390', 'volume_name': 'volume-679c27e4-300b-4482-82fb-2a7e06656390', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:23 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-dd299992-ff58-4cf9-ba6c-85b25b91c819 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35fee240-b9f0-44d5-9dcc-50c5c8dd752c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:23 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-dd299992-ff58-4cf9-ba6c-85b25b91c819 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35fee240-b9f0-44d5-9dcc-50c5c8dd752c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:23 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-dd299992-ff58-4cf9-ba6c-85b25b91c819 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22e419c2-d88d-4f13-88b2-b8e2be9f1c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:23 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-dd299992-ff58-4cf9-ba6c-85b25b91c819 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Volume 679c27e4-300b-4482-82fb-2a7e06656390: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-679c27e4-300b-4482-82fb-2a7e06656390', 'volume_size': 1} Jul 30 17:09:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-dd299992-ff58-4cf9-ba6c-85b25b91c819 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:23 devstack sudo[108646]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9e9ad716-1b11-420c-9d67-72289aafa325 tempest-VolumeImageDependencyTests-1529416407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286.55fbf6ca-597f-49fe-bb92-424af09ab2e1" returned: 0 in 0.359s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:23 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9e9ad716-1b11-420c-9d67-72289aafa325 tempest-VolumeImageDependencyTests-1529416407 None] Lock "cinder-quobyte-55fbf6ca-597f-49fe-bb92-424af09ab2e1" released by "_delete_snapshot" :: held 1.768s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:23 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9e9ad716-1b11-420c-9d67-72289aafa325 tempest-VolumeImageDependencyTests-1529416407 None] Lock "cinder-quobyte-a9f56c8b-0fb4-4f83-8b50-a220707eb286" released by "delete_snapshot" :: held 1.798s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:24 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-9e9ad716-1b11-420c-9d67-72289aafa325 tempest-VolumeImageDependencyTests-1529416407 None] Created reservations ['911a0a6f-e412-4798-8539-b8d070ac6927', '261cf881-caa8-4f63-8f72-fbff42051fb8', 'd17a74f0-bf34-43e0-9b67-bc862361b7e9', 'b9e32b11-5421-48cb-b535-99dcea191064'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:09:24 devstack sudo[108648]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fbeba419-eab5-4f6e-afa9-c537a447353b tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff.info" returned: 0 in 0.462s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:24 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-fbeba419-eab5-4f6e-afa9-c537a447353b tempest-VolumeDependencyTests-500709084 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff.info is being set with open permissions: ugo+rw Jul 30 17:09:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fbeba419-eab5-4f6e-afa9-c537a447353b tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:24 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-9e9ad716-1b11-420c-9d67-72289aafa325 tempest-VolumeImageDependencyTests-1529416407 None] Delete snapshot completed successfully. Jul 30 17:09:24 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9e9ad716-1b11-420c-9d67-72289aafa325 tempest-VolumeImageDependencyTests-1529416407 None] Lock "cinder-55fbf6ca-597f-49fe-bb92-424af09ab2e1-delete_snapshot" released by "delete_snapshot" :: held 2.054s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:24 devstack sudo[108652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff.info Jul 30 17:09:24 devstack sudo[108652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:24 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-dff1b75d-8f7f-470e-9f31-6e4ddd8b4949 tempest-VolumeImageDependencyTests-1529416407 None] Acquiring lock "cinder-6212e360-87db-4447-bf66-2db389a7ba35-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:24 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-dff1b75d-8f7f-470e-9f31-6e4ddd8b4949 tempest-VolumeImageDependencyTests-1529416407 None] Lock "cinder-6212e360-87db-4447-bf66-2db389a7ba35-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:24 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-dff1b75d-8f7f-470e-9f31-6e4ddd8b4949 tempest-VolumeImageDependencyTests-1529416407 None] Acquiring lock "cinder-quobyte-6212e360-87db-4447-bf66-2db389a7ba35" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:24 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-dff1b75d-8f7f-470e-9f31-6e4ddd8b4949 tempest-VolumeImageDependencyTests-1529416407 None] Lock "cinder-quobyte-6212e360-87db-4447-bf66-2db389a7ba35" acquired by "delete_volume" :: waited 0.021s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:24 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de2ef94-e395-43f2-b7e5-567e349368b8]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dff1b75d-8f7f-470e-9f31-6e4ddd8b4949 tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-6212e360-87db-4447-bf66-2db389a7ba35 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:24 devstack sudo[108652]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fbeba419-eab5-4f6e-afa9-c537a447353b tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff.info" returned: 0 in 0.402s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-fbeba419-eab5-4f6e-afa9-c537a447353b tempest-VolumeDependencyTests-500709084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.778s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-dd299992-ff58-4cf9-ba6c-85b25b91c819 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.780s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:24 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-dd299992-ff58-4cf9-ba6c-85b25b91c819 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1164665379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=679c27e4-300b-4482-82fb-2a7e06656390,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea66f9219b4644f59fff959929a1ef22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:09:24Z,use_quota=True,user_id='c2b9de048ee84761b71c9bf4fda93c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:09:24 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-dd299992-ff58-4cf9-ba6c-85b25b91c819 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Creating volume 679c27e4-300b-4482-82fb-2a7e06656390 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:09:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-dd299992-ff58-4cf9-ba6c-85b25b91c819 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-dd299992-ff58-4cf9-ba6c-85b25b91c819 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:24 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-dd299992-ff58-4cf9-ba6c-85b25b91c819 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:24 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-dd299992-ff58-4cf9-ba6c-85b25b91c819 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-dd299992-ff58-4cf9-ba6c-85b25b91c819 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:24 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-dd299992-ff58-4cf9-ba6c-85b25b91c819 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:09:24 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-dd299992-ff58-4cf9-ba6c-85b25b91c819 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:09:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dd299992-ff58-4cf9-ba6c-85b25b91c819 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-679c27e4-300b-4482-82fb-2a7e06656390 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:24 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-b47dee6e-d4ec-4ef6-8783-8407dead3327 tempest-ProjectMemberTests-1145856324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:09:24 devstack sudo[108656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-6212e360-87db-4447-bf66-2db389a7ba35 Jul 30 17:09:24 devstack sudo[108656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b47dee6e-d4ec-4ef6-8783-8407dead3327 tempest-ProjectMemberTests-1145856324 None] Flow 'volume_create_manager' (db340f3c-41bf-4c60-9a5a-377fa0f60882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:09:24 devstack sudo[108658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-679c27e4-300b-4482-82fb-2a7e06656390 1073741824 Jul 30 17:09:24 devstack sudo[108658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b47dee6e-d4ec-4ef6-8783-8407dead3327 tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaf74dcf-86ae-45e9-97c0-a3379ea84374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b47dee6e-d4ec-4ef6-8783-8407dead3327 tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaf74dcf-86ae-45e9-97c0-a3379ea84374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1156682539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9331e48e-13ba-48f2-b248-de0e2a752354,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26c22addd8364bc982bc8002f431ee32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:09:24Z,use_quota=True,user_id='c9da4889b5dd47d3bb88b442a104a944',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b47dee6e-d4ec-4ef6-8783-8407dead3327 tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d8e267b-4ed1-4b0b-9e9f-54792b0bb3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b47dee6e-d4ec-4ef6-8783-8407dead3327 tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d8e267b-4ed1-4b0b-9e9f-54792b0bb3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b47dee6e-d4ec-4ef6-8783-8407dead3327 tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8a1fb99-9394-4fb5-9746-dbc878a47f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b47dee6e-d4ec-4ef6-8783-8407dead3327 tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8a1fb99-9394-4fb5-9746-dbc878a47f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9331e48e-13ba-48f2-b248-de0e2a752354', 'volume_name': 'volume-9331e48e-13ba-48f2-b248-de0e2a752354', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b47dee6e-d4ec-4ef6-8783-8407dead3327 tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6cf8347-e6d6-49bd-9738-172514f43f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b47dee6e-d4ec-4ef6-8783-8407dead3327 tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6cf8347-e6d6-49bd-9738-172514f43f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b47dee6e-d4ec-4ef6-8783-8407dead3327 tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4638b7fc-d964-4a6b-a4e0-722a13b3cf1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:24 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-b47dee6e-d4ec-4ef6-8783-8407dead3327 tempest-ProjectMemberTests-1145856324 None] Volume 9331e48e-13ba-48f2-b248-de0e2a752354: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9331e48e-13ba-48f2-b248-de0e2a752354', 'volume_size': 1} Jul 30 17:09:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b47dee6e-d4ec-4ef6-8783-8407dead3327 tempest-ProjectMemberTests-1145856324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:24 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-fbeba419-eab5-4f6e-afa9-c537a447353b tempest-VolumeDependencyTests-500709084 None] Create snapshot completed successfully Jul 30 17:09:24 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-85cb4afc-1b89-46c3-90ff-70735c407dc1 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:09:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-85cb4afc-1b89-46c3-90ff-70735c407dc1 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Flow 'volume_create_manager' (152c74a0-3207-4fc0-a3fa-f73e926b35ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:09:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-85cb4afc-1b89-46c3-90ff-70735c407dc1 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f48b3ab-4a38-4c2f-bb4a-3fa040e58950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-85cb4afc-1b89-46c3-90ff-70735c407dc1 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f48b3ab-4a38-4c2f-bb4a-3fa040e58950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2007459087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=079a0997-fa22-4f9a-a74c-7b816341083d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea66f9219b4644f59fff959929a1ef22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:09:25Z,use_quota=True,user_id='c2b9de048ee84761b71c9bf4fda93c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-85cb4afc-1b89-46c3-90ff-70735c407dc1 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95ce6f13-24a5-4691-922d-d4d5c7eedf94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-85cb4afc-1b89-46c3-90ff-70735c407dc1 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95ce6f13-24a5-4691-922d-d4d5c7eedf94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-85cb4afc-1b89-46c3-90ff-70735c407dc1 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08fe40e3-0276-40f6-a8ba-9e7d8515b8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-85cb4afc-1b89-46c3-90ff-70735c407dc1 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08fe40e3-0276-40f6-a8ba-9e7d8515b8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '079a0997-fa22-4f9a-a74c-7b816341083d', 'volume_name': 'volume-079a0997-fa22-4f9a-a74c-7b816341083d', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-85cb4afc-1b89-46c3-90ff-70735c407dc1 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c78fed77-f09e-4360-bf48-136ba44fdbed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-85cb4afc-1b89-46c3-90ff-70735c407dc1 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c78fed77-f09e-4360-bf48-136ba44fdbed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:24 devstack sudo[108656]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:24 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-85cb4afc-1b89-46c3-90ff-70735c407dc1 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13b4e8d6-aaa5-435e-bae2-2d48de2078b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:24 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-85cb4afc-1b89-46c3-90ff-70735c407dc1 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Volume 079a0997-fa22-4f9a-a74c-7b816341083d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-079a0997-fa22-4f9a-a74c-7b816341083d', 'volume_size': 1} Jul 30 17:09:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-85cb4afc-1b89-46c3-90ff-70735c407dc1 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dff1b75d-8f7f-470e-9f31-6e4ddd8b4949 tempest-VolumeImageDependencyTests-1529416407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-6212e360-87db-4447-bf66-2db389a7ba35" returned: 0 in 0.486s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dff1b75d-8f7f-470e-9f31-6e4ddd8b4949 tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-6212e360-87db-4447-bf66-2db389a7ba35 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:24 devstack sudo[108667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-6212e360-87db-4447-bf66-2db389a7ba35 Jul 30 17:09:24 devstack sudo[108667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-52d56d02-2200-4832-be25-04110a2fa6d4 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-52d56d02-2200-4832-be25-04110a2fa6d4 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Flow 'volume_create_manager' (d04d5423-c39f-45c4-8e13-5723eb3ece71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-52d56d02-2200-4832-be25-04110a2fa6d4 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd0be593-de33-4895-9a9e-963e2e9a7c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-52d56d02-2200-4832-be25-04110a2fa6d4 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd0be593-de33-4895-9a9e-963e2e9a7c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-854632142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b2d3942-6b87-4d81-a155-5deaefaa2a2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea66f9219b4644f59fff959929a1ef22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:09:25Z,use_quota=True,user_id='c2b9de048ee84761b71c9bf4fda93c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-52d56d02-2200-4832-be25-04110a2fa6d4 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (397c29fc-1989-4762-9f54-94b8436d8fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-52d56d02-2200-4832-be25-04110a2fa6d4 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (397c29fc-1989-4762-9f54-94b8436d8fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-52d56d02-2200-4832-be25-04110a2fa6d4 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c43010f-2740-408c-8c67-ed964591884d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-52d56d02-2200-4832-be25-04110a2fa6d4 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c43010f-2740-408c-8c67-ed964591884d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b2d3942-6b87-4d81-a155-5deaefaa2a2b', 'volume_name': 'volume-8b2d3942-6b87-4d81-a155-5deaefaa2a2b', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-52d56d02-2200-4832-be25-04110a2fa6d4 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae6bac55-9ee8-47e6-a1c8-f185443ab670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:25 devstack sudo[108658]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-52d56d02-2200-4832-be25-04110a2fa6d4 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae6bac55-9ee8-47e6-a1c8-f185443ab670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-52d56d02-2200-4832-be25-04110a2fa6d4 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9761fe1-16ad-4534-879a-fd40f5b705ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:25 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-52d56d02-2200-4832-be25-04110a2fa6d4 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Volume 8b2d3942-6b87-4d81-a155-5deaefaa2a2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b2d3942-6b87-4d81-a155-5deaefaa2a2b', 'volume_size': 1} Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-52d56d02-2200-4832-be25-04110a2fa6d4 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dd299992-ff58-4cf9-ba6c-85b25b91c819 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-679c27e4-300b-4482-82fb-2a7e06656390 1073741824" returned: 0 in 0.628s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dd299992-ff58-4cf9-ba6c-85b25b91c819 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-679c27e4-300b-4482-82fb-2a7e06656390 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:25 devstack sudo[108670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-679c27e4-300b-4482-82fb-2a7e06656390 Jul 30 17:09:25 devstack sudo[108670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f037ea8-84cd-4970-95e2-a5c65be018e6 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:09:25 devstack sudo[108667]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7f037ea8-84cd-4970-95e2-a5c65be018e6 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Flow 'volume_create_manager' (b16ff854-6ccb-41d3-9553-dc096521310c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7f037ea8-84cd-4970-95e2-a5c65be018e6 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (471f19a0-97b9-4010-b9d2-a71ad473f45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dff1b75d-8f7f-470e-9f31-6e4ddd8b4949 tempest-VolumeImageDependencyTests-1529416407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-6212e360-87db-4447-bf66-2db389a7ba35" returned: 0 in 0.498s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7f037ea8-84cd-4970-95e2-a5c65be018e6 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (471f19a0-97b9-4010-b9d2-a71ad473f45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2133581917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b024e28c-365e-440c-a2bc-a6ead06cdc7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea66f9219b4644f59fff959929a1ef22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:09:25Z,use_quota=True,user_id='c2b9de048ee84761b71c9bf4fda93c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7f037ea8-84cd-4970-95e2-a5c65be018e6 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58d6aad7-1eb2-4e5c-9c5a-117615d62087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7f037ea8-84cd-4970-95e2-a5c65be018e6 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58d6aad7-1eb2-4e5c-9c5a-117615d62087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7f037ea8-84cd-4970-95e2-a5c65be018e6 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a751097b-346a-486e-8828-068ea160f6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7f037ea8-84cd-4970-95e2-a5c65be018e6 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a751097b-346a-486e-8828-068ea160f6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b024e28c-365e-440c-a2bc-a6ead06cdc7e', 'volume_name': 'volume-b024e28c-365e-440c-a2bc-a6ead06cdc7e', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7f037ea8-84cd-4970-95e2-a5c65be018e6 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d89ba233-8dd4-48bc-be15-847acf50c4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7f037ea8-84cd-4970-95e2-a5c65be018e6 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d89ba233-8dd4-48bc-be15-847acf50c4a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7f037ea8-84cd-4970-95e2-a5c65be018e6 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bc54f6f-eae6-47e0-8bff-009f886b1f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:25 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-7f037ea8-84cd-4970-95e2-a5c65be018e6 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Volume b024e28c-365e-440c-a2bc-a6ead06cdc7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b024e28c-365e-440c-a2bc-a6ead06cdc7e', 'volume_size': 1} Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7f037ea8-84cd-4970-95e2-a5c65be018e6 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-dff1b75d-8f7f-470e-9f31-6e4ddd8b4949 tempest-VolumeImageDependencyTests-1529416407 None] Lock "cinder-quobyte-6212e360-87db-4447-bf66-2db389a7ba35" released by "delete_volume" :: held 1.145s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:25 devstack sudo[108670]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dd299992-ff58-4cf9-ba6c-85b25b91c819 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-679c27e4-300b-4482-82fb-2a7e06656390" returned: 0 in 0.349s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-dd299992-ff58-4cf9-ba6c-85b25b91c819 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-dd299992-ff58-4cf9-ba6c-85b25b91c819 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b47dee6e-d4ec-4ef6-8783-8407dead3327 tempest-ProjectMemberTests-1145856324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.874s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b47dee6e-d4ec-4ef6-8783-8407dead3327 tempest-ProjectMemberTests-1145856324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1156682539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9331e48e-13ba-48f2-b248-de0e2a752354,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26c22addd8364bc982bc8002f431ee32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:09:24Z,use_quota=True,user_id='c9da4889b5dd47d3bb88b442a104a944',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-b47dee6e-d4ec-4ef6-8783-8407dead3327 tempest-ProjectMemberTests-1145856324 None] Creating volume 9331e48e-13ba-48f2-b248-de0e2a752354 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b47dee6e-d4ec-4ef6-8783-8407dead3327 tempest-ProjectMemberTests-1145856324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b47dee6e-d4ec-4ef6-8783-8407dead3327 tempest-ProjectMemberTests-1145856324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b47dee6e-d4ec-4ef6-8783-8407dead3327 tempest-ProjectMemberTests-1145856324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b47dee6e-d4ec-4ef6-8783-8407dead3327 tempest-ProjectMemberTests-1145856324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b47dee6e-d4ec-4ef6-8783-8407dead3327 tempest-ProjectMemberTests-1145856324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b47dee6e-d4ec-4ef6-8783-8407dead3327 tempest-ProjectMemberTests-1145856324 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:09:25 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-b47dee6e-d4ec-4ef6-8783-8407dead3327 tempest-ProjectMemberTests-1145856324 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b47dee6e-d4ec-4ef6-8783-8407dead3327 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9331e48e-13ba-48f2-b248-de0e2a752354 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-dff1b75d-8f7f-470e-9f31-6e4ddd8b4949 tempest-VolumeImageDependencyTests-1529416407 None] Created reservations ['4a404f4f-ea2f-4bd1-a1fc-fe498d0c8704', '1b0c180f-21fb-4ac5-a05e-125a3800a936', 'fad877ca-6713-417a-b098-f614e54c4f8c', '02333ea2-4d37-4694-ae86-2e4e75dd16df'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:09:25 devstack sudo[108674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9331e48e-13ba-48f2-b248-de0e2a752354 1073741824 Jul 30 17:09:25 devstack sudo[108674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-dd299992-ff58-4cf9-ba6c-85b25b91c819 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22e419c2-d88d-4f13-88b2-b8e2be9f1c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-679c27e4-300b-4482-82fb-2a7e06656390', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-dd299992-ff58-4cf9-ba6c-85b25b91c819 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c1531f9-d9c7-493e-80b9-e6e266e899e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:25 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-dd299992-ff58-4cf9-ba6c-85b25b91c819 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Volume volume-679c27e4-300b-4482-82fb-2a7e06656390 (679c27e4-300b-4482-82fb-2a7e06656390): created successfully Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-dd299992-ff58-4cf9-ba6c-85b25b91c819 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c1531f9-d9c7-493e-80b9-e6e266e899e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-dd299992-ff58-4cf9-ba6c-85b25b91c819 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Flow 'volume_create_manager' (a381600a-c350-4653-b34e-6d32c4fe38d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:09:25 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-dd299992-ff58-4cf9-ba6c-85b25b91c819 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Created volume successfully. Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b22187f-18f1-40fc-8b42-20ca28f1223c tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5b22187f-18f1-40fc-8b42-20ca28f1223c tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Flow 'volume_create_manager' (8faed377-8367-4ddc-879c-737e5accefe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5b22187f-18f1-40fc-8b42-20ca28f1223c tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cc5850a-b27d-434a-8af9-1bd0cca7a936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5b22187f-18f1-40fc-8b42-20ca28f1223c tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cc5850a-b27d-434a-8af9-1bd0cca7a936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1950147191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f17aab98-651a-41be-a256-cc0fa2180fdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea66f9219b4644f59fff959929a1ef22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:09:26Z,use_quota=True,user_id='c2b9de048ee84761b71c9bf4fda93c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5b22187f-18f1-40fc-8b42-20ca28f1223c tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7189d734-9b2c-404c-993c-b58973c38964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5b22187f-18f1-40fc-8b42-20ca28f1223c tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7189d734-9b2c-404c-993c-b58973c38964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5b22187f-18f1-40fc-8b42-20ca28f1223c tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c588bc52-3e90-4e90-8c5c-86c4f0b7d37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5b22187f-18f1-40fc-8b42-20ca28f1223c tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c588bc52-3e90-4e90-8c5c-86c4f0b7d37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f17aab98-651a-41be-a256-cc0fa2180fdf', 'volume_name': 'volume-f17aab98-651a-41be-a256-cc0fa2180fdf', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5b22187f-18f1-40fc-8b42-20ca28f1223c tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a25a7014-9c07-4cd4-81b0-ba07af218dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5b22187f-18f1-40fc-8b42-20ca28f1223c tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a25a7014-9c07-4cd4-81b0-ba07af218dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5b22187f-18f1-40fc-8b42-20ca28f1223c tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39805065-de83-4732-9d59-76d9141276f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:25 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-5b22187f-18f1-40fc-8b42-20ca28f1223c tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Volume f17aab98-651a-41be-a256-cc0fa2180fdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f17aab98-651a-41be-a256-cc0fa2180fdf', 'volume_size': 1} Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5b22187f-18f1-40fc-8b42-20ca28f1223c tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-dff1b75d-8f7f-470e-9f31-6e4ddd8b4949 tempest-VolumeImageDependencyTests-1529416407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-dff1b75d-8f7f-470e-9f31-6e4ddd8b4949 tempest-VolumeImageDependencyTests-1529416407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-dff1b75d-8f7f-470e-9f31-6e4ddd8b4949 tempest-VolumeImageDependencyTests-1529416407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-dff1b75d-8f7f-470e-9f31-6e4ddd8b4949 tempest-VolumeImageDependencyTests-1529416407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-dff1b75d-8f7f-470e-9f31-6e4ddd8b4949 tempest-VolumeImageDependencyTests-1529416407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dff1b75d-8f7f-470e-9f31-6e4ddd8b4949 tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:25 devstack sudo[108676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:09:25 devstack sudo[108676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7db06e8-a711-4d51-b308-56151772abd8 tempest-VolumeDependencyTests-500709084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-e7db06e8-a711-4d51-b308-56151772abd8 tempest-VolumeDependencyTests-500709084 None] Flow 'volume_create_manager' (1f798759-89d9-40f6-89d3-c5431c7e100f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:09:25 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-e7db06e8-a711-4d51-b308-56151772abd8 tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8be485a3-98db-4e95-bab6-d0b1c3b85b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-e7db06e8-a711-4d51-b308-56151772abd8 tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8be485a3-98db-4e95-bab6-d0b1c3b85b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-114723330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cea10c9-b035-46ee-b30f-1b3af9b38b59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75be733264504175956c041c2312fa52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b6f56336-1c43-459d-a07c-946ff751c3ca,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:09:26Z,use_quota=True,user_id='9ee0dab1317a4cfeafb4f6b50ca81a57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-e7db06e8-a711-4d51-b308-56151772abd8 tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afd75156-fe49-48e3-b248-4cd8a45fdb30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-e7db06e8-a711-4d51-b308-56151772abd8 tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afd75156-fe49-48e3-b248-4cd8a45fdb30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-e7db06e8-a711-4d51-b308-56151772abd8 tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28924fd3-eb87-4e40-a0be-add87ed42b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-e7db06e8-a711-4d51-b308-56151772abd8 tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28924fd3-eb87-4e40-a0be-add87ed42b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3cea10c9-b035-46ee-b30f-1b3af9b38b59', 'volume_name': 'volume-3cea10c9-b035-46ee-b30f-1b3af9b38b59', 'volume_size': 1, 'snapshot_id': 'b6f56336-1c43-459d-a07c-946ff751c3ca'}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-e7db06e8-a711-4d51-b308-56151772abd8 tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1880d56-3e49-4291-86c6-bfef1ee1bc3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-e7db06e8-a711-4d51-b308-56151772abd8 tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1880d56-3e49-4291-86c6-bfef1ee1bc3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-e7db06e8-a711-4d51-b308-56151772abd8 tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3e9802b-7870-47e8-9a59-95c7124573bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:26 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-e7db06e8-a711-4d51-b308-56151772abd8 tempest-VolumeDependencyTests-500709084 None] Volume 3cea10c9-b035-46ee-b30f-1b3af9b38b59: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3cea10c9-b035-46ee-b30f-1b3af9b38b59', 'volume_size': 1, 'snapshot_id': 'b6f56336-1c43-459d-a07c-946ff751c3ca'} Jul 30 17:09:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-e7db06e8-a711-4d51-b308-56151772abd8 tempest-VolumeDependencyTests-500709084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:26 devstack sudo[108674]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b47dee6e-d4ec-4ef6-8783-8407dead3327 tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9331e48e-13ba-48f2-b248-de0e2a752354 1073741824" returned: 0 in 0.525s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b47dee6e-d4ec-4ef6-8783-8407dead3327 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9331e48e-13ba-48f2-b248-de0e2a752354 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:26 devstack sudo[108676]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dff1b75d-8f7f-470e-9f31-6e4ddd8b4949 tempest-VolumeImageDependencyTests-1529416407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.314s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:26 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-dff1b75d-8f7f-470e-9f31-6e4ddd8b4949 tempest-VolumeImageDependencyTests-1529416407 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:09:26 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-dff1b75d-8f7f-470e-9f31-6e4ddd8b4949 tempest-VolumeImageDependencyTests-1529416407 None] Deleted volume successfully. Jul 30 17:09:26 devstack sudo[108683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9331e48e-13ba-48f2-b248-de0e2a752354 Jul 30 17:09:26 devstack sudo[108683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:26 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-dff1b75d-8f7f-470e-9f31-6e4ddd8b4949 tempest-VolumeImageDependencyTests-1529416407 None] Lock "cinder-6212e360-87db-4447-bf66-2db389a7ba35-delete_volume" released by "delete_volume" :: held 1.913s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:26 devstack sudo[108683]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b47dee6e-d4ec-4ef6-8783-8407dead3327 tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9331e48e-13ba-48f2-b248-de0e2a752354" returned: 0 in 0.254s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:26 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b47dee6e-d4ec-4ef6-8783-8407dead3327 tempest-ProjectMemberTests-1145856324 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:09:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b47dee6e-d4ec-4ef6-8783-8407dead3327 tempest-ProjectMemberTests-1145856324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-85cb4afc-1b89-46c3-90ff-70735c407dc1 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.501s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:26 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-85cb4afc-1b89-46c3-90ff-70735c407dc1 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2007459087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=079a0997-fa22-4f9a-a74c-7b816341083d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea66f9219b4644f59fff959929a1ef22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:09:25Z,use_quota=True,user_id='c2b9de048ee84761b71c9bf4fda93c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:09:26 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-85cb4afc-1b89-46c3-90ff-70735c407dc1 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Creating volume 079a0997-fa22-4f9a-a74c-7b816341083d {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:09:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-85cb4afc-1b89-46c3-90ff-70735c407dc1 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-85cb4afc-1b89-46c3-90ff-70735c407dc1 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:26 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-85cb4afc-1b89-46c3-90ff-70735c407dc1 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:26 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-85cb4afc-1b89-46c3-90ff-70735c407dc1 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-85cb4afc-1b89-46c3-90ff-70735c407dc1 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:26 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-85cb4afc-1b89-46c3-90ff-70735c407dc1 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:09:26 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-85cb4afc-1b89-46c3-90ff-70735c407dc1 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:09:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-85cb4afc-1b89-46c3-90ff-70735c407dc1 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-079a0997-fa22-4f9a-a74c-7b816341083d 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b47dee6e-d4ec-4ef6-8783-8407dead3327 tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4638b7fc-d964-4a6b-a4e0-722a13b3cf1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9331e48e-13ba-48f2-b248-de0e2a752354', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:26 devstack sudo[108686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-079a0997-fa22-4f9a-a74c-7b816341083d 1073741824 Jul 30 17:09:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b47dee6e-d4ec-4ef6-8783-8407dead3327 tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ce4ddcc-d7f4-4aa4-8776-89d55b4469fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:26 devstack sudo[108686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:26 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-b47dee6e-d4ec-4ef6-8783-8407dead3327 tempest-ProjectMemberTests-1145856324 None] Volume volume-9331e48e-13ba-48f2-b248-de0e2a752354 (9331e48e-13ba-48f2-b248-de0e2a752354): created successfully Jul 30 17:09:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b47dee6e-d4ec-4ef6-8783-8407dead3327 tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ce4ddcc-d7f4-4aa4-8776-89d55b4469fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:26 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-b47dee6e-d4ec-4ef6-8783-8407dead3327 tempest-ProjectMemberTests-1145856324 None] Flow 'volume_create_manager' (db340f3c-41bf-4c60-9a5a-377fa0f60882) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:09:26 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-b47dee6e-d4ec-4ef6-8783-8407dead3327 tempest-ProjectMemberTests-1145856324 None] Created volume successfully. Jul 30 17:09:26 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-3fa2e711-f9ec-4d56-8f80-8941494acfcd tempest-VolumeImageDependencyTests-1529416407 None] Acquiring lock "cinder-a9f56c8b-0fb4-4f83-8b50-a220707eb286-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:26 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-3fa2e711-f9ec-4d56-8f80-8941494acfcd tempest-VolumeImageDependencyTests-1529416407 None] Lock "cinder-a9f56c8b-0fb4-4f83-8b50-a220707eb286-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:26 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-3fa2e711-f9ec-4d56-8f80-8941494acfcd tempest-VolumeImageDependencyTests-1529416407 None] Acquiring lock "cinder-quobyte-a9f56c8b-0fb4-4f83-8b50-a220707eb286" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:26 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-3fa2e711-f9ec-4d56-8f80-8941494acfcd tempest-VolumeImageDependencyTests-1529416407 None] Lock "cinder-quobyte-a9f56c8b-0fb4-4f83-8b50-a220707eb286" acquired by "delete_volume" :: waited 0.017s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:26 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b4cb9f-76bd-4795-8667-00f92dc56638]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3fa2e711-f9ec-4d56-8f80-8941494acfcd tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:26 devstack sudo[108686]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-85cb4afc-1b89-46c3-90ff-70735c407dc1 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-079a0997-fa22-4f9a-a74c-7b816341083d 1073741824" returned: 0 in 0.469s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-85cb4afc-1b89-46c3-90ff-70735c407dc1 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-079a0997-fa22-4f9a-a74c-7b816341083d {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:26 devstack sudo[108693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-079a0997-fa22-4f9a-a74c-7b816341083d Jul 30 17:09:26 devstack sudo[108693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:26 devstack sudo[108692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286 Jul 30 17:09:26 devstack sudo[108692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:27 devstack sudo[108693]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-85cb4afc-1b89-46c3-90ff-70735c407dc1 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-079a0997-fa22-4f9a-a74c-7b816341083d" returned: 0 in 0.272s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:27 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-85cb4afc-1b89-46c3-90ff-70735c407dc1 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:09:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-85cb4afc-1b89-46c3-90ff-70735c407dc1 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-52d56d02-2200-4832-be25-04110a2fa6d4 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.031s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:27 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-52d56d02-2200-4832-be25-04110a2fa6d4 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-854632142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b2d3942-6b87-4d81-a155-5deaefaa2a2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea66f9219b4644f59fff959929a1ef22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:09:25Z,use_quota=True,user_id='c2b9de048ee84761b71c9bf4fda93c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:09:27 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-52d56d02-2200-4832-be25-04110a2fa6d4 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Creating volume 8b2d3942-6b87-4d81-a155-5deaefaa2a2b {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:09:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-52d56d02-2200-4832-be25-04110a2fa6d4 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-52d56d02-2200-4832-be25-04110a2fa6d4 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:27 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-52d56d02-2200-4832-be25-04110a2fa6d4 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:27 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-52d56d02-2200-4832-be25-04110a2fa6d4 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-52d56d02-2200-4832-be25-04110a2fa6d4 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:27 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-52d56d02-2200-4832-be25-04110a2fa6d4 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:09:27 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-52d56d02-2200-4832-be25-04110a2fa6d4 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:09:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-52d56d02-2200-4832-be25-04110a2fa6d4 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b2d3942-6b87-4d81-a155-5deaefaa2a2b 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:27 devstack sudo[108692]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:27 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-85cb4afc-1b89-46c3-90ff-70735c407dc1 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13b4e8d6-aaa5-435e-bae2-2d48de2078b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-079a0997-fa22-4f9a-a74c-7b816341083d', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:27 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-85cb4afc-1b89-46c3-90ff-70735c407dc1 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea3f6d5a-904d-44ba-b856-b02ea4153574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:27 devstack sudo[108700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b2d3942-6b87-4d81-a155-5deaefaa2a2b 1073741824 Jul 30 17:09:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3fa2e711-f9ec-4d56-8f80-8941494acfcd tempest-VolumeImageDependencyTests-1529416407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286" returned: 0 in 0.430s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3fa2e711-f9ec-4d56-8f80-8941494acfcd tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:27 devstack sudo[108700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:27 devstack sudo[108702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286 Jul 30 17:09:27 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-85cb4afc-1b89-46c3-90ff-70735c407dc1 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Volume volume-079a0997-fa22-4f9a-a74c-7b816341083d (079a0997-fa22-4f9a-a74c-7b816341083d): created successfully Jul 30 17:09:27 devstack sudo[108702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:27 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-85cb4afc-1b89-46c3-90ff-70735c407dc1 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea3f6d5a-904d-44ba-b856-b02ea4153574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:27 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-85cb4afc-1b89-46c3-90ff-70735c407dc1 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Flow 'volume_create_manager' (152c74a0-3207-4fc0-a3fa-f73e926b35ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:09:27 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-85cb4afc-1b89-46c3-90ff-70735c407dc1 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Created volume successfully. Jul 30 17:09:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5a465a3d-c16a-4f31-a013-1fee5db68abd tempest-ProjectMemberTests-1145856324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:27 devstack sudo[108702]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3fa2e711-f9ec-4d56-8f80-8941494acfcd tempest-VolumeImageDependencyTests-1529416407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-a9f56c8b-0fb4-4f83-8b50-a220707eb286" returned: 0 in 0.314s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:27 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-3fa2e711-f9ec-4d56-8f80-8941494acfcd tempest-VolumeImageDependencyTests-1529416407 None] Lock "cinder-quobyte-a9f56c8b-0fb4-4f83-8b50-a220707eb286" released by "delete_volume" :: held 0.801s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:27 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-3fa2e711-f9ec-4d56-8f80-8941494acfcd tempest-VolumeImageDependencyTests-1529416407 None] Created reservations ['a9ff4e92-b1a7-40b4-83bc-1a5e2532b325', '200dcaf2-8938-4a61-abf4-21fcbe26f80c', '22c1348b-79b7-4450-8309-a9bfac28d144', '0059ab4b-87bf-4b17-aff8-a87802a6960f'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:09:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3fa2e711-f9ec-4d56-8f80-8941494acfcd tempest-VolumeImageDependencyTests-1529416407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3fa2e711-f9ec-4d56-8f80-8941494acfcd tempest-VolumeImageDependencyTests-1529416407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:27 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-3fa2e711-f9ec-4d56-8f80-8941494acfcd tempest-VolumeImageDependencyTests-1529416407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:27 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-3fa2e711-f9ec-4d56-8f80-8941494acfcd tempest-VolumeImageDependencyTests-1529416407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3fa2e711-f9ec-4d56-8f80-8941494acfcd tempest-VolumeImageDependencyTests-1529416407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3fa2e711-f9ec-4d56-8f80-8941494acfcd tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:27 devstack sudo[108709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:09:27 devstack sudo[108709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:27 devstack sudo[108700]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-52d56d02-2200-4832-be25-04110a2fa6d4 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b2d3942-6b87-4d81-a155-5deaefaa2a2b 1073741824" returned: 0 in 0.553s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-52d56d02-2200-4832-be25-04110a2fa6d4 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b2d3942-6b87-4d81-a155-5deaefaa2a2b {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:27 devstack sudo[108711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b2d3942-6b87-4d81-a155-5deaefaa2a2b Jul 30 17:09:27 devstack sudo[108711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:28 devstack sudo[108709]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3fa2e711-f9ec-4d56-8f80-8941494acfcd tempest-VolumeImageDependencyTests-1529416407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.288s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:28 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-3fa2e711-f9ec-4d56-8f80-8941494acfcd tempest-VolumeImageDependencyTests-1529416407 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:09:28 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-3fa2e711-f9ec-4d56-8f80-8941494acfcd tempest-VolumeImageDependencyTests-1529416407 None] Deleted volume successfully. Jul 30 17:09:28 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-3fa2e711-f9ec-4d56-8f80-8941494acfcd tempest-VolumeImageDependencyTests-1529416407 None] Lock "cinder-a9f56c8b-0fb4-4f83-8b50-a220707eb286-delete_volume" released by "delete_volume" :: held 1.296s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:28 devstack sudo[108711]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-52d56d02-2200-4832-be25-04110a2fa6d4 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b2d3942-6b87-4d81-a155-5deaefaa2a2b" returned: 0 in 0.263s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:28 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-52d56d02-2200-4832-be25-04110a2fa6d4 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:09:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-52d56d02-2200-4832-be25-04110a2fa6d4 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7f037ea8-84cd-4970-95e2-a5c65be018e6 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.562s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:28 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7f037ea8-84cd-4970-95e2-a5c65be018e6 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2133581917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b024e28c-365e-440c-a2bc-a6ead06cdc7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea66f9219b4644f59fff959929a1ef22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:09:25Z,use_quota=True,user_id='c2b9de048ee84761b71c9bf4fda93c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:09:28 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-7f037ea8-84cd-4970-95e2-a5c65be018e6 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Creating volume b024e28c-365e-440c-a2bc-a6ead06cdc7e {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:09:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7f037ea8-84cd-4970-95e2-a5c65be018e6 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7f037ea8-84cd-4970-95e2-a5c65be018e6 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:28 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7f037ea8-84cd-4970-95e2-a5c65be018e6 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:28 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7f037ea8-84cd-4970-95e2-a5c65be018e6 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7f037ea8-84cd-4970-95e2-a5c65be018e6 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:28 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7f037ea8-84cd-4970-95e2-a5c65be018e6 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:09:28 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-7f037ea8-84cd-4970-95e2-a5c65be018e6 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:09:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7f037ea8-84cd-4970-95e2-a5c65be018e6 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b024e28c-365e-440c-a2bc-a6ead06cdc7e 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:28 devstack sudo[108715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b024e28c-365e-440c-a2bc-a6ead06cdc7e 1073741824 Jul 30 17:09:28 devstack sudo[108715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:28 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-52d56d02-2200-4832-be25-04110a2fa6d4 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9761fe1-16ad-4534-879a-fd40f5b705ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b2d3942-6b87-4d81-a155-5deaefaa2a2b', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:28 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-52d56d02-2200-4832-be25-04110a2fa6d4 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eaaf704-c39b-4bdd-9785-897343a24ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:28 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9ab9eae3-ab81-4478-959b-b21b3a605a1b tempest-VolumeImageDependencyTests-1529416407 None] Acquiring lock "cinder-54bc1f11-e727-4577-870d-3000bbd16dca-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:28 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-52d56d02-2200-4832-be25-04110a2fa6d4 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Volume volume-8b2d3942-6b87-4d81-a155-5deaefaa2a2b (8b2d3942-6b87-4d81-a155-5deaefaa2a2b): created successfully Jul 30 17:09:28 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-52d56d02-2200-4832-be25-04110a2fa6d4 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eaaf704-c39b-4bdd-9785-897343a24ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:28 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-52d56d02-2200-4832-be25-04110a2fa6d4 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Flow 'volume_create_manager' (d04d5423-c39f-45c4-8e13-5723eb3ece71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:09:28 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9ab9eae3-ab81-4478-959b-b21b3a605a1b tempest-VolumeImageDependencyTests-1529416407 None] Lock "cinder-54bc1f11-e727-4577-870d-3000bbd16dca-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:28 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-52d56d02-2200-4832-be25-04110a2fa6d4 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Created volume successfully. Jul 30 17:09:28 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9ab9eae3-ab81-4478-959b-b21b3a605a1b tempest-VolumeImageDependencyTests-1529416407 None] Acquiring lock "cinder-quobyte-54bc1f11-e727-4577-870d-3000bbd16dca" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:28 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9ab9eae3-ab81-4478-959b-b21b3a605a1b tempest-VolumeImageDependencyTests-1529416407 None] Lock "cinder-quobyte-54bc1f11-e727-4577-870d-3000bbd16dca" acquired by "delete_volume" :: waited 0.015s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:28 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3cd288e-f836-4ae7-ace6-59afe777483a]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9ab9eae3-ab81-4478-959b-b21b3a605a1b tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-54bc1f11-e727-4577-870d-3000bbd16dca {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:28 devstack sudo[108717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-54bc1f11-e727-4577-870d-3000bbd16dca Jul 30 17:09:28 devstack sudo[108717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:28 devstack sudo[108715]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7f037ea8-84cd-4970-95e2-a5c65be018e6 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b024e28c-365e-440c-a2bc-a6ead06cdc7e 1073741824" returned: 0 in 0.448s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7f037ea8-84cd-4970-95e2-a5c65be018e6 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b024e28c-365e-440c-a2bc-a6ead06cdc7e {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:28 devstack sudo[108722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b024e28c-365e-440c-a2bc-a6ead06cdc7e Jul 30 17:09:28 devstack sudo[108722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:28 devstack sudo[108717]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9ab9eae3-ab81-4478-959b-b21b3a605a1b tempest-VolumeImageDependencyTests-1529416407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-54bc1f11-e727-4577-870d-3000bbd16dca" returned: 0 in 0.402s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9ab9eae3-ab81-4478-959b-b21b3a605a1b tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-54bc1f11-e727-4577-870d-3000bbd16dca {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:28 devstack sudo[108727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-54bc1f11-e727-4577-870d-3000bbd16dca Jul 30 17:09:28 devstack sudo[108727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:28 devstack sudo[108722]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7f037ea8-84cd-4970-95e2-a5c65be018e6 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b024e28c-365e-440c-a2bc-a6ead06cdc7e" returned: 0 in 0.270s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:28 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7f037ea8-84cd-4970-95e2-a5c65be018e6 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:09:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7f037ea8-84cd-4970-95e2-a5c65be018e6 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5b22187f-18f1-40fc-8b42-20ca28f1223c tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.014s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:28 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-5b22187f-18f1-40fc-8b42-20ca28f1223c tempest-CreateVolumesFromSourceVolumeTest-760749072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1950147191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f17aab98-651a-41be-a256-cc0fa2180fdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea66f9219b4644f59fff959929a1ef22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:09:26Z,use_quota=True,user_id='c2b9de048ee84761b71c9bf4fda93c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:09:28 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-5b22187f-18f1-40fc-8b42-20ca28f1223c tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Creating volume f17aab98-651a-41be-a256-cc0fa2180fdf {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:09:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5b22187f-18f1-40fc-8b42-20ca28f1223c tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5b22187f-18f1-40fc-8b42-20ca28f1223c tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:28 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-5b22187f-18f1-40fc-8b42-20ca28f1223c tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:28 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-5b22187f-18f1-40fc-8b42-20ca28f1223c tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5b22187f-18f1-40fc-8b42-20ca28f1223c tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:28 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-5b22187f-18f1-40fc-8b42-20ca28f1223c tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:09:28 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-5b22187f-18f1-40fc-8b42-20ca28f1223c tempest-CreateVolumesFromSourceVolumeTest-760749072 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:09:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5b22187f-18f1-40fc-8b42-20ca28f1223c tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f17aab98-651a-41be-a256-cc0fa2180fdf 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:28 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7f037ea8-84cd-4970-95e2-a5c65be018e6 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bc54f6f-eae6-47e0-8bff-009f886b1f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b024e28c-365e-440c-a2bc-a6ead06cdc7e', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:28 devstack sudo[108730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f17aab98-651a-41be-a256-cc0fa2180fdf 1073741824 Jul 30 17:09:28 devstack sudo[108730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:28 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7f037ea8-84cd-4970-95e2-a5c65be018e6 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42e30f89-c4f4-4491-a3b8-f27ec0d5c515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:28 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-7f037ea8-84cd-4970-95e2-a5c65be018e6 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Volume volume-b024e28c-365e-440c-a2bc-a6ead06cdc7e (b024e28c-365e-440c-a2bc-a6ead06cdc7e): created successfully Jul 30 17:09:28 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7f037ea8-84cd-4970-95e2-a5c65be018e6 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42e30f89-c4f4-4491-a3b8-f27ec0d5c515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:28 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-7f037ea8-84cd-4970-95e2-a5c65be018e6 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Flow 'volume_create_manager' (b16ff854-6ccb-41d3-9553-dc096521310c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:09:28 devstack sudo[108727]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9ab9eae3-ab81-4478-959b-b21b3a605a1b tempest-VolumeImageDependencyTests-1529416407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-54bc1f11-e727-4577-870d-3000bbd16dca" returned: 0 in 0.261s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:28 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9ab9eae3-ab81-4478-959b-b21b3a605a1b tempest-VolumeImageDependencyTests-1529416407 None] Lock "cinder-quobyte-54bc1f11-e727-4577-870d-3000bbd16dca" released by "delete_volume" :: held 0.708s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:28 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-7f037ea8-84cd-4970-95e2-a5c65be018e6 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Created volume successfully. Jul 30 17:09:29 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-9ab9eae3-ab81-4478-959b-b21b3a605a1b tempest-VolumeImageDependencyTests-1529416407 None] Created reservations ['99fb8b0b-eaee-45cd-b9ff-ac0b6415ff43', '64d9413b-5e2c-4945-af61-9a619fd647b6', '4baf00d9-0ffc-4324-83dc-41ceef71b387', '604ab57d-365e-4dd6-96cf-8987aadad43c'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:09:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-9ab9eae3-ab81-4478-959b-b21b3a605a1b tempest-VolumeImageDependencyTests-1529416407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-9ab9eae3-ab81-4478-959b-b21b3a605a1b tempest-VolumeImageDependencyTests-1529416407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:29 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-9ab9eae3-ab81-4478-959b-b21b3a605a1b tempest-VolumeImageDependencyTests-1529416407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:29 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-9ab9eae3-ab81-4478-959b-b21b3a605a1b tempest-VolumeImageDependencyTests-1529416407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-9ab9eae3-ab81-4478-959b-b21b3a605a1b tempest-VolumeImageDependencyTests-1529416407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9ab9eae3-ab81-4478-959b-b21b3a605a1b tempest-VolumeImageDependencyTests-1529416407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:29 devstack sudo[108735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:09:29 devstack sudo[108735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:29 devstack sudo[108730]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5b22187f-18f1-40fc-8b42-20ca28f1223c tempest-CreateVolumesFromSourceVolumeTest-760749072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f17aab98-651a-41be-a256-cc0fa2180fdf 1073741824" returned: 0 in 0.467s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:29 devstack sudo[108735]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9ab9eae3-ab81-4478-959b-b21b3a605a1b tempest-VolumeImageDependencyTests-1529416407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.278s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:29 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-9ab9eae3-ab81-4478-959b-b21b3a605a1b tempest-VolumeImageDependencyTests-1529416407 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:09:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5b22187f-18f1-40fc-8b42-20ca28f1223c tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f17aab98-651a-41be-a256-cc0fa2180fdf {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:29 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-9ab9eae3-ab81-4478-959b-b21b3a605a1b tempest-VolumeImageDependencyTests-1529416407 None] Deleted volume successfully. Jul 30 17:09:29 devstack sudo[108740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f17aab98-651a-41be-a256-cc0fa2180fdf Jul 30 17:09:29 devstack sudo[108740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:29 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9ab9eae3-ab81-4478-959b-b21b3a605a1b tempest-VolumeImageDependencyTests-1529416407 None] Lock "cinder-54bc1f11-e727-4577-870d-3000bbd16dca-delete_volume" released by "delete_volume" :: held 1.234s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:29 devstack sudo[108740]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5b22187f-18f1-40fc-8b42-20ca28f1223c tempest-CreateVolumesFromSourceVolumeTest-760749072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f17aab98-651a-41be-a256-cc0fa2180fdf" returned: 0 in 0.261s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:29 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-5b22187f-18f1-40fc-8b42-20ca28f1223c tempest-CreateVolumesFromSourceVolumeTest-760749072 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:09:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5b22187f-18f1-40fc-8b42-20ca28f1223c tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-e7db06e8-a711-4d51-b308-56151772abd8 tempest-VolumeDependencyTests-500709084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.603s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:29 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-e7db06e8-a711-4d51-b308-56151772abd8 tempest-VolumeDependencyTests-500709084 None] Acquiring lock "cinder-quobyte-b6f56336-1c43-459d-a07c-946ff751c3ca-3cea10c9-b035-46ee-b30f-1b3af9b38b59" by "_create_volume_from_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:29 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5b22187f-18f1-40fc-8b42-20ca28f1223c tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39805065-de83-4732-9d59-76d9141276f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f17aab98-651a-41be-a256-cc0fa2180fdf', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:29 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5b22187f-18f1-40fc-8b42-20ca28f1223c tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (548299b5-c8af-4343-a419-b57c4c535319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:29 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-e7db06e8-a711-4d51-b308-56151772abd8 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-b6f56336-1c43-459d-a07c-946ff751c3ca-3cea10c9-b035-46ee-b30f-1b3af9b38b59" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:29 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-e7db06e8-a711-4d51-b308-56151772abd8 tempest-VolumeDependencyTests-500709084 None] Creating volume 3cea10c9-b035-46ee-b30f-1b3af9b38b59 from snapshot b6f56336-1c43-459d-a07c-946ff751c3ca {{(pid=88591) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 30 17:09:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-e7db06e8-a711-4d51-b308-56151772abd8 tempest-VolumeDependencyTests-500709084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-e7db06e8-a711-4d51-b308-56151772abd8 tempest-VolumeDependencyTests-500709084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:29 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-e7db06e8-a711-4d51-b308-56151772abd8 tempest-VolumeDependencyTests-500709084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:29 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-e7db06e8-a711-4d51-b308-56151772abd8 tempest-VolumeDependencyTests-500709084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-e7db06e8-a711-4d51-b308-56151772abd8 tempest-VolumeDependencyTests-500709084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:29 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-e7db06e8-a711-4d51-b308-56151772abd8 tempest-VolumeDependencyTests-500709084 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:09:29 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-e7db06e8-a711-4d51-b308-56151772abd8 tempest-VolumeDependencyTests-500709084 None] Acquiring lock "cinder-quobyte-3cea10c9-b035-46ee-b30f-1b3af9b38b59" by "_copy_volume_from_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:29 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-e7db06e8-a711-4d51-b308-56151772abd8 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-3cea10c9-b035-46ee-b30f-1b3af9b38b59" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:29 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-e7db06e8-a711-4d51-b308-56151772abd8 tempest-VolumeDependencyTests-500709084 None] snapshot: b6f56336-1c43-459d-a07c-946ff751c3ca, volume: 3cea10c9-b035-46ee-b30f-1b3af9b38b59, {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 17:09:29 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-5b22187f-18f1-40fc-8b42-20ca28f1223c tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Volume volume-f17aab98-651a-41be-a256-cc0fa2180fdf (f17aab98-651a-41be-a256-cc0fa2180fdf): created successfully Jul 30 17:09:29 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5b22187f-18f1-40fc-8b42-20ca28f1223c tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (548299b5-c8af-4343-a419-b57c4c535319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:29 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5b22187f-18f1-40fc-8b42-20ca28f1223c tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Flow 'volume_create_manager' (8faed377-8367-4ddc-879c-737e5accefe3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:09:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-e7db06e8-a711-4d51-b308-56151772abd8 tempest-VolumeDependencyTests-500709084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-e7db06e8-a711-4d51-b308-56151772abd8 tempest-VolumeDependencyTests-500709084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:29 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-e7db06e8-a711-4d51-b308-56151772abd8 tempest-VolumeDependencyTests-500709084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:29 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-e7db06e8-a711-4d51-b308-56151772abd8 tempest-VolumeDependencyTests-500709084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-e7db06e8-a711-4d51-b308-56151772abd8 tempest-VolumeDependencyTests-500709084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:29 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-5b22187f-18f1-40fc-8b42-20ca28f1223c tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Created volume successfully. Jul 30 17:09:29 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[556a137d-ca2b-4593-b00a-90c800d7e446]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:29 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e7db06e8-a711-4d51-b308-56151772abd8 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff.b6f56336-1c43-459d-a07c-946ff751c3ca {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:29 devstack sudo[108743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff.b6f56336-1c43-459d-a07c-946ff751c3ca Jul 30 17:09:29 devstack sudo[108743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:29 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-dc1249e3-9f6a-4c3d-b5a0-67a35baec4f5 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Acquiring lock "cinder-f17aab98-651a-41be-a256-cc0fa2180fdf-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:30 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-dc1249e3-9f6a-4c3d-b5a0-67a35baec4f5 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "cinder-f17aab98-651a-41be-a256-cc0fa2180fdf-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:30 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-dc1249e3-9f6a-4c3d-b5a0-67a35baec4f5 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Acquiring lock "cinder-quobyte-f17aab98-651a-41be-a256-cc0fa2180fdf" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:30 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-dc1249e3-9f6a-4c3d-b5a0-67a35baec4f5 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "cinder-quobyte-f17aab98-651a-41be-a256-cc0fa2180fdf" acquired by "delete_volume" :: waited 0.018s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:30 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0fb3c0-e5a9-4188-a020-6f59c0131ba0]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dc1249e3-9f6a-4c3d-b5a0-67a35baec4f5 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f17aab98-651a-41be-a256-cc0fa2180fdf {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:30 devstack sudo[108743]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e7db06e8-a711-4d51-b308-56151772abd8 tempest-VolumeDependencyTests-500709084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff.b6f56336-1c43-459d-a07c-946ff751c3ca" returned: 0 in 0.460s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:30 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-e7db06e8-a711-4d51-b308-56151772abd8 tempest-VolumeDependencyTests-500709084 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:09:30 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e2b3ba-2462-45f7-a98e-4c94798bd9c1]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e7db06e8-a711-4d51-b308-56151772abd8 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:30 devstack sudo[108745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f17aab98-651a-41be-a256-cc0fa2180fdf Jul 30 17:09:30 devstack sudo[108745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:30 devstack sudo[108750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff Jul 30 17:09:30 devstack sudo[108750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:30 devstack sudo[108745]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dc1249e3-9f6a-4c3d-b5a0-67a35baec4f5 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f17aab98-651a-41be-a256-cc0fa2180fdf" returned: 0 in 0.411s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dc1249e3-9f6a-4c3d-b5a0-67a35baec4f5 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f17aab98-651a-41be-a256-cc0fa2180fdf {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:30 devstack sudo[108755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f17aab98-651a-41be-a256-cc0fa2180fdf Jul 30 17:09:30 devstack sudo[108755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:30 devstack sudo[108750]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e7db06e8-a711-4d51-b308-56151772abd8 tempest-VolumeDependencyTests-500709084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff" returned: 0 in 0.429s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:30 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-e7db06e8-a711-4d51-b308-56151772abd8 tempest-VolumeDependencyTests-500709084 None] will copy from snapshot at /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 17:09:30 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-e7db06e8-a711-4d51-b308-56151772abd8 tempest-VolumeDependencyTests-500709084 None] Creating direct copy from snapshot {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 17:09:30 devstack cinder-volume[88591]: DEBUG cinder.utils [None req-e7db06e8-a711-4d51-b308-56151772abd8 tempest-VolumeDependencyTests-500709084 None] Path /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3cea10c9-b035-46ee-b30f-1b3af9b38b59 not found in is_blk_device check {{(pid=88591) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 17:09:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e7db06e8-a711-4d51-b308-56151772abd8 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3cea10c9-b035-46ee-b30f-1b3af9b38b59 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:30 devstack sudo[108760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3cea10c9-b035-46ee-b30f-1b3af9b38b59 Jul 30 17:09:30 devstack sudo[108760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:30 devstack sudo[108755]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dc1249e3-9f6a-4c3d-b5a0-67a35baec4f5 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-f17aab98-651a-41be-a256-cc0fa2180fdf" returned: 0 in 0.279s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:30 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-dc1249e3-9f6a-4c3d-b5a0-67a35baec4f5 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "cinder-quobyte-f17aab98-651a-41be-a256-cc0fa2180fdf" released by "delete_volume" :: held 0.753s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:30 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-dc1249e3-9f6a-4c3d-b5a0-67a35baec4f5 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Created reservations ['f0ba5a25-e39f-4fcc-bd05-26e76d6f0945', 'e15e5061-9f17-4ed4-8b54-b282a812480b', '9720460b-16f4-4cb6-a1a9-d62b309029ba', 'cd6e4f46-84a1-4476-b0e3-18b1fab88911'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:09:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-dc1249e3-9f6a-4c3d-b5a0-67a35baec4f5 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-dc1249e3-9f6a-4c3d-b5a0-67a35baec4f5 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:30 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-dc1249e3-9f6a-4c3d-b5a0-67a35baec4f5 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:30 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-dc1249e3-9f6a-4c3d-b5a0-67a35baec4f5 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-dc1249e3-9f6a-4c3d-b5a0-67a35baec4f5 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:30 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dc1249e3-9f6a-4c3d-b5a0-67a35baec4f5 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:31 devstack sudo[108766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:09:31 devstack sudo[108766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:31 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9eb864f3-827d-46b9-9123-41b0d8955c20 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Acquiring lock "cinder-b024e28c-365e-440c-a2bc-a6ead06cdc7e-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:31 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9eb864f3-827d-46b9-9123-41b0d8955c20 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "cinder-b024e28c-365e-440c-a2bc-a6ead06cdc7e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:31 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9eb864f3-827d-46b9-9123-41b0d8955c20 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Acquiring lock "cinder-quobyte-b024e28c-365e-440c-a2bc-a6ead06cdc7e" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:31 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9eb864f3-827d-46b9-9123-41b0d8955c20 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "cinder-quobyte-b024e28c-365e-440c-a2bc-a6ead06cdc7e" acquired by "delete_volume" :: waited 0.017s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:31 devstack sudo[108766]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-dc1249e3-9f6a-4c3d-b5a0-67a35baec4f5 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.335s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:31 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-dc1249e3-9f6a-4c3d-b5a0-67a35baec4f5 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:09:31 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-dc1249e3-9f6a-4c3d-b5a0-67a35baec4f5 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Deleted volume successfully. Jul 30 17:09:31 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9b0534-75fb-4480-899b-eadda8011fdf]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9eb864f3-827d-46b9-9123-41b0d8955c20 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b024e28c-365e-440c-a2bc-a6ead06cdc7e {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:31 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-dc1249e3-9f6a-4c3d-b5a0-67a35baec4f5 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "cinder-f17aab98-651a-41be-a256-cc0fa2180fdf-delete_volume" released by "delete_volume" :: held 1.341s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:31 devstack sudo[108760]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e7db06e8-a711-4d51-b308-56151772abd8 tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3cea10c9-b035-46ee-b30f-1b3af9b38b59" returned: 0 in 0.675s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:31 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-e7db06e8-a711-4d51-b308-56151772abd8 tempest-VolumeDependencyTests-500709084 None] Image conversion details: src /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3cea10c9-b035-46ee-b30f-1b3af9b38b59 {{(pid=88591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 17:09:31 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-e7db06e8-a711-4d51-b308-56151772abd8 tempest-VolumeDependencyTests-500709084 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 30 17:09:31 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-e7db06e8-a711-4d51-b308-56151772abd8 tempest-VolumeDependencyTests-500709084 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3cea10c9-b035-46ee-b30f-1b3af9b38b59 is being set with open permissions: ugo+rw Jul 30 17:09:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e7db06e8-a711-4d51-b308-56151772abd8 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3cea10c9-b035-46ee-b30f-1b3af9b38b59 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:31 devstack sudo[108770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3cea10c9-b035-46ee-b30f-1b3af9b38b59 Jul 30 17:09:31 devstack sudo[108770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:31 devstack sudo[108769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b024e28c-365e-440c-a2bc-a6ead06cdc7e Jul 30 17:09:31 devstack sudo[108769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:31 devstack sudo[108770]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e7db06e8-a711-4d51-b308-56151772abd8 tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3cea10c9-b035-46ee-b30f-1b3af9b38b59" returned: 0 in 0.281s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:31 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-e7db06e8-a711-4d51-b308-56151772abd8 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-3cea10c9-b035-46ee-b30f-1b3af9b38b59" released by "_copy_volume_from_snapshot" :: held 1.950s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:31 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-e7db06e8-a711-4d51-b308-56151772abd8 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-b6f56336-1c43-459d-a07c-946ff751c3ca-3cea10c9-b035-46ee-b30f-1b3af9b38b59" released by "_create_volume_from_snapshot" :: held 2.017s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-e7db06e8-a711-4d51-b308-56151772abd8 tempest-VolumeDependencyTests-500709084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 2.051s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5a465a3d-c16a-4f31-a013-1fee5db68abd tempest-ProjectMemberTests-1145856324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.173s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:31 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-5a465a3d-c16a-4f31-a013-1fee5db68abd tempest-ProjectMemberTests-1145856324 None] Creating offline snapshot 322ba836-e5a2-4e18-be6a-184db5c7cc79 of volume 9331e48e-13ba-48f2-b248-de0e2a752354 {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:09:31 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-e7db06e8-a711-4d51-b308-56151772abd8 tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3e9802b-7870-47e8-9a59-95c7124573bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cea10c9-b035-46ee-b30f-1b3af9b38b59', 'volume_size': 1, 'snapshot_id': 'b6f56336-1c43-459d-a07c-946ff751c3ca'}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:31 devstack sudo[108769]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:31 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-e7db06e8-a711-4d51-b308-56151772abd8 tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3434251-8cf9-44e8-a24f-d02857788e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:31 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb5cc20-abea-4b4d-86f4-3ee488f9efa4]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5a465a3d-c16a-4f31-a013-1fee5db68abd tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9331e48e-13ba-48f2-b248-de0e2a752354 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9eb864f3-827d-46b9-9123-41b0d8955c20 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b024e28c-365e-440c-a2bc-a6ead06cdc7e" returned: 0 in 0.459s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:31 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9eb864f3-827d-46b9-9123-41b0d8955c20 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b024e28c-365e-440c-a2bc-a6ead06cdc7e {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:31 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-e7db06e8-a711-4d51-b308-56151772abd8 tempest-VolumeDependencyTests-500709084 None] Volume volume-3cea10c9-b035-46ee-b30f-1b3af9b38b59 (3cea10c9-b035-46ee-b30f-1b3af9b38b59): created successfully Jul 30 17:09:31 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-e7db06e8-a711-4d51-b308-56151772abd8 tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3434251-8cf9-44e8-a24f-d02857788e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:31 devstack sudo[108778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b024e28c-365e-440c-a2bc-a6ead06cdc7e Jul 30 17:09:31 devstack sudo[108778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:31 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-e7db06e8-a711-4d51-b308-56151772abd8 tempest-VolumeDependencyTests-500709084 None] Flow 'volume_create_manager' (1f798759-89d9-40f6-89d3-c5431c7e100f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:09:31 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-e7db06e8-a711-4d51-b308-56151772abd8 tempest-VolumeDependencyTests-500709084 None] Created volume successfully. Jul 30 17:09:31 devstack sudo[108777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9331e48e-13ba-48f2-b248-de0e2a752354 Jul 30 17:09:31 devstack sudo[108777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:32 devstack sudo[108778]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9eb864f3-827d-46b9-9123-41b0d8955c20 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-b024e28c-365e-440c-a2bc-a6ead06cdc7e" returned: 0 in 0.282s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:32 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9eb864f3-827d-46b9-9123-41b0d8955c20 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "cinder-quobyte-b024e28c-365e-440c-a2bc-a6ead06cdc7e" released by "delete_volume" :: held 0.794s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:32 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-9eb864f3-827d-46b9-9123-41b0d8955c20 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Created reservations ['0585f786-0263-431e-a4f8-0db42a324e1a', 'cba62687-7586-47af-a0fe-a06ed750ba51', '16f47c51-1d07-48a9-b482-c064e5aa8904', '1165161e-cd1c-4ffa-bbd5-0db8674edc66'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:09:32 devstack sudo[108777]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5a465a3d-c16a-4f31-a013-1fee5db68abd tempest-ProjectMemberTests-1145856324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9331e48e-13ba-48f2-b248-de0e2a752354" returned: 0 in 0.430s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5a465a3d-c16a-4f31-a013-1fee5db68abd tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9331e48e-13ba-48f2-b248-de0e2a752354,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9331e48e-13ba-48f2-b248-de0e2a752354.322ba836-e5a2-4e18-be6a-184db5c7cc79 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:32 devstack sudo[108785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9331e48e-13ba-48f2-b248-de0e2a752354,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9331e48e-13ba-48f2-b248-de0e2a752354.322ba836-e5a2-4e18-be6a-184db5c7cc79 1G Jul 30 17:09:32 devstack sudo[108785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-9eb864f3-827d-46b9-9123-41b0d8955c20 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-9eb864f3-827d-46b9-9123-41b0d8955c20 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:32 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-9eb864f3-827d-46b9-9123-41b0d8955c20 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:32 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-9eb864f3-827d-46b9-9123-41b0d8955c20 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-9eb864f3-827d-46b9-9123-41b0d8955c20 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9eb864f3-827d-46b9-9123-41b0d8955c20 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:32 devstack sudo[108787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:09:32 devstack sudo[108787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:32 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-531afbd8-13c9-40a9-b21c-fd5e2640c009 tempest-VolumeDependencyTests-500709084 None] Acquiring lock "cinder-efd1ebbe-c12b-472e-ad37-525ad9769a16-delete_snapshot" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:32 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-a5796c79-254f-472d-8f2d-4b1055719e4a tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Acquiring lock "cinder-8b2d3942-6b87-4d81-a155-5deaefaa2a2b-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:32 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-531afbd8-13c9-40a9-b21c-fd5e2640c009 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-efd1ebbe-c12b-472e-ad37-525ad9769a16-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:32 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-531afbd8-13c9-40a9-b21c-fd5e2640c009 tempest-VolumeDependencyTests-500709084 None] Acquiring lock "cinder-quobyte-2d48bfa2-dfb0-4990-a275-d31b3723c2a2" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:32 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-531afbd8-13c9-40a9-b21c-fd5e2640c009 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-2d48bfa2-dfb0-4990-a275-d31b3723c2a2" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:32 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-531afbd8-13c9-40a9-b21c-fd5e2640c009 tempest-VolumeDependencyTests-500709084 None] Acquiring lock "cinder-quobyte-efd1ebbe-c12b-472e-ad37-525ad9769a16" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:32 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-a5796c79-254f-472d-8f2d-4b1055719e4a tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "cinder-8b2d3942-6b87-4d81-a155-5deaefaa2a2b-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:32 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-531afbd8-13c9-40a9-b21c-fd5e2640c009 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-efd1ebbe-c12b-472e-ad37-525ad9769a16" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:32 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-531afbd8-13c9-40a9-b21c-fd5e2640c009 tempest-VolumeDependencyTests-500709084 None] Deleting offline snapshot efd1ebbe-c12b-472e-ad37-525ad9769a16 of volume 2d48bfa2-dfb0-4990-a275-d31b3723c2a2 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:09:32 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-531afbd8-13c9-40a9-b21c-fd5e2640c009 tempest-VolumeDependencyTests-500709084 None] snapshot_file for this snap is: volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2.efd1ebbe-c12b-472e-ad37-525ad9769a16 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:09:32 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f19f56-d3b3-4f72-9150-d61dbc64b7c9]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-531afbd8-13c9-40a9-b21c-fd5e2640c009 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2.efd1ebbe-c12b-472e-ad37-525ad9769a16 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:32 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-a5796c79-254f-472d-8f2d-4b1055719e4a tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Acquiring lock "cinder-quobyte-8b2d3942-6b87-4d81-a155-5deaefaa2a2b" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:32 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-a5796c79-254f-472d-8f2d-4b1055719e4a tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "cinder-quobyte-8b2d3942-6b87-4d81-a155-5deaefaa2a2b" acquired by "delete_volume" :: waited 0.031s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:32 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c2b120-d9cb-40cc-8d83-e95305c84806]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a5796c79-254f-472d-8f2d-4b1055719e4a tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b2d3942-6b87-4d81-a155-5deaefaa2a2b {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:32 devstack sudo[108787]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9eb864f3-827d-46b9-9123-41b0d8955c20 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.424s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:32 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-9eb864f3-827d-46b9-9123-41b0d8955c20 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:09:32 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-9eb864f3-827d-46b9-9123-41b0d8955c20 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Deleted volume successfully. Jul 30 17:09:32 devstack sudo[108793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2.efd1ebbe-c12b-472e-ad37-525ad9769a16 Jul 30 17:09:32 devstack sudo[108793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:32 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9eb864f3-827d-46b9-9123-41b0d8955c20 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "cinder-b024e28c-365e-440c-a2bc-a6ead06cdc7e-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:32 devstack sudo[108785]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5a465a3d-c16a-4f31-a013-1fee5db68abd tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9331e48e-13ba-48f2-b248-de0e2a752354,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9331e48e-13ba-48f2-b248-de0e2a752354.322ba836-e5a2-4e18-be6a-184db5c7cc79 1G" returned: 0 in 0.625s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5a465a3d-c16a-4f31-a013-1fee5db68abd tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9331e48e-13ba-48f2-b248-de0e2a752354 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9331e48e-13ba-48f2-b248-de0e2a752354.322ba836-e5a2-4e18-be6a-184db5c7cc79 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:32 devstack sudo[108798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9331e48e-13ba-48f2-b248-de0e2a752354 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9331e48e-13ba-48f2-b248-de0e2a752354.322ba836-e5a2-4e18-be6a-184db5c7cc79 Jul 30 17:09:32 devstack sudo[108798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:32 devstack sudo[108795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b2d3942-6b87-4d81-a155-5deaefaa2a2b Jul 30 17:09:32 devstack sudo[108795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:33 devstack sudo[108793]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-531afbd8-13c9-40a9-b21c-fd5e2640c009 tempest-VolumeDependencyTests-500709084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2.efd1ebbe-c12b-472e-ad37-525ad9769a16" returned: 0 in 0.441s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:33 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-531afbd8-13c9-40a9-b21c-fd5e2640c009 tempest-VolumeDependencyTests-500709084 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:09:33 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9aed90a-14e5-45cf-bec2-dcec6cb22920]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-531afbd8-13c9-40a9-b21c-fd5e2640c009 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:33 devstack sudo[108795]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a5796c79-254f-472d-8f2d-4b1055719e4a tempest-CreateVolumesFromSourceVolumeTest-760749072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b2d3942-6b87-4d81-a155-5deaefaa2a2b" returned: 0 in 0.464s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a5796c79-254f-472d-8f2d-4b1055719e4a tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b2d3942-6b87-4d81-a155-5deaefaa2a2b {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:33 devstack sudo[108798]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5a465a3d-c16a-4f31-a013-1fee5db68abd tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9331e48e-13ba-48f2-b248-de0e2a752354 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9331e48e-13ba-48f2-b248-de0e2a752354.322ba836-e5a2-4e18-be6a-184db5c7cc79" returned: 0 in 0.364s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:33 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-5a465a3d-c16a-4f31-a013-1fee5db68abd tempest-ProjectMemberTests-1145856324 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9331e48e-13ba-48f2-b248-de0e2a752354.322ba836-e5a2-4e18-be6a-184db5c7cc79 is being set with open permissions: ugo+rw Jul 30 17:09:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5a465a3d-c16a-4f31-a013-1fee5db68abd tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9331e48e-13ba-48f2-b248-de0e2a752354.322ba836-e5a2-4e18-be6a-184db5c7cc79 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:33 devstack sudo[108812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b2d3942-6b87-4d81-a155-5deaefaa2a2b Jul 30 17:09:33 devstack sudo[108812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:33 devstack sudo[108813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9331e48e-13ba-48f2-b248-de0e2a752354.322ba836-e5a2-4e18-be6a-184db5c7cc79 Jul 30 17:09:33 devstack sudo[108813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:33 devstack sudo[108809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2 Jul 30 17:09:33 devstack sudo[108809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:33 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-dd6a5fd3-df2d-40cf-a253-75581822b536 tempest-ProjectAdminTests-1036034056 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6732902526855, 'free_capacity_gb': 1775.6732902526855, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88591) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 30 17:09:33 devstack sudo[108812]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a5796c79-254f-472d-8f2d-4b1055719e4a tempest-CreateVolumesFromSourceVolumeTest-760749072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8b2d3942-6b87-4d81-a155-5deaefaa2a2b" returned: 0 in 0.287s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:33 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-a5796c79-254f-472d-8f2d-4b1055719e4a tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "cinder-quobyte-8b2d3942-6b87-4d81-a155-5deaefaa2a2b" released by "delete_volume" :: held 0.820s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:33 devstack sudo[108813]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5a465a3d-c16a-4f31-a013-1fee5db68abd tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9331e48e-13ba-48f2-b248-de0e2a752354.322ba836-e5a2-4e18-be6a-184db5c7cc79" returned: 0 in 0.301s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5a465a3d-c16a-4f31-a013-1fee5db68abd tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9331e48e-13ba-48f2-b248-de0e2a752354.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:33 devstack sudo[108821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9331e48e-13ba-48f2-b248-de0e2a752354.info Jul 30 17:09:33 devstack sudo[108821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:33 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-a5796c79-254f-472d-8f2d-4b1055719e4a tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Created reservations ['2d6c4bd5-2470-4a04-a45a-1792ae1d4ae0', 'eb2fd334-0c9b-49ed-b9e6-7cac3e5355ce', '56ea41f0-9bdb-4d95-ac61-007b6d728b9d', '102cd91c-edbf-442b-80c5-6af4caf17b28'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:09:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a5796c79-254f-472d-8f2d-4b1055719e4a tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a5796c79-254f-472d-8f2d-4b1055719e4a tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:33 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a5796c79-254f-472d-8f2d-4b1055719e4a tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:33 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a5796c79-254f-472d-8f2d-4b1055719e4a tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a5796c79-254f-472d-8f2d-4b1055719e4a tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a5796c79-254f-472d-8f2d-4b1055719e4a tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:33 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-adedc0b2-82f3-4425-b1cf-8d2ed7321c94 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Acquiring lock "cinder-079a0997-fa22-4f9a-a74c-7b816341083d-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:33 devstack sudo[108824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:09:33 devstack sudo[108824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:33 devstack sudo[108809]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:33 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-adedc0b2-82f3-4425-b1cf-8d2ed7321c94 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "cinder-079a0997-fa22-4f9a-a74c-7b816341083d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-531afbd8-13c9-40a9-b21c-fd5e2640c009 tempest-VolumeDependencyTests-500709084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2" returned: 0 in 0.734s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-531afbd8-13c9-40a9-b21c-fd5e2640c009 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2.efd1ebbe-c12b-472e-ad37-525ad9769a16 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:33 devstack sudo[108826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2.efd1ebbe-c12b-472e-ad37-525ad9769a16 Jul 30 17:09:33 devstack sudo[108826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:33 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-adedc0b2-82f3-4425-b1cf-8d2ed7321c94 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Acquiring lock "cinder-quobyte-079a0997-fa22-4f9a-a74c-7b816341083d" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:33 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-adedc0b2-82f3-4425-b1cf-8d2ed7321c94 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "cinder-quobyte-079a0997-fa22-4f9a-a74c-7b816341083d" acquired by "delete_volume" :: waited 0.025s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:34 devstack sudo[108821]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5a465a3d-c16a-4f31-a013-1fee5db68abd tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9331e48e-13ba-48f2-b248-de0e2a752354.info" returned: 0 in 0.473s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:34 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-5a465a3d-c16a-4f31-a013-1fee5db68abd tempest-ProjectMemberTests-1145856324 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9331e48e-13ba-48f2-b248-de0e2a752354.info is being set with open permissions: ugo+rw Jul 30 17:09:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5a465a3d-c16a-4f31-a013-1fee5db68abd tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9331e48e-13ba-48f2-b248-de0e2a752354.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:34 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25d4a83-c151-4e6a-8381-d2528a9ef218]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-adedc0b2-82f3-4425-b1cf-8d2ed7321c94 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-079a0997-fa22-4f9a-a74c-7b816341083d {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:34 devstack sudo[108829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9331e48e-13ba-48f2-b248-de0e2a752354.info Jul 30 17:09:34 devstack sudo[108829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:34 devstack sudo[108824]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a5796c79-254f-472d-8f2d-4b1055719e4a tempest-CreateVolumesFromSourceVolumeTest-760749072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.425s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:34 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-a5796c79-254f-472d-8f2d-4b1055719e4a tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:09:34 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-a5796c79-254f-472d-8f2d-4b1055719e4a tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Deleted volume successfully. Jul 30 17:09:34 devstack sudo[108830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-079a0997-fa22-4f9a-a74c-7b816341083d Jul 30 17:09:34 devstack sudo[108830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:34 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-a5796c79-254f-472d-8f2d-4b1055719e4a tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "cinder-8b2d3942-6b87-4d81-a155-5deaefaa2a2b-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:34 devstack sudo[108826]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:34 devstack sudo[108829]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-531afbd8-13c9-40a9-b21c-fd5e2640c009 tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2.efd1ebbe-c12b-472e-ad37-525ad9769a16" returned: 0 in 0.493s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5a465a3d-c16a-4f31-a013-1fee5db68abd tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9331e48e-13ba-48f2-b248-de0e2a752354.info" returned: 0 in 0.321s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-531afbd8-13c9-40a9-b21c-fd5e2640c009 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2.efd1ebbe-c12b-472e-ad37-525ad9769a16 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:34 devstack sudo[108838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2.efd1ebbe-c12b-472e-ad37-525ad9769a16 Jul 30 17:09:34 devstack sudo[108838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5a465a3d-c16a-4f31-a013-1fee5db68abd tempest-ProjectMemberTests-1145856324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.653s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:34 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-5a465a3d-c16a-4f31-a013-1fee5db68abd tempest-ProjectMemberTests-1145856324 None] Create snapshot completed successfully Jul 30 17:09:34 devstack sudo[108830]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-adedc0b2-82f3-4425-b1cf-8d2ed7321c94 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-079a0997-fa22-4f9a-a74c-7b816341083d" returned: 0 in 0.468s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-adedc0b2-82f3-4425-b1cf-8d2ed7321c94 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-079a0997-fa22-4f9a-a74c-7b816341083d {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:34 devstack sudo[108843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-079a0997-fa22-4f9a-a74c-7b816341083d Jul 30 17:09:34 devstack sudo[108843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:34 devstack sudo[108838]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-531afbd8-13c9-40a9-b21c-fd5e2640c009 tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2.efd1ebbe-c12b-472e-ad37-525ad9769a16" returned: 0 in 0.315s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:34 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-531afbd8-13c9-40a9-b21c-fd5e2640c009 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-efd1ebbe-c12b-472e-ad37-525ad9769a16" released by "_delete_snapshot" :: held 2.143s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:34 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-531afbd8-13c9-40a9-b21c-fd5e2640c009 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-2d48bfa2-dfb0-4990-a275-d31b3723c2a2" released by "delete_snapshot" :: held 2.188s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:34 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-531afbd8-13c9-40a9-b21c-fd5e2640c009 tempest-VolumeDependencyTests-500709084 None] Created reservations ['0e4bb3da-2f32-46f4-92b2-74a1937d453b', '6f89eaa6-abbb-4855-8dec-8a5cafd2da99', 'b8e9b766-cf05-44d3-b246-f9b3f8ea0bc8', '6d60efbc-ffdc-4086-a1b3-05c638abddb7'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:09:34 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-531afbd8-13c9-40a9-b21c-fd5e2640c009 tempest-VolumeDependencyTests-500709084 None] Delete snapshot completed successfully. Jul 30 17:09:34 devstack sudo[108843]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:34 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-531afbd8-13c9-40a9-b21c-fd5e2640c009 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-efd1ebbe-c12b-472e-ad37-525ad9769a16-delete_snapshot" released by "delete_snapshot" :: held 2.343s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-adedc0b2-82f3-4425-b1cf-8d2ed7321c94 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-079a0997-fa22-4f9a-a74c-7b816341083d" returned: 0 in 0.356s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:34 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-adedc0b2-82f3-4425-b1cf-8d2ed7321c94 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "cinder-quobyte-079a0997-fa22-4f9a-a74c-7b816341083d" released by "delete_volume" :: held 0.896s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:34 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-adedc0b2-82f3-4425-b1cf-8d2ed7321c94 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Created reservations ['ef85f990-493d-49b7-8727-aec917ce912d', 'eae29803-7f8a-477f-a229-c50f09cf978b', '2a79bb3a-aeb5-43df-92d3-a530db11b997', 'fbf6f414-6335-41c2-a5ac-b7e4a87e7ad2'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:09:34 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-6ebf2241-b606-449a-a634-38e6c31cf380 tempest-ProjectMemberTests-1145856324 None] Acquiring lock "cinder-322ba836-e5a2-4e18-be6a-184db5c7cc79-delete_snapshot" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:34 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-6ebf2241-b606-449a-a634-38e6c31cf380 tempest-ProjectMemberTests-1145856324 None] Lock "cinder-322ba836-e5a2-4e18-be6a-184db5c7cc79-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:34 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-6ebf2241-b606-449a-a634-38e6c31cf380 tempest-ProjectMemberTests-1145856324 None] Acquiring lock "cinder-quobyte-9331e48e-13ba-48f2-b248-de0e2a752354" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:34 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-6ebf2241-b606-449a-a634-38e6c31cf380 tempest-ProjectMemberTests-1145856324 None] Lock "cinder-quobyte-9331e48e-13ba-48f2-b248-de0e2a752354" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:34 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-6ebf2241-b606-449a-a634-38e6c31cf380 tempest-ProjectMemberTests-1145856324 None] Acquiring lock "cinder-quobyte-322ba836-e5a2-4e18-be6a-184db5c7cc79" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:35 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-6ebf2241-b606-449a-a634-38e6c31cf380 tempest-ProjectMemberTests-1145856324 None] Lock "cinder-quobyte-322ba836-e5a2-4e18-be6a-184db5c7cc79" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:35 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-6ebf2241-b606-449a-a634-38e6c31cf380 tempest-ProjectMemberTests-1145856324 None] Deleting offline snapshot 322ba836-e5a2-4e18-be6a-184db5c7cc79 of volume 9331e48e-13ba-48f2-b248-de0e2a752354 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:09:35 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-6ebf2241-b606-449a-a634-38e6c31cf380 tempest-ProjectMemberTests-1145856324 None] snapshot_file for this snap is: volume-9331e48e-13ba-48f2-b248-de0e2a752354.322ba836-e5a2-4e18-be6a-184db5c7cc79 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:09:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-adedc0b2-82f3-4425-b1cf-8d2ed7321c94 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-adedc0b2-82f3-4425-b1cf-8d2ed7321c94 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:35 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-adedc0b2-82f3-4425-b1cf-8d2ed7321c94 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:35 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-adedc0b2-82f3-4425-b1cf-8d2ed7321c94 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-adedc0b2-82f3-4425-b1cf-8d2ed7321c94 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-adedc0b2-82f3-4425-b1cf-8d2ed7321c94 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:35 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aba25e1-a30a-4dcd-a198-5f308f97f3b8]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6ebf2241-b606-449a-a634-38e6c31cf380 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9331e48e-13ba-48f2-b248-de0e2a752354.322ba836-e5a2-4e18-be6a-184db5c7cc79 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:35 devstack sudo[108847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:09:35 devstack sudo[108847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:35 devstack sudo[108848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9331e48e-13ba-48f2-b248-de0e2a752354.322ba836-e5a2-4e18-be6a-184db5c7cc79 Jul 30 17:09:35 devstack sudo[108848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:35 devstack sudo[108847]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-adedc0b2-82f3-4425-b1cf-8d2ed7321c94 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.295s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:35 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-adedc0b2-82f3-4425-b1cf-8d2ed7321c94 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:09:35 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-adedc0b2-82f3-4425-b1cf-8d2ed7321c94 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Deleted volume successfully. Jul 30 17:09:35 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-adedc0b2-82f3-4425-b1cf-8d2ed7321c94 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "cinder-079a0997-fa22-4f9a-a74c-7b816341083d-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:35 devstack sudo[108848]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6ebf2241-b606-449a-a634-38e6c31cf380 tempest-ProjectMemberTests-1145856324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9331e48e-13ba-48f2-b248-de0e2a752354.322ba836-e5a2-4e18-be6a-184db5c7cc79" returned: 0 in 0.456s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:35 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-6ebf2241-b606-449a-a634-38e6c31cf380 tempest-ProjectMemberTests-1145856324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9331e48e-13ba-48f2-b248-de0e2a752354(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:09:35 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b835dd0b-924f-45f6-897c-922e06d0e280]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6ebf2241-b606-449a-a634-38e6c31cf380 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9331e48e-13ba-48f2-b248-de0e2a752354 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:35 devstack sudo[108856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9331e48e-13ba-48f2-b248-de0e2a752354 Jul 30 17:09:35 devstack sudo[108856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:35 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c12594ee-cd33-46fb-bc7f-c4d84db04b19 tempest-VolumeDependencyTests-500709084 None] Acquiring lock "cinder-b6f56336-1c43-459d-a07c-946ff751c3ca-delete_snapshot" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:35 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c12594ee-cd33-46fb-bc7f-c4d84db04b19 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-b6f56336-1c43-459d-a07c-946ff751c3ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:35 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c12594ee-cd33-46fb-bc7f-c4d84db04b19 tempest-VolumeDependencyTests-500709084 None] Acquiring lock "cinder-quobyte-ad9d489b-be22-4b8d-8480-c74bf5af8bff" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:35 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c12594ee-cd33-46fb-bc7f-c4d84db04b19 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-ad9d489b-be22-4b8d-8480-c74bf5af8bff" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:35 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c12594ee-cd33-46fb-bc7f-c4d84db04b19 tempest-VolumeDependencyTests-500709084 None] Acquiring lock "cinder-quobyte-b6f56336-1c43-459d-a07c-946ff751c3ca" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:35 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c12594ee-cd33-46fb-bc7f-c4d84db04b19 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-b6f56336-1c43-459d-a07c-946ff751c3ca" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:35 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-c12594ee-cd33-46fb-bc7f-c4d84db04b19 tempest-VolumeDependencyTests-500709084 None] Deleting offline snapshot b6f56336-1c43-459d-a07c-946ff751c3ca of volume ad9d489b-be22-4b8d-8480-c74bf5af8bff {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:09:35 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-c12594ee-cd33-46fb-bc7f-c4d84db04b19 tempest-VolumeDependencyTests-500709084 None] snapshot_file for this snap is: volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff.b6f56336-1c43-459d-a07c-946ff751c3ca {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:09:35 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[2651f2ad-b96a-4e33-9656-51f23224333a]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c12594ee-cd33-46fb-bc7f-c4d84db04b19 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff.b6f56336-1c43-459d-a07c-946ff751c3ca {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:35 devstack sudo[108858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff.b6f56336-1c43-459d-a07c-946ff751c3ca Jul 30 17:09:35 devstack sudo[108858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:35 devstack sudo[108856]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6ebf2241-b606-449a-a634-38e6c31cf380 tempest-ProjectMemberTests-1145856324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9331e48e-13ba-48f2-b248-de0e2a752354" returned: 0 in 0.412s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6ebf2241-b606-449a-a634-38e6c31cf380 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9331e48e-13ba-48f2-b248-de0e2a752354.322ba836-e5a2-4e18-be6a-184db5c7cc79 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:36 devstack sudo[108863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9331e48e-13ba-48f2-b248-de0e2a752354.322ba836-e5a2-4e18-be6a-184db5c7cc79 Jul 30 17:09:36 devstack sudo[108863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:36 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-744c5bef-c88c-47c0-8ab6-c8cc79a1a8a3 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Acquiring lock "cinder-679c27e4-300b-4482-82fb-2a7e06656390-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:36 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-744c5bef-c88c-47c0-8ab6-c8cc79a1a8a3 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "cinder-679c27e4-300b-4482-82fb-2a7e06656390-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:36 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-744c5bef-c88c-47c0-8ab6-c8cc79a1a8a3 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Acquiring lock "cinder-quobyte-679c27e4-300b-4482-82fb-2a7e06656390" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:36 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-744c5bef-c88c-47c0-8ab6-c8cc79a1a8a3 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "cinder-quobyte-679c27e4-300b-4482-82fb-2a7e06656390" acquired by "delete_volume" :: waited 0.022s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:36 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a86596-8cd1-41d7-84e0-c275f56fcce8]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-744c5bef-c88c-47c0-8ab6-c8cc79a1a8a3 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-679c27e4-300b-4482-82fb-2a7e06656390 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:36 devstack sudo[108858]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c12594ee-cd33-46fb-bc7f-c4d84db04b19 tempest-VolumeDependencyTests-500709084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff.b6f56336-1c43-459d-a07c-946ff751c3ca" returned: 0 in 0.455s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:36 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-c12594ee-cd33-46fb-bc7f-c4d84db04b19 tempest-VolumeDependencyTests-500709084 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:09:36 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82e4230-1cf0-4ad5-ab04-d5bf2acabbff]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c12594ee-cd33-46fb-bc7f-c4d84db04b19 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:36 devstack sudo[108868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-679c27e4-300b-4482-82fb-2a7e06656390 Jul 30 17:09:36 devstack sudo[108868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:36 devstack sudo[108872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff Jul 30 17:09:36 devstack sudo[108872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:36 devstack sudo[108863]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6ebf2241-b606-449a-a634-38e6c31cf380 tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9331e48e-13ba-48f2-b248-de0e2a752354.322ba836-e5a2-4e18-be6a-184db5c7cc79" returned: 0 in 0.493s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6ebf2241-b606-449a-a634-38e6c31cf380 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9331e48e-13ba-48f2-b248-de0e2a752354.322ba836-e5a2-4e18-be6a-184db5c7cc79 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:36 devstack sudo[108875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9331e48e-13ba-48f2-b248-de0e2a752354.322ba836-e5a2-4e18-be6a-184db5c7cc79 Jul 30 17:09:36 devstack sudo[108875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:36 devstack sudo[108868]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-744c5bef-c88c-47c0-8ab6-c8cc79a1a8a3 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-679c27e4-300b-4482-82fb-2a7e06656390" returned: 0 in 0.426s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-744c5bef-c88c-47c0-8ab6-c8cc79a1a8a3 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-679c27e4-300b-4482-82fb-2a7e06656390 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:36 devstack sudo[108883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-679c27e4-300b-4482-82fb-2a7e06656390 Jul 30 17:09:36 devstack sudo[108883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:36 devstack sudo[108872]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c12594ee-cd33-46fb-bc7f-c4d84db04b19 tempest-VolumeDependencyTests-500709084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff" returned: 0 in 0.441s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c12594ee-cd33-46fb-bc7f-c4d84db04b19 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff.b6f56336-1c43-459d-a07c-946ff751c3ca {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:36 devstack sudo[108875]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6ebf2241-b606-449a-a634-38e6c31cf380 tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9331e48e-13ba-48f2-b248-de0e2a752354.322ba836-e5a2-4e18-be6a-184db5c7cc79" returned: 0 in 0.296s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:36 devstack sudo[108886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff.b6f56336-1c43-459d-a07c-946ff751c3ca Jul 30 17:09:36 devstack sudo[108886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:36 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-6ebf2241-b606-449a-a634-38e6c31cf380 tempest-ProjectMemberTests-1145856324 None] Lock "cinder-quobyte-322ba836-e5a2-4e18-be6a-184db5c7cc79" released by "_delete_snapshot" :: held 1.784s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:36 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-6ebf2241-b606-449a-a634-38e6c31cf380 tempest-ProjectMemberTests-1145856324 None] Lock "cinder-quobyte-9331e48e-13ba-48f2-b248-de0e2a752354" released by "delete_snapshot" :: held 1.820s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:36 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-6ebf2241-b606-449a-a634-38e6c31cf380 tempest-ProjectMemberTests-1145856324 None] Created reservations ['efd54de7-e043-4953-bcae-90a4942bada0', '531ddda2-d0d0-470d-bcb8-e380d51e12ac', '2db63685-d6fc-4fee-9632-a5dd4d9e4616', 'e6312e37-07fe-412b-b30e-951f51f1a4e9'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:09:36 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-6ebf2241-b606-449a-a634-38e6c31cf380 tempest-ProjectMemberTests-1145856324 None] Delete snapshot completed successfully. Jul 30 17:09:36 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-6ebf2241-b606-449a-a634-38e6c31cf380 tempest-ProjectMemberTests-1145856324 None] Lock "cinder-322ba836-e5a2-4e18-be6a-184db5c7cc79-delete_snapshot" released by "delete_snapshot" :: held 2.000s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:37 devstack sudo[108883]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-744c5bef-c88c-47c0-8ab6-c8cc79a1a8a3 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-679c27e4-300b-4482-82fb-2a7e06656390" returned: 0 in 0.321s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:37 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-744c5bef-c88c-47c0-8ab6-c8cc79a1a8a3 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "cinder-quobyte-679c27e4-300b-4482-82fb-2a7e06656390" released by "delete_volume" :: held 0.794s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:37 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-744c5bef-c88c-47c0-8ab6-c8cc79a1a8a3 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Created reservations ['3c0b509a-6340-4c94-8fd1-4459604061d7', 'a7030110-0150-40fb-b90b-cea577d55eac', 'b4d30cbc-eddb-4af9-9e60-f86957412382', '98fad248-7709-449e-88ce-07a57440c915'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:09:37 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-aae0d69b-606d-4f8a-93a2-0b4fbae0309f tempest-ProjectMemberTests-1145856324 None] Acquiring lock "cinder-9331e48e-13ba-48f2-b248-de0e2a752354-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-744c5bef-c88c-47c0-8ab6-c8cc79a1a8a3 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-744c5bef-c88c-47c0-8ab6-c8cc79a1a8a3 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:37 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-744c5bef-c88c-47c0-8ab6-c8cc79a1a8a3 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:37 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-744c5bef-c88c-47c0-8ab6-c8cc79a1a8a3 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-744c5bef-c88c-47c0-8ab6-c8cc79a1a8a3 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-744c5bef-c88c-47c0-8ab6-c8cc79a1a8a3 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:37 devstack sudo[108886]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c12594ee-cd33-46fb-bc7f-c4d84db04b19 tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff.b6f56336-1c43-459d-a07c-946ff751c3ca" returned: 0 in 0.470s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c12594ee-cd33-46fb-bc7f-c4d84db04b19 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff.b6f56336-1c43-459d-a07c-946ff751c3ca {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:37 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-aae0d69b-606d-4f8a-93a2-0b4fbae0309f tempest-ProjectMemberTests-1145856324 None] Lock "cinder-9331e48e-13ba-48f2-b248-de0e2a752354-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:37 devstack sudo[108894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff.b6f56336-1c43-459d-a07c-946ff751c3ca Jul 30 17:09:37 devstack sudo[108894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:37 devstack sudo[108893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:09:37 devstack sudo[108893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:37 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-aae0d69b-606d-4f8a-93a2-0b4fbae0309f tempest-ProjectMemberTests-1145856324 None] Acquiring lock "cinder-quobyte-9331e48e-13ba-48f2-b248-de0e2a752354" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:37 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-aae0d69b-606d-4f8a-93a2-0b4fbae0309f tempest-ProjectMemberTests-1145856324 None] Lock "cinder-quobyte-9331e48e-13ba-48f2-b248-de0e2a752354" acquired by "delete_volume" :: waited 0.018s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:37 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b223feed-f03f-4227-b63d-a84097e6b8f7 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Acquiring lock "cinder-06210903-8f4e-46fe-9f65-56c2dd123b1f-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:37 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a22cd22-781d-444b-8813-a1e02944c72e]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-aae0d69b-606d-4f8a-93a2-0b4fbae0309f tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9331e48e-13ba-48f2-b248-de0e2a752354 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:37 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b223feed-f03f-4227-b63d-a84097e6b8f7 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "cinder-06210903-8f4e-46fe-9f65-56c2dd123b1f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:37 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b223feed-f03f-4227-b63d-a84097e6b8f7 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Acquiring lock "cinder-quobyte-06210903-8f4e-46fe-9f65-56c2dd123b1f" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:37 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b223feed-f03f-4227-b63d-a84097e6b8f7 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "cinder-quobyte-06210903-8f4e-46fe-9f65-56c2dd123b1f" acquired by "delete_volume" :: waited 0.020s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:37 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3407be-3e7d-469c-867f-37d09965ea93]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b223feed-f03f-4227-b63d-a84097e6b8f7 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-06210903-8f4e-46fe-9f65-56c2dd123b1f {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:37 devstack sudo[108897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9331e48e-13ba-48f2-b248-de0e2a752354 Jul 30 17:09:37 devstack sudo[108897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:37 devstack sudo[108893]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:37 devstack sudo[108894]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-744c5bef-c88c-47c0-8ab6-c8cc79a1a8a3 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.408s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:37 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-744c5bef-c88c-47c0-8ab6-c8cc79a1a8a3 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:09:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c12594ee-cd33-46fb-bc7f-c4d84db04b19 tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff.b6f56336-1c43-459d-a07c-946ff751c3ca" returned: 0 in 0.401s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:37 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-744c5bef-c88c-47c0-8ab6-c8cc79a1a8a3 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Deleted volume successfully. Jul 30 17:09:37 devstack sudo[108899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-06210903-8f4e-46fe-9f65-56c2dd123b1f Jul 30 17:09:37 devstack sudo[108899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:37 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c12594ee-cd33-46fb-bc7f-c4d84db04b19 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-b6f56336-1c43-459d-a07c-946ff751c3ca" released by "_delete_snapshot" :: held 1.894s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:37 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-744c5bef-c88c-47c0-8ab6-c8cc79a1a8a3 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "cinder-679c27e4-300b-4482-82fb-2a7e06656390-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:37 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c12594ee-cd33-46fb-bc7f-c4d84db04b19 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-ad9d489b-be22-4b8d-8480-c74bf5af8bff" released by "delete_snapshot" :: held 1.929s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:37 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-c12594ee-cd33-46fb-bc7f-c4d84db04b19 tempest-VolumeDependencyTests-500709084 None] Created reservations ['c8019180-60c4-4215-8c2b-daa6a5a84e28', 'f212a2cf-0111-4e42-86f7-cb68d324db35', '4dac831d-6351-45a7-9174-274eb5b2ba47', 'c3944aac-1292-4987-8d15-29fe3f713197'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:09:37 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-c12594ee-cd33-46fb-bc7f-c4d84db04b19 tempest-VolumeDependencyTests-500709084 None] Delete snapshot completed successfully. Jul 30 17:09:37 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c12594ee-cd33-46fb-bc7f-c4d84db04b19 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-b6f56336-1c43-459d-a07c-946ff751c3ca-delete_snapshot" released by "delete_snapshot" :: held 2.107s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:37 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-fd5e64f3-4202-499c-906a-dfdc49fb43f2 tempest-VolumeDependencyTests-500709084 None] Acquiring lock "cinder-2d48bfa2-dfb0-4990-a275-d31b3723c2a2-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:37 devstack sudo[108897]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-aae0d69b-606d-4f8a-93a2-0b4fbae0309f tempest-ProjectMemberTests-1145856324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9331e48e-13ba-48f2-b248-de0e2a752354" returned: 0 in 0.586s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-aae0d69b-606d-4f8a-93a2-0b4fbae0309f tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9331e48e-13ba-48f2-b248-de0e2a752354 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:37 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-fd5e64f3-4202-499c-906a-dfdc49fb43f2 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-2d48bfa2-dfb0-4990-a275-d31b3723c2a2-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:38 devstack sudo[108909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9331e48e-13ba-48f2-b248-de0e2a752354 Jul 30 17:09:38 devstack sudo[108909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:38 devstack sudo[108899]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b223feed-f03f-4227-b63d-a84097e6b8f7 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-06210903-8f4e-46fe-9f65-56c2dd123b1f" returned: 0 in 0.523s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b223feed-f03f-4227-b63d-a84097e6b8f7 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-06210903-8f4e-46fe-9f65-56c2dd123b1f {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:38 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-fd5e64f3-4202-499c-906a-dfdc49fb43f2 tempest-VolumeDependencyTests-500709084 None] Acquiring lock "cinder-quobyte-2d48bfa2-dfb0-4990-a275-d31b3723c2a2" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:38 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-fd5e64f3-4202-499c-906a-dfdc49fb43f2 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-2d48bfa2-dfb0-4990-a275-d31b3723c2a2" acquired by "delete_volume" :: waited 0.019s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:38 devstack sudo[108911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-06210903-8f4e-46fe-9f65-56c2dd123b1f Jul 30 17:09:38 devstack sudo[108911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:38 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec4f4bf-99d4-44ac-9846-b571e70f30fd]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fd5e64f3-4202-499c-906a-dfdc49fb43f2 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:38 devstack sudo[108913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2 Jul 30 17:09:38 devstack sudo[108913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:38 devstack sudo[108909]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-aae0d69b-606d-4f8a-93a2-0b4fbae0309f tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-9331e48e-13ba-48f2-b248-de0e2a752354" returned: 0 in 0.347s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:38 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-aae0d69b-606d-4f8a-93a2-0b4fbae0309f tempest-ProjectMemberTests-1145856324 None] Lock "cinder-quobyte-9331e48e-13ba-48f2-b248-de0e2a752354" released by "delete_volume" :: held 1.029s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:38 devstack sudo[108911]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b223feed-f03f-4227-b63d-a84097e6b8f7 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-06210903-8f4e-46fe-9f65-56c2dd123b1f" returned: 0 in 0.347s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:38 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b223feed-f03f-4227-b63d-a84097e6b8f7 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "cinder-quobyte-06210903-8f4e-46fe-9f65-56c2dd123b1f" released by "delete_volume" :: held 0.920s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:38 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-aae0d69b-606d-4f8a-93a2-0b4fbae0309f tempest-ProjectMemberTests-1145856324 None] Created reservations ['5aa7fe01-7f31-4a8b-9536-6b729e825b96', '525d811e-1111-42e9-98d4-eb48205fbec2', '3c6b862d-a1c4-41d8-a4fd-c485012dbe6d', 'a1a94222-e4d8-437c-83cf-b341e16d71b8'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:09:38 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-b223feed-f03f-4227-b63d-a84097e6b8f7 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Created reservations ['f571cbc8-d9d0-44a0-ac9b-ea517a3ab38d', '89b95934-104e-42e7-962f-a4ef68012e2d', '9db7c522-0d6c-42cf-aeb8-21c33e3525d1', 'c12ce929-6502-4244-b705-5d3e55b96eec'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:09:38 devstack sudo[108913]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-aae0d69b-606d-4f8a-93a2-0b4fbae0309f tempest-ProjectMemberTests-1145856324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-aae0d69b-606d-4f8a-93a2-0b4fbae0309f tempest-ProjectMemberTests-1145856324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:38 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-aae0d69b-606d-4f8a-93a2-0b4fbae0309f tempest-ProjectMemberTests-1145856324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:38 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-aae0d69b-606d-4f8a-93a2-0b4fbae0309f tempest-ProjectMemberTests-1145856324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-aae0d69b-606d-4f8a-93a2-0b4fbae0309f tempest-ProjectMemberTests-1145856324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-aae0d69b-606d-4f8a-93a2-0b4fbae0309f tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fd5e64f3-4202-499c-906a-dfdc49fb43f2 tempest-VolumeDependencyTests-500709084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2" returned: 0 in 0.501s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fd5e64f3-4202-499c-906a-dfdc49fb43f2 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:38 devstack sudo[108920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:09:38 devstack sudo[108920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:38 devstack sudo[108921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2 Jul 30 17:09:38 devstack sudo[108921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b223feed-f03f-4227-b63d-a84097e6b8f7 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b223feed-f03f-4227-b63d-a84097e6b8f7 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:38 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b223feed-f03f-4227-b63d-a84097e6b8f7 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:38 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-b223feed-f03f-4227-b63d-a84097e6b8f7 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-b223feed-f03f-4227-b63d-a84097e6b8f7 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b223feed-f03f-4227-b63d-a84097e6b8f7 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:38 devstack sudo[108924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:09:38 devstack sudo[108924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:38 devstack sudo[108920]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-aae0d69b-606d-4f8a-93a2-0b4fbae0309f tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.300s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:38 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-aae0d69b-606d-4f8a-93a2-0b4fbae0309f tempest-ProjectMemberTests-1145856324 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:09:38 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-aae0d69b-606d-4f8a-93a2-0b4fbae0309f tempest-ProjectMemberTests-1145856324 None] Deleted volume successfully. Jul 30 17:09:38 devstack sudo[108921]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:38 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-aae0d69b-606d-4f8a-93a2-0b4fbae0309f tempest-ProjectMemberTests-1145856324 None] Lock "cinder-9331e48e-13ba-48f2-b248-de0e2a752354-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fd5e64f3-4202-499c-906a-dfdc49fb43f2 tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2d48bfa2-dfb0-4990-a275-d31b3723c2a2" returned: 0 in 0.321s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:38 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-fd5e64f3-4202-499c-906a-dfdc49fb43f2 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-2d48bfa2-dfb0-4990-a275-d31b3723c2a2" released by "delete_volume" :: held 0.893s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:38 devstack sudo[108924]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b223feed-f03f-4227-b63d-a84097e6b8f7 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.292s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:38 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-b223feed-f03f-4227-b63d-a84097e6b8f7 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:09:38 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-b223feed-f03f-4227-b63d-a84097e6b8f7 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Deleted volume successfully. Jul 30 17:09:39 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b223feed-f03f-4227-b63d-a84097e6b8f7 tempest-CreateVolumesFromSourceVolumeTest-760749072 None] Lock "cinder-06210903-8f4e-46fe-9f65-56c2dd123b1f-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:39 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-fd5e64f3-4202-499c-906a-dfdc49fb43f2 tempest-VolumeDependencyTests-500709084 None] Created reservations ['4f11cece-1b51-491e-8ffc-42d4714b749c', '1af4b229-fa46-4bde-8e39-8d557f29b696', 'dafcf2c8-95f7-447f-a53c-570d1c7f2c53', '00bd48fc-4098-4915-8746-ebd65b6cccd9'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:09:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-fd5e64f3-4202-499c-906a-dfdc49fb43f2 tempest-VolumeDependencyTests-500709084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-fd5e64f3-4202-499c-906a-dfdc49fb43f2 tempest-VolumeDependencyTests-500709084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:39 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-fd5e64f3-4202-499c-906a-dfdc49fb43f2 tempest-VolumeDependencyTests-500709084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:39 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-fd5e64f3-4202-499c-906a-dfdc49fb43f2 tempest-VolumeDependencyTests-500709084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-fd5e64f3-4202-499c-906a-dfdc49fb43f2 tempest-VolumeDependencyTests-500709084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fd5e64f3-4202-499c-906a-dfdc49fb43f2 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:39 devstack sudo[108929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:09:39 devstack sudo[108929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:39 devstack sudo[108929]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-fd5e64f3-4202-499c-906a-dfdc49fb43f2 tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.263s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:39 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-fd5e64f3-4202-499c-906a-dfdc49fb43f2 tempest-VolumeDependencyTests-500709084 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:09:39 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-fd5e64f3-4202-499c-906a-dfdc49fb43f2 tempest-VolumeDependencyTests-500709084 None] Deleted volume successfully. Jul 30 17:09:39 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-fd5e64f3-4202-499c-906a-dfdc49fb43f2 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-2d48bfa2-dfb0-4990-a275-d31b3723c2a2-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:39 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae5a5a74-fe05-46c3-b740-68c6b6288f2c tempest-ProjectMemberTests-1145856324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:09:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ae5a5a74-fe05-46c3-b740-68c6b6288f2c tempest-ProjectMemberTests-1145856324 None] Flow 'volume_create_manager' (8fa6b91c-ad80-4192-adc9-952eb4979106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:09:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ae5a5a74-fe05-46c3-b740-68c6b6288f2c tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51d3d76a-5b22-496f-9231-7e2a1326074a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ae5a5a74-fe05-46c3-b740-68c6b6288f2c tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51d3d76a-5b22-496f-9231-7e2a1326074a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-886185069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=743f5c90-1a91-4771-acbc-427dc0ae751b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26c22addd8364bc982bc8002f431ee32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:09:40Z,use_quota=True,user_id='c9da4889b5dd47d3bb88b442a104a944',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ae5a5a74-fe05-46c3-b740-68c6b6288f2c tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04c2a6dd-1fa0-4ca1-921a-6b508d517ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ae5a5a74-fe05-46c3-b740-68c6b6288f2c tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04c2a6dd-1fa0-4ca1-921a-6b508d517ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ae5a5a74-fe05-46c3-b740-68c6b6288f2c tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0289e0d2-581b-45d4-a4d2-407e1aec12a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ae5a5a74-fe05-46c3-b740-68c6b6288f2c tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0289e0d2-581b-45d4-a4d2-407e1aec12a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '743f5c90-1a91-4771-acbc-427dc0ae751b', 'volume_name': 'volume-743f5c90-1a91-4771-acbc-427dc0ae751b', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ae5a5a74-fe05-46c3-b740-68c6b6288f2c tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7579032c-19a4-4cdf-95ea-498470697fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ae5a5a74-fe05-46c3-b740-68c6b6288f2c tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7579032c-19a4-4cdf-95ea-498470697fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ae5a5a74-fe05-46c3-b740-68c6b6288f2c tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f83d5ef-38b0-4b38-81db-a7b4f342e7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:40 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-ae5a5a74-fe05-46c3-b740-68c6b6288f2c tempest-ProjectMemberTests-1145856324 None] Volume 743f5c90-1a91-4771-acbc-427dc0ae751b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-743f5c90-1a91-4771-acbc-427dc0ae751b', 'volume_size': 1} Jul 30 17:09:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ae5a5a74-fe05-46c3-b740-68c6b6288f2c tempest-ProjectMemberTests-1145856324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ae5a5a74-fe05-46c3-b740-68c6b6288f2c tempest-ProjectMemberTests-1145856324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:40 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ae5a5a74-fe05-46c3-b740-68c6b6288f2c tempest-ProjectMemberTests-1145856324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-886185069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=743f5c90-1a91-4771-acbc-427dc0ae751b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26c22addd8364bc982bc8002f431ee32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:09:40Z,use_quota=True,user_id='c9da4889b5dd47d3bb88b442a104a944',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:09:40 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-ae5a5a74-fe05-46c3-b740-68c6b6288f2c tempest-ProjectMemberTests-1145856324 None] Creating volume 743f5c90-1a91-4771-acbc-427dc0ae751b {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:09:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ae5a5a74-fe05-46c3-b740-68c6b6288f2c tempest-ProjectMemberTests-1145856324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ae5a5a74-fe05-46c3-b740-68c6b6288f2c tempest-ProjectMemberTests-1145856324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:40 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ae5a5a74-fe05-46c3-b740-68c6b6288f2c tempest-ProjectMemberTests-1145856324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:40 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ae5a5a74-fe05-46c3-b740-68c6b6288f2c tempest-ProjectMemberTests-1145856324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ae5a5a74-fe05-46c3-b740-68c6b6288f2c tempest-ProjectMemberTests-1145856324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:40 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ae5a5a74-fe05-46c3-b740-68c6b6288f2c tempest-ProjectMemberTests-1145856324 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:09:40 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-ae5a5a74-fe05-46c3-b740-68c6b6288f2c tempest-ProjectMemberTests-1145856324 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:09:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ae5a5a74-fe05-46c3-b740-68c6b6288f2c tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-743f5c90-1a91-4771-acbc-427dc0ae751b 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:40 devstack sudo[108932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-743f5c90-1a91-4771-acbc-427dc0ae751b 1073741824 Jul 30 17:09:40 devstack sudo[108932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:40 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7b15772b-b123-437f-8290-2f5be6dc78e6 tempest-VolumeDependencyTests-500709084 None] Acquiring lock "cinder-ad9d489b-be22-4b8d-8480-c74bf5af8bff-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:40 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7b15772b-b123-437f-8290-2f5be6dc78e6 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-ad9d489b-be22-4b8d-8480-c74bf5af8bff-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:40 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7b15772b-b123-437f-8290-2f5be6dc78e6 tempest-VolumeDependencyTests-500709084 None] Acquiring lock "cinder-quobyte-ad9d489b-be22-4b8d-8480-c74bf5af8bff" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:40 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7b15772b-b123-437f-8290-2f5be6dc78e6 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-ad9d489b-be22-4b8d-8480-c74bf5af8bff" acquired by "delete_volume" :: waited 0.024s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:40 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa93a1d-5bef-4e04-be6e-d7ae5587d550]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7b15772b-b123-437f-8290-2f5be6dc78e6 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:40 devstack sudo[108934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff Jul 30 17:09:40 devstack sudo[108934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:40 devstack sudo[108932]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ae5a5a74-fe05-46c3-b740-68c6b6288f2c tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-743f5c90-1a91-4771-acbc-427dc0ae751b 1073741824" returned: 0 in 0.699s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ae5a5a74-fe05-46c3-b740-68c6b6288f2c tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-743f5c90-1a91-4771-acbc-427dc0ae751b {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:40 devstack sudo[108943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-743f5c90-1a91-4771-acbc-427dc0ae751b Jul 30 17:09:40 devstack sudo[108943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:40 devstack sudo[108934]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7b15772b-b123-437f-8290-2f5be6dc78e6 tempest-VolumeDependencyTests-500709084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff" returned: 0 in 0.513s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7b15772b-b123-437f-8290-2f5be6dc78e6 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:41 devstack sudo[108945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff Jul 30 17:09:41 devstack sudo[108945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:41 devstack sudo[108943]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ae5a5a74-fe05-46c3-b740-68c6b6288f2c tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-743f5c90-1a91-4771-acbc-427dc0ae751b" returned: 0 in 0.348s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:41 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ae5a5a74-fe05-46c3-b740-68c6b6288f2c tempest-ProjectMemberTests-1145856324 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:09:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ae5a5a74-fe05-46c3-b740-68c6b6288f2c tempest-ProjectMemberTests-1145856324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:41 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ae5a5a74-fe05-46c3-b740-68c6b6288f2c tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f83d5ef-38b0-4b38-81db-a7b4f342e7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-743f5c90-1a91-4771-acbc-427dc0ae751b', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:41 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ae5a5a74-fe05-46c3-b740-68c6b6288f2c tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1436849b-d926-4532-a70a-e62afb5b38c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:41 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-ae5a5a74-fe05-46c3-b740-68c6b6288f2c tempest-ProjectMemberTests-1145856324 None] Volume volume-743f5c90-1a91-4771-acbc-427dc0ae751b (743f5c90-1a91-4771-acbc-427dc0ae751b): created successfully Jul 30 17:09:41 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ae5a5a74-fe05-46c3-b740-68c6b6288f2c tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1436849b-d926-4532-a70a-e62afb5b38c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:41 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ae5a5a74-fe05-46c3-b740-68c6b6288f2c tempest-ProjectMemberTests-1145856324 None] Flow 'volume_create_manager' (8fa6b91c-ad80-4192-adc9-952eb4979106) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:09:41 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-ae5a5a74-fe05-46c3-b740-68c6b6288f2c tempest-ProjectMemberTests-1145856324 None] Created volume successfully. Jul 30 17:09:41 devstack sudo[108945]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7b15772b-b123-437f-8290-2f5be6dc78e6 tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-ad9d489b-be22-4b8d-8480-c74bf5af8bff" returned: 0 in 0.398s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:41 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7b15772b-b123-437f-8290-2f5be6dc78e6 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-ad9d489b-be22-4b8d-8480-c74bf5af8bff" released by "delete_volume" :: held 0.991s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:41 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-7b15772b-b123-437f-8290-2f5be6dc78e6 tempest-VolumeDependencyTests-500709084 None] Created reservations ['c3b66f7b-ec56-4fec-a567-84d110014d85', '819c4f11-c6ff-4507-b68e-684c3b2ebf08', 'cab478ba-e09b-48c1-94f2-96a7065ac5cd', '66f8cd0a-4555-4cad-9b3a-2819a06aa855'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:09:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7b15772b-b123-437f-8290-2f5be6dc78e6 tempest-VolumeDependencyTests-500709084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7b15772b-b123-437f-8290-2f5be6dc78e6 tempest-VolumeDependencyTests-500709084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:41 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7b15772b-b123-437f-8290-2f5be6dc78e6 tempest-VolumeDependencyTests-500709084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:41 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7b15772b-b123-437f-8290-2f5be6dc78e6 tempest-VolumeDependencyTests-500709084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7b15772b-b123-437f-8290-2f5be6dc78e6 tempest-VolumeDependencyTests-500709084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7b15772b-b123-437f-8290-2f5be6dc78e6 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:41 devstack sudo[108949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:09:41 devstack sudo[108949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:41 devstack sudo[108949]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7b15772b-b123-437f-8290-2f5be6dc78e6 tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.251s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:41 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-7b15772b-b123-437f-8290-2f5be6dc78e6 tempest-VolumeDependencyTests-500709084 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:09:41 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-7b15772b-b123-437f-8290-2f5be6dc78e6 tempest-VolumeDependencyTests-500709084 None] Deleted volume successfully. Jul 30 17:09:41 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7b15772b-b123-437f-8290-2f5be6dc78e6 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-ad9d489b-be22-4b8d-8480-c74bf5af8bff-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5d8b23a7-759a-4235-89a5-670babedef80 tempest-ProjectMemberTests-1145856324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5d8b23a7-759a-4235-89a5-670babedef80 tempest-ProjectMemberTests-1145856324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:42 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-5d8b23a7-759a-4235-89a5-670babedef80 tempest-ProjectMemberTests-1145856324 None] Creating offline snapshot 4af28e86-c23e-4dea-a0b4-685af116c34c of volume 743f5c90-1a91-4771-acbc-427dc0ae751b {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:09:42 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[139741d2-2a25-4faf-83f2-ad5a571afe36]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5d8b23a7-759a-4235-89a5-670babedef80 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-743f5c90-1a91-4771-acbc-427dc0ae751b {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:42 devstack sudo[108952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-743f5c90-1a91-4771-acbc-427dc0ae751b Jul 30 17:09:42 devstack sudo[108952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:42 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-212ad222-0c52-4616-b545-748d7a838df0 tempest-VolumeDependencyTests-500709084 None] Acquiring lock "cinder-3cea10c9-b035-46ee-b30f-1b3af9b38b59-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:42 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-212ad222-0c52-4616-b545-748d7a838df0 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-3cea10c9-b035-46ee-b30f-1b3af9b38b59-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:42 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-212ad222-0c52-4616-b545-748d7a838df0 tempest-VolumeDependencyTests-500709084 None] Acquiring lock "cinder-quobyte-3cea10c9-b035-46ee-b30f-1b3af9b38b59" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:42 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-212ad222-0c52-4616-b545-748d7a838df0 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-3cea10c9-b035-46ee-b30f-1b3af9b38b59" acquired by "delete_volume" :: waited 0.018s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:42 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3f8871-62ea-45c6-8659-5a1292a4f60a]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-212ad222-0c52-4616-b545-748d7a838df0 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3cea10c9-b035-46ee-b30f-1b3af9b38b59 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:42 devstack sudo[108952]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5d8b23a7-759a-4235-89a5-670babedef80 tempest-ProjectMemberTests-1145856324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-743f5c90-1a91-4771-acbc-427dc0ae751b" returned: 0 in 0.395s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5d8b23a7-759a-4235-89a5-670babedef80 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-743f5c90-1a91-4771-acbc-427dc0ae751b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-743f5c90-1a91-4771-acbc-427dc0ae751b.4af28e86-c23e-4dea-a0b4-685af116c34c 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:42 devstack sudo[108959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-743f5c90-1a91-4771-acbc-427dc0ae751b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-743f5c90-1a91-4771-acbc-427dc0ae751b.4af28e86-c23e-4dea-a0b4-685af116c34c 1G Jul 30 17:09:42 devstack sudo[108959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:42 devstack sudo[108958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3cea10c9-b035-46ee-b30f-1b3af9b38b59 Jul 30 17:09:42 devstack sudo[108958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:43 devstack sudo[108958]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-212ad222-0c52-4616-b545-748d7a838df0 tempest-VolumeDependencyTests-500709084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3cea10c9-b035-46ee-b30f-1b3af9b38b59" returned: 0 in 0.403s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-212ad222-0c52-4616-b545-748d7a838df0 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3cea10c9-b035-46ee-b30f-1b3af9b38b59 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:43 devstack sudo[108969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3cea10c9-b035-46ee-b30f-1b3af9b38b59 Jul 30 17:09:43 devstack sudo[108969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:43 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbd3e519-1c1e-4927-b30c-a898abfb38a4 tempest-CinderUnicodeTest-1481336374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:09:43 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bbd3e519-1c1e-4927-b30c-a898abfb38a4 tempest-CinderUnicodeTest-1481336374 None] Flow 'volume_create_manager' (b89af9ae-4606-4f6d-a314-dfa55c2a9989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:09:43 devstack sudo[108959]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:43 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bbd3e519-1c1e-4927-b30c-a898abfb38a4 tempest-CinderUnicodeTest-1481336374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5028279-7da5-4873-a771-7583c258b6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5d8b23a7-759a-4235-89a5-670babedef80 tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-743f5c90-1a91-4771-acbc-427dc0ae751b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-743f5c90-1a91-4771-acbc-427dc0ae751b.4af28e86-c23e-4dea-a0b4-685af116c34c 1G" returned: 0 in 0.448s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5d8b23a7-759a-4235-89a5-670babedef80 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-743f5c90-1a91-4771-acbc-427dc0ae751b -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-743f5c90-1a91-4771-acbc-427dc0ae751b.4af28e86-c23e-4dea-a0b4-685af116c34c {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:43 devstack sudo[108971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-743f5c90-1a91-4771-acbc-427dc0ae751b -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-743f5c90-1a91-4771-acbc-427dc0ae751b.4af28e86-c23e-4dea-a0b4-685af116c34c Jul 30 17:09:43 devstack sudo[108971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:43 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bbd3e519-1c1e-4927-b30c-a898abfb38a4 tempest-CinderUnicodeTest-1481336374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5028279-7da5-4873-a771-7583c258b6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:09:43Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2943dab2-ae50-4e59-97ce-24945c23a755,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='736b9f1b5e6745158d08429fafceba6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:09:43Z,use_quota=True,user_id='77baeb6f42b749daaeefecbd3115aabb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:43 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bbd3e519-1c1e-4927-b30c-a898abfb38a4 tempest-CinderUnicodeTest-1481336374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02992d1d-73d0-499e-9a4c-664739ca45a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:43 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bbd3e519-1c1e-4927-b30c-a898abfb38a4 tempest-CinderUnicodeTest-1481336374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02992d1d-73d0-499e-9a4c-664739ca45a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:43 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bbd3e519-1c1e-4927-b30c-a898abfb38a4 tempest-CinderUnicodeTest-1481336374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5c76f70-9930-4d36-8f1f-26321074929f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:43 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bbd3e519-1c1e-4927-b30c-a898abfb38a4 tempest-CinderUnicodeTest-1481336374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5c76f70-9930-4d36-8f1f-26321074929f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2943dab2-ae50-4e59-97ce-24945c23a755', 'volume_name': 'volume-2943dab2-ae50-4e59-97ce-24945c23a755', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:43 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bbd3e519-1c1e-4927-b30c-a898abfb38a4 tempest-CinderUnicodeTest-1481336374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ab21701-eacc-4cc7-894f-1103a8374885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:43 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bbd3e519-1c1e-4927-b30c-a898abfb38a4 tempest-CinderUnicodeTest-1481336374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ab21701-eacc-4cc7-894f-1103a8374885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:43 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bbd3e519-1c1e-4927-b30c-a898abfb38a4 tempest-CinderUnicodeTest-1481336374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ecb67fd-44ae-4a78-a540-04e358fad00a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:43 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-bbd3e519-1c1e-4927-b30c-a898abfb38a4 tempest-CinderUnicodeTest-1481336374 None] Volume 2943dab2-ae50-4e59-97ce-24945c23a755: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2943dab2-ae50-4e59-97ce-24945c23a755', 'volume_size': 1} Jul 30 17:09:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-bbd3e519-1c1e-4927-b30c-a898abfb38a4 tempest-CinderUnicodeTest-1481336374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:43 devstack sudo[108969]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-212ad222-0c52-4616-b545-748d7a838df0 tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3cea10c9-b035-46ee-b30f-1b3af9b38b59" returned: 0 in 0.273s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:43 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-212ad222-0c52-4616-b545-748d7a838df0 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-3cea10c9-b035-46ee-b30f-1b3af9b38b59" released by "delete_volume" :: held 0.720s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:43 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-212ad222-0c52-4616-b545-748d7a838df0 tempest-VolumeDependencyTests-500709084 None] Created reservations ['ec37ef04-5498-4af4-bd1b-9aded57ec1c9', '89b1de33-7aad-4501-8cfb-c2cceb098b03', '1ea1850d-28ea-48f8-8ef4-ef8cc7010524', 'edffc270-6181-4431-aad8-f80cc8245cbf'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:09:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-212ad222-0c52-4616-b545-748d7a838df0 tempest-VolumeDependencyTests-500709084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-212ad222-0c52-4616-b545-748d7a838df0 tempest-VolumeDependencyTests-500709084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:43 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-212ad222-0c52-4616-b545-748d7a838df0 tempest-VolumeDependencyTests-500709084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:43 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-212ad222-0c52-4616-b545-748d7a838df0 tempest-VolumeDependencyTests-500709084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-212ad222-0c52-4616-b545-748d7a838df0 tempest-VolumeDependencyTests-500709084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-212ad222-0c52-4616-b545-748d7a838df0 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:43 devstack sudo[108971]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5d8b23a7-759a-4235-89a5-670babedef80 tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-743f5c90-1a91-4771-acbc-427dc0ae751b -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-743f5c90-1a91-4771-acbc-427dc0ae751b.4af28e86-c23e-4dea-a0b4-685af116c34c" returned: 0 in 0.334s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:43 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-5d8b23a7-759a-4235-89a5-670babedef80 tempest-ProjectMemberTests-1145856324 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-743f5c90-1a91-4771-acbc-427dc0ae751b.4af28e86-c23e-4dea-a0b4-685af116c34c is being set with open permissions: ugo+rw Jul 30 17:09:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5d8b23a7-759a-4235-89a5-670babedef80 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-743f5c90-1a91-4771-acbc-427dc0ae751b.4af28e86-c23e-4dea-a0b4-685af116c34c {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:43 devstack sudo[108977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:09:43 devstack sudo[108977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:43 devstack sudo[108979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-743f5c90-1a91-4771-acbc-427dc0ae751b.4af28e86-c23e-4dea-a0b4-685af116c34c Jul 30 17:09:43 devstack sudo[108979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:43 devstack sudo[108977]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-212ad222-0c52-4616-b545-748d7a838df0 tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.256s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:43 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-212ad222-0c52-4616-b545-748d7a838df0 tempest-VolumeDependencyTests-500709084 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:09:43 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-212ad222-0c52-4616-b545-748d7a838df0 tempest-VolumeDependencyTests-500709084 None] Deleted volume successfully. Jul 30 17:09:43 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-212ad222-0c52-4616-b545-748d7a838df0 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-3cea10c9-b035-46ee-b30f-1b3af9b38b59-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:43 devstack sudo[108979]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5d8b23a7-759a-4235-89a5-670babedef80 tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-743f5c90-1a91-4771-acbc-427dc0ae751b.4af28e86-c23e-4dea-a0b4-685af116c34c" returned: 0 in 0.274s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5d8b23a7-759a-4235-89a5-670babedef80 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-743f5c90-1a91-4771-acbc-427dc0ae751b.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:43 devstack sudo[108983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-743f5c90-1a91-4771-acbc-427dc0ae751b.info Jul 30 17:09:43 devstack sudo[108983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:44 devstack sudo[108983]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5d8b23a7-759a-4235-89a5-670babedef80 tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-743f5c90-1a91-4771-acbc-427dc0ae751b.info" returned: 0 in 0.305s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:44 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-5d8b23a7-759a-4235-89a5-670babedef80 tempest-ProjectMemberTests-1145856324 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-743f5c90-1a91-4771-acbc-427dc0ae751b.info is being set with open permissions: ugo+rw Jul 30 17:09:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5d8b23a7-759a-4235-89a5-670babedef80 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-743f5c90-1a91-4771-acbc-427dc0ae751b.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:44 devstack sudo[108986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-743f5c90-1a91-4771-acbc-427dc0ae751b.info Jul 30 17:09:44 devstack sudo[108986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:44 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad623b52-770a-4cb8-a214-9d956f9cfe69 tempest-VolumeDependencyTests-500709084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:09:44 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ad623b52-770a-4cb8-a214-9d956f9cfe69 tempest-VolumeDependencyTests-500709084 None] Flow 'volume_create_manager' (4da45f1c-efb7-4f52-96c6-56c371a88a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:09:44 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ad623b52-770a-4cb8-a214-9d956f9cfe69 tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccc57b75-d337-4068-b2c3-8677396b8d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:44 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ad623b52-770a-4cb8-a214-9d956f9cfe69 tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccc57b75-d337-4068-b2c3-8677396b8d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1843636763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c32018b7-3311-49c9-b350-b8c599c66834,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75be733264504175956c041c2312fa52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:09:44Z,use_quota=True,user_id='9ee0dab1317a4cfeafb4f6b50ca81a57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:44 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ad623b52-770a-4cb8-a214-9d956f9cfe69 tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6dabe00-8a44-450b-8ed9-a4e05f581f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:44 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ad623b52-770a-4cb8-a214-9d956f9cfe69 tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6dabe00-8a44-450b-8ed9-a4e05f581f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:44 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ad623b52-770a-4cb8-a214-9d956f9cfe69 tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b01493a-399a-4394-8905-871a7db416be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:44 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ad623b52-770a-4cb8-a214-9d956f9cfe69 tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b01493a-399a-4394-8905-871a7db416be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c32018b7-3311-49c9-b350-b8c599c66834', 'volume_name': 'volume-c32018b7-3311-49c9-b350-b8c599c66834', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:44 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ad623b52-770a-4cb8-a214-9d956f9cfe69 tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd8a9faf-bd79-41a1-a13f-21acba4d18fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:44 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ad623b52-770a-4cb8-a214-9d956f9cfe69 tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd8a9faf-bd79-41a1-a13f-21acba4d18fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:44 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ad623b52-770a-4cb8-a214-9d956f9cfe69 tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (355ad44f-5e1d-4e6e-aea5-817957221fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:44 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-ad623b52-770a-4cb8-a214-9d956f9cfe69 tempest-VolumeDependencyTests-500709084 None] Volume c32018b7-3311-49c9-b350-b8c599c66834: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c32018b7-3311-49c9-b350-b8c599c66834', 'volume_size': 1} Jul 30 17:09:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ad623b52-770a-4cb8-a214-9d956f9cfe69 tempest-VolumeDependencyTests-500709084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:44 devstack sudo[108986]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5d8b23a7-759a-4235-89a5-670babedef80 tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-743f5c90-1a91-4771-acbc-427dc0ae751b.info" returned: 0 in 0.255s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5d8b23a7-759a-4235-89a5-670babedef80 tempest-ProjectMemberTests-1145856324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.093s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-bbd3e519-1c1e-4927-b30c-a898abfb38a4 tempest-CinderUnicodeTest-1481336374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.134s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:44 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-bbd3e519-1c1e-4927-b30c-a898abfb38a4 tempest-CinderUnicodeTest-1481336374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:09:43Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2943dab2-ae50-4e59-97ce-24945c23a755,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='736b9f1b5e6745158d08429fafceba6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:09:43Z,use_quota=True,user_id='77baeb6f42b749daaeefecbd3115aabb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:09:44 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-bbd3e519-1c1e-4927-b30c-a898abfb38a4 tempest-CinderUnicodeTest-1481336374 None] Creating volume 2943dab2-ae50-4e59-97ce-24945c23a755 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:09:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-bbd3e519-1c1e-4927-b30c-a898abfb38a4 tempest-CinderUnicodeTest-1481336374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-bbd3e519-1c1e-4927-b30c-a898abfb38a4 tempest-CinderUnicodeTest-1481336374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:44 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-bbd3e519-1c1e-4927-b30c-a898abfb38a4 tempest-CinderUnicodeTest-1481336374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:44 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-bbd3e519-1c1e-4927-b30c-a898abfb38a4 tempest-CinderUnicodeTest-1481336374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-bbd3e519-1c1e-4927-b30c-a898abfb38a4 tempest-CinderUnicodeTest-1481336374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:44 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-bbd3e519-1c1e-4927-b30c-a898abfb38a4 tempest-CinderUnicodeTest-1481336374 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:09:44 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-bbd3e519-1c1e-4927-b30c-a898abfb38a4 tempest-CinderUnicodeTest-1481336374 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:09:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bbd3e519-1c1e-4927-b30c-a898abfb38a4 tempest-CinderUnicodeTest-1481336374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2943dab2-ae50-4e59-97ce-24945c23a755 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:44 devstack sudo[108989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2943dab2-ae50-4e59-97ce-24945c23a755 1073741824 Jul 30 17:09:44 devstack sudo[108989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:44 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-5d8b23a7-759a-4235-89a5-670babedef80 tempest-ProjectMemberTests-1145856324 None] Create snapshot completed successfully Jul 30 17:09:44 devstack sudo[108989]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bbd3e519-1c1e-4927-b30c-a898abfb38a4 tempest-CinderUnicodeTest-1481336374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2943dab2-ae50-4e59-97ce-24945c23a755 1073741824" returned: 0 in 0.413s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bbd3e519-1c1e-4927-b30c-a898abfb38a4 tempest-CinderUnicodeTest-1481336374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2943dab2-ae50-4e59-97ce-24945c23a755 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:44 devstack sudo[108994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2943dab2-ae50-4e59-97ce-24945c23a755 Jul 30 17:09:44 devstack sudo[108994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:45 devstack sudo[108994]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bbd3e519-1c1e-4927-b30c-a898abfb38a4 tempest-CinderUnicodeTest-1481336374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2943dab2-ae50-4e59-97ce-24945c23a755" returned: 0 in 0.244s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:45 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-bbd3e519-1c1e-4927-b30c-a898abfb38a4 tempest-CinderUnicodeTest-1481336374 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:09:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-bbd3e519-1c1e-4927-b30c-a898abfb38a4 tempest-CinderUnicodeTest-1481336374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ad623b52-770a-4cb8-a214-9d956f9cfe69 tempest-VolumeDependencyTests-500709084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.780s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:45 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ad623b52-770a-4cb8-a214-9d956f9cfe69 tempest-VolumeDependencyTests-500709084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1843636763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c32018b7-3311-49c9-b350-b8c599c66834,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75be733264504175956c041c2312fa52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:09:44Z,use_quota=True,user_id='9ee0dab1317a4cfeafb4f6b50ca81a57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:09:45 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-ad623b52-770a-4cb8-a214-9d956f9cfe69 tempest-VolumeDependencyTests-500709084 None] Creating volume c32018b7-3311-49c9-b350-b8c599c66834 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:09:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ad623b52-770a-4cb8-a214-9d956f9cfe69 tempest-VolumeDependencyTests-500709084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ad623b52-770a-4cb8-a214-9d956f9cfe69 tempest-VolumeDependencyTests-500709084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:45 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ad623b52-770a-4cb8-a214-9d956f9cfe69 tempest-VolumeDependencyTests-500709084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:45 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ad623b52-770a-4cb8-a214-9d956f9cfe69 tempest-VolumeDependencyTests-500709084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ad623b52-770a-4cb8-a214-9d956f9cfe69 tempest-VolumeDependencyTests-500709084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:45 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ad623b52-770a-4cb8-a214-9d956f9cfe69 tempest-VolumeDependencyTests-500709084 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:09:45 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-ad623b52-770a-4cb8-a214-9d956f9cfe69 tempest-VolumeDependencyTests-500709084 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:09:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ad623b52-770a-4cb8-a214-9d956f9cfe69 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c32018b7-3311-49c9-b350-b8c599c66834 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:45 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bbd3e519-1c1e-4927-b30c-a898abfb38a4 tempest-CinderUnicodeTest-1481336374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ecb67fd-44ae-4a78-a540-04e358fad00a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2943dab2-ae50-4e59-97ce-24945c23a755', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:45 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bbd3e519-1c1e-4927-b30c-a898abfb38a4 tempest-CinderUnicodeTest-1481336374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19c33575-4639-456c-b179-11a47ef87ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:45 devstack sudo[108997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c32018b7-3311-49c9-b350-b8c599c66834 1073741824 Jul 30 17:09:45 devstack sudo[108997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:45 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-bbd3e519-1c1e-4927-b30c-a898abfb38a4 tempest-CinderUnicodeTest-1481336374 None] Volume volume-2943dab2-ae50-4e59-97ce-24945c23a755 (2943dab2-ae50-4e59-97ce-24945c23a755): created successfully Jul 30 17:09:45 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bbd3e519-1c1e-4927-b30c-a898abfb38a4 tempest-CinderUnicodeTest-1481336374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19c33575-4639-456c-b179-11a47ef87ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:45 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bbd3e519-1c1e-4927-b30c-a898abfb38a4 tempest-CinderUnicodeTest-1481336374 None] Flow 'volume_create_manager' (b89af9ae-4606-4f6d-a314-dfa55c2a9989) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:09:45 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-bbd3e519-1c1e-4927-b30c-a898abfb38a4 tempest-CinderUnicodeTest-1481336374 None] Created volume successfully. Jul 30 17:09:45 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-272fa884-b100-417f-87fe-e41dcea67aab tempest-ProjectMemberTests-1145856324 None] Acquiring lock "cinder-4af28e86-c23e-4dea-a0b4-685af116c34c-delete_snapshot" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:45 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-272fa884-b100-417f-87fe-e41dcea67aab tempest-ProjectMemberTests-1145856324 None] Lock "cinder-4af28e86-c23e-4dea-a0b4-685af116c34c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:45 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-272fa884-b100-417f-87fe-e41dcea67aab tempest-ProjectMemberTests-1145856324 None] Acquiring lock "cinder-quobyte-743f5c90-1a91-4771-acbc-427dc0ae751b" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:45 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-272fa884-b100-417f-87fe-e41dcea67aab tempest-ProjectMemberTests-1145856324 None] Lock "cinder-quobyte-743f5c90-1a91-4771-acbc-427dc0ae751b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:45 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-272fa884-b100-417f-87fe-e41dcea67aab tempest-ProjectMemberTests-1145856324 None] Acquiring lock "cinder-quobyte-4af28e86-c23e-4dea-a0b4-685af116c34c" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:45 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-272fa884-b100-417f-87fe-e41dcea67aab tempest-ProjectMemberTests-1145856324 None] Lock "cinder-quobyte-4af28e86-c23e-4dea-a0b4-685af116c34c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:45 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-272fa884-b100-417f-87fe-e41dcea67aab tempest-ProjectMemberTests-1145856324 None] Deleting offline snapshot 4af28e86-c23e-4dea-a0b4-685af116c34c of volume 743f5c90-1a91-4771-acbc-427dc0ae751b {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:09:45 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-272fa884-b100-417f-87fe-e41dcea67aab tempest-ProjectMemberTests-1145856324 None] snapshot_file for this snap is: volume-743f5c90-1a91-4771-acbc-427dc0ae751b.4af28e86-c23e-4dea-a0b4-685af116c34c {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:09:45 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02ed633-00f7-46a3-8190-5ec91caa4930]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-272fa884-b100-417f-87fe-e41dcea67aab tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-743f5c90-1a91-4771-acbc-427dc0ae751b.4af28e86-c23e-4dea-a0b4-685af116c34c {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:45 devstack sudo[108997]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ad623b52-770a-4cb8-a214-9d956f9cfe69 tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c32018b7-3311-49c9-b350-b8c599c66834 1073741824" returned: 0 in 0.482s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ad623b52-770a-4cb8-a214-9d956f9cfe69 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c32018b7-3311-49c9-b350-b8c599c66834 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:45 devstack sudo[109004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c32018b7-3311-49c9-b350-b8c599c66834 Jul 30 17:09:45 devstack sudo[109004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:45 devstack sudo[109003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-743f5c90-1a91-4771-acbc-427dc0ae751b.4af28e86-c23e-4dea-a0b4-685af116c34c Jul 30 17:09:45 devstack sudo[109003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:45 devstack sudo[109004]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ad623b52-770a-4cb8-a214-9d956f9cfe69 tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c32018b7-3311-49c9-b350-b8c599c66834" returned: 0 in 0.258s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:45 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ad623b52-770a-4cb8-a214-9d956f9cfe69 tempest-VolumeDependencyTests-500709084 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:09:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ad623b52-770a-4cb8-a214-9d956f9cfe69 tempest-VolumeDependencyTests-500709084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:45 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ad623b52-770a-4cb8-a214-9d956f9cfe69 tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (355ad44f-5e1d-4e6e-aea5-817957221fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c32018b7-3311-49c9-b350-b8c599c66834', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:45 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ad623b52-770a-4cb8-a214-9d956f9cfe69 tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (431214a6-d237-41d2-acd3-6cac1fa02691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:45 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-ad623b52-770a-4cb8-a214-9d956f9cfe69 tempest-VolumeDependencyTests-500709084 None] Volume volume-c32018b7-3311-49c9-b350-b8c599c66834 (c32018b7-3311-49c9-b350-b8c599c66834): created successfully Jul 30 17:09:45 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ad623b52-770a-4cb8-a214-9d956f9cfe69 tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (431214a6-d237-41d2-acd3-6cac1fa02691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:45 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ad623b52-770a-4cb8-a214-9d956f9cfe69 tempest-VolumeDependencyTests-500709084 None] Flow 'volume_create_manager' (4da45f1c-efb7-4f52-96c6-56c371a88a9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:09:45 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-ad623b52-770a-4cb8-a214-9d956f9cfe69 tempest-VolumeDependencyTests-500709084 None] Created volume successfully. Jul 30 17:09:45 devstack sudo[109003]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-272fa884-b100-417f-87fe-e41dcea67aab tempest-ProjectMemberTests-1145856324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-743f5c90-1a91-4771-acbc-427dc0ae751b.4af28e86-c23e-4dea-a0b4-685af116c34c" returned: 0 in 0.374s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:45 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-272fa884-b100-417f-87fe-e41dcea67aab tempest-ProjectMemberTests-1145856324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-743f5c90-1a91-4771-acbc-427dc0ae751b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:09:45 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ff8296-4890-4dff-915f-df651ad7b090]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-272fa884-b100-417f-87fe-e41dcea67aab tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-743f5c90-1a91-4771-acbc-427dc0ae751b {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:46 devstack sudo[109011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-743f5c90-1a91-4771-acbc-427dc0ae751b Jul 30 17:09:46 devstack sudo[109011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:46 devstack sudo[109011]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-272fa884-b100-417f-87fe-e41dcea67aab tempest-ProjectMemberTests-1145856324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-743f5c90-1a91-4771-acbc-427dc0ae751b" returned: 0 in 0.395s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-272fa884-b100-417f-87fe-e41dcea67aab tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-743f5c90-1a91-4771-acbc-427dc0ae751b.4af28e86-c23e-4dea-a0b4-685af116c34c {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:46 devstack sudo[109016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-743f5c90-1a91-4771-acbc-427dc0ae751b.4af28e86-c23e-4dea-a0b4-685af116c34c Jul 30 17:09:46 devstack sudo[109016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0ec29943-6b26-4825-8d23-7596fe961c39 tempest-VolumeDependencyTests-500709084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0ec29943-6b26-4825-8d23-7596fe961c39 tempest-VolumeDependencyTests-500709084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:46 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-0ec29943-6b26-4825-8d23-7596fe961c39 tempest-VolumeDependencyTests-500709084 None] Creating offline snapshot c08a9da3-21a7-49e9-ba15-255edab64abd of volume c32018b7-3311-49c9-b350-b8c599c66834 {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:09:46 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[340f7f24-c436-4fd8-88ff-f10ec73e99b2]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0ec29943-6b26-4825-8d23-7596fe961c39 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c32018b7-3311-49c9-b350-b8c599c66834 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:46 devstack sudo[109018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c32018b7-3311-49c9-b350-b8c599c66834 Jul 30 17:09:46 devstack sudo[109018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:46 devstack sudo[109016]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-272fa884-b100-417f-87fe-e41dcea67aab tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-743f5c90-1a91-4771-acbc-427dc0ae751b.4af28e86-c23e-4dea-a0b4-685af116c34c" returned: 0 in 0.422s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-272fa884-b100-417f-87fe-e41dcea67aab tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-743f5c90-1a91-4771-acbc-427dc0ae751b.4af28e86-c23e-4dea-a0b4-685af116c34c {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:46 devstack sudo[109023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-743f5c90-1a91-4771-acbc-427dc0ae751b.4af28e86-c23e-4dea-a0b4-685af116c34c Jul 30 17:09:46 devstack sudo[109023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:46 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc63fa19-e94a-4d65-805e-554f99c1eb43 tempest-CinderUnicodeTest-1481336374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:09:46 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-cc63fa19-e94a-4d65-805e-554f99c1eb43 tempest-CinderUnicodeTest-1481336374 None] Flow 'volume_create_manager' (443fbd97-ee76-4dd8-a09d-add63340bd70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:09:46 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-cc63fa19-e94a-4d65-805e-554f99c1eb43 tempest-CinderUnicodeTest-1481336374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04ff4313-486d-4bc7-b820-3b9112aee62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:46 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-cc63fa19-e94a-4d65-805e-554f99c1eb43 tempest-CinderUnicodeTest-1481336374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04ff4313-486d-4bc7-b820-3b9112aee62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:09:47Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1545283165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0915fdd4-19cc-43b8-a313-92152fced6da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='736b9f1b5e6745158d08429fafceba6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:09:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:09:47Z,use_quota=True,user_id='77baeb6f42b749daaeefecbd3115aabb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:46 devstack sudo[109018]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:46 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-cc63fa19-e94a-4d65-805e-554f99c1eb43 tempest-CinderUnicodeTest-1481336374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d61ef403-971f-4459-b06b-b4218c04ba22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:46 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-cc63fa19-e94a-4d65-805e-554f99c1eb43 tempest-CinderUnicodeTest-1481336374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d61ef403-971f-4459-b06b-b4218c04ba22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:46 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-cc63fa19-e94a-4d65-805e-554f99c1eb43 tempest-CinderUnicodeTest-1481336374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ddf4458-9df0-4dd5-9888-44a899d97eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:46 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-cc63fa19-e94a-4d65-805e-554f99c1eb43 tempest-CinderUnicodeTest-1481336374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ddf4458-9df0-4dd5-9888-44a899d97eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0915fdd4-19cc-43b8-a313-92152fced6da', 'volume_name': 'volume-0915fdd4-19cc-43b8-a313-92152fced6da', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:46 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-cc63fa19-e94a-4d65-805e-554f99c1eb43 tempest-CinderUnicodeTest-1481336374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6aa7e9d-8aaa-453d-b76f-dceb8e242521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:46 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-cc63fa19-e94a-4d65-805e-554f99c1eb43 tempest-CinderUnicodeTest-1481336374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6aa7e9d-8aaa-453d-b76f-dceb8e242521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:46 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-cc63fa19-e94a-4d65-805e-554f99c1eb43 tempest-CinderUnicodeTest-1481336374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8745d553-61b9-4425-b3ea-5911af47dee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:46 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-cc63fa19-e94a-4d65-805e-554f99c1eb43 tempest-CinderUnicodeTest-1481336374 None] Volume 0915fdd4-19cc-43b8-a313-92152fced6da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0915fdd4-19cc-43b8-a313-92152fced6da', 'volume_size': 1} Jul 30 17:09:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-cc63fa19-e94a-4d65-805e-554f99c1eb43 tempest-CinderUnicodeTest-1481336374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0ec29943-6b26-4825-8d23-7596fe961c39 tempest-VolumeDependencyTests-500709084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c32018b7-3311-49c9-b350-b8c599c66834" returned: 0 in 0.427s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0ec29943-6b26-4825-8d23-7596fe961c39 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c32018b7-3311-49c9-b350-b8c599c66834,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c32018b7-3311-49c9-b350-b8c599c66834.c08a9da3-21a7-49e9-ba15-255edab64abd 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:46 devstack sudo[109028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c32018b7-3311-49c9-b350-b8c599c66834,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c32018b7-3311-49c9-b350-b8c599c66834.c08a9da3-21a7-49e9-ba15-255edab64abd 1G Jul 30 17:09:46 devstack sudo[109028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:47 devstack sudo[109023]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-272fa884-b100-417f-87fe-e41dcea67aab tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-743f5c90-1a91-4771-acbc-427dc0ae751b.4af28e86-c23e-4dea-a0b4-685af116c34c" returned: 0 in 0.276s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:47 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-272fa884-b100-417f-87fe-e41dcea67aab tempest-ProjectMemberTests-1145856324 None] Lock "cinder-quobyte-4af28e86-c23e-4dea-a0b4-685af116c34c" released by "_delete_snapshot" :: held 1.579s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:47 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-272fa884-b100-417f-87fe-e41dcea67aab tempest-ProjectMemberTests-1145856324 None] Lock "cinder-quobyte-743f5c90-1a91-4771-acbc-427dc0ae751b" released by "delete_snapshot" :: held 1.608s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:47 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-272fa884-b100-417f-87fe-e41dcea67aab tempest-ProjectMemberTests-1145856324 None] Created reservations ['5f7c1fc7-00d2-4869-ab79-e06c8ad27038', 'cab91bc1-b086-4b32-a803-70529d3e83b5', 'e1d46442-64ea-4f7d-be7b-5420b8534904', 'c14403ed-4ddf-4126-b7ef-d23e07a2b9d5'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:09:47 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-272fa884-b100-417f-87fe-e41dcea67aab tempest-ProjectMemberTests-1145856324 None] Delete snapshot completed successfully. Jul 30 17:09:47 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-272fa884-b100-417f-87fe-e41dcea67aab tempest-ProjectMemberTests-1145856324 None] Lock "cinder-4af28e86-c23e-4dea-a0b4-685af116c34c-delete_snapshot" released by "delete_snapshot" :: held 1.749s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:47 devstack sudo[109028]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0ec29943-6b26-4825-8d23-7596fe961c39 tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c32018b7-3311-49c9-b350-b8c599c66834,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c32018b7-3311-49c9-b350-b8c599c66834.c08a9da3-21a7-49e9-ba15-255edab64abd 1G" returned: 0 in 0.416s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0ec29943-6b26-4825-8d23-7596fe961c39 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c32018b7-3311-49c9-b350-b8c599c66834 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c32018b7-3311-49c9-b350-b8c599c66834.c08a9da3-21a7-49e9-ba15-255edab64abd {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:47 devstack sudo[109034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c32018b7-3311-49c9-b350-b8c599c66834 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c32018b7-3311-49c9-b350-b8c599c66834.c08a9da3-21a7-49e9-ba15-255edab64abd Jul 30 17:09:47 devstack sudo[109034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:47 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-15669bf9-938d-43c8-a521-02def7cc30cb tempest-ProjectMemberTests-1145856324 None] Acquiring lock "cinder-743f5c90-1a91-4771-acbc-427dc0ae751b-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:47 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-15669bf9-938d-43c8-a521-02def7cc30cb tempest-ProjectMemberTests-1145856324 None] Lock "cinder-743f5c90-1a91-4771-acbc-427dc0ae751b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:47 devstack sudo[109034]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0ec29943-6b26-4825-8d23-7596fe961c39 tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c32018b7-3311-49c9-b350-b8c599c66834 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c32018b7-3311-49c9-b350-b8c599c66834.c08a9da3-21a7-49e9-ba15-255edab64abd" returned: 0 in 0.337s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:47 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-0ec29943-6b26-4825-8d23-7596fe961c39 tempest-VolumeDependencyTests-500709084 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c32018b7-3311-49c9-b350-b8c599c66834.c08a9da3-21a7-49e9-ba15-255edab64abd is being set with open permissions: ugo+rw Jul 30 17:09:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0ec29943-6b26-4825-8d23-7596fe961c39 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c32018b7-3311-49c9-b350-b8c599c66834.c08a9da3-21a7-49e9-ba15-255edab64abd {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:47 devstack sudo[109039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c32018b7-3311-49c9-b350-b8c599c66834.c08a9da3-21a7-49e9-ba15-255edab64abd Jul 30 17:09:47 devstack sudo[109039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:47 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-15669bf9-938d-43c8-a521-02def7cc30cb tempest-ProjectMemberTests-1145856324 None] Acquiring lock "cinder-quobyte-743f5c90-1a91-4771-acbc-427dc0ae751b" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:47 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-15669bf9-938d-43c8-a521-02def7cc30cb tempest-ProjectMemberTests-1145856324 None] Lock "cinder-quobyte-743f5c90-1a91-4771-acbc-427dc0ae751b" acquired by "delete_volume" :: waited 0.016s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:47 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[992cd201-3e4c-4b04-a622-2899d2cb78d4]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-15669bf9-938d-43c8-a521-02def7cc30cb tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-743f5c90-1a91-4771-acbc-427dc0ae751b {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:47 devstack sudo[109041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-743f5c90-1a91-4771-acbc-427dc0ae751b Jul 30 17:09:47 devstack sudo[109041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:47 devstack sudo[109039]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0ec29943-6b26-4825-8d23-7596fe961c39 tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c32018b7-3311-49c9-b350-b8c599c66834.c08a9da3-21a7-49e9-ba15-255edab64abd" returned: 0 in 0.254s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0ec29943-6b26-4825-8d23-7596fe961c39 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c32018b7-3311-49c9-b350-b8c599c66834.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:48 devstack sudo[109044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c32018b7-3311-49c9-b350-b8c599c66834.info Jul 30 17:09:48 devstack sudo[109044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:48 devstack sudo[109041]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-15669bf9-938d-43c8-a521-02def7cc30cb tempest-ProjectMemberTests-1145856324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-743f5c90-1a91-4771-acbc-427dc0ae751b" returned: 0 in 0.386s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-15669bf9-938d-43c8-a521-02def7cc30cb tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-743f5c90-1a91-4771-acbc-427dc0ae751b {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:48 devstack sudo[109050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-743f5c90-1a91-4771-acbc-427dc0ae751b Jul 30 17:09:48 devstack sudo[109050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:48 devstack sudo[109044]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0ec29943-6b26-4825-8d23-7596fe961c39 tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c32018b7-3311-49c9-b350-b8c599c66834.info" returned: 0 in 0.269s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:48 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-0ec29943-6b26-4825-8d23-7596fe961c39 tempest-VolumeDependencyTests-500709084 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c32018b7-3311-49c9-b350-b8c599c66834.info is being set with open permissions: ugo+rw Jul 30 17:09:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0ec29943-6b26-4825-8d23-7596fe961c39 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c32018b7-3311-49c9-b350-b8c599c66834.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:48 devstack sudo[109052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c32018b7-3311-49c9-b350-b8c599c66834.info Jul 30 17:09:48 devstack sudo[109052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:48 devstack sudo[109050]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-15669bf9-938d-43c8-a521-02def7cc30cb tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-743f5c90-1a91-4771-acbc-427dc0ae751b" returned: 0 in 0.246s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:48 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-15669bf9-938d-43c8-a521-02def7cc30cb tempest-ProjectMemberTests-1145856324 None] Lock "cinder-quobyte-743f5c90-1a91-4771-acbc-427dc0ae751b" released by "delete_volume" :: held 0.697s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:48 devstack sudo[109052]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-0ec29943-6b26-4825-8d23-7596fe961c39 tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c32018b7-3311-49c9-b350-b8c599c66834.info" returned: 0 in 0.266s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-0ec29943-6b26-4825-8d23-7596fe961c39 tempest-VolumeDependencyTests-500709084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.077s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-cc63fa19-e94a-4d65-805e-554f99c1eb43 tempest-CinderUnicodeTest-1481336374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.601s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:48 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-cc63fa19-e94a-4d65-805e-554f99c1eb43 tempest-CinderUnicodeTest-1481336374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:09:47Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1545283165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0915fdd4-19cc-43b8-a313-92152fced6da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='736b9f1b5e6745158d08429fafceba6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:09:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:09:47Z,use_quota=True,user_id='77baeb6f42b749daaeefecbd3115aabb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:09:48 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-cc63fa19-e94a-4d65-805e-554f99c1eb43 tempest-CinderUnicodeTest-1481336374 None] Creating volume 0915fdd4-19cc-43b8-a313-92152fced6da {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:09:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-cc63fa19-e94a-4d65-805e-554f99c1eb43 tempest-CinderUnicodeTest-1481336374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-cc63fa19-e94a-4d65-805e-554f99c1eb43 tempest-CinderUnicodeTest-1481336374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:48 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-cc63fa19-e94a-4d65-805e-554f99c1eb43 tempest-CinderUnicodeTest-1481336374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:48 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-cc63fa19-e94a-4d65-805e-554f99c1eb43 tempest-CinderUnicodeTest-1481336374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-cc63fa19-e94a-4d65-805e-554f99c1eb43 tempest-CinderUnicodeTest-1481336374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:48 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-cc63fa19-e94a-4d65-805e-554f99c1eb43 tempest-CinderUnicodeTest-1481336374 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:09:48 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-cc63fa19-e94a-4d65-805e-554f99c1eb43 tempest-CinderUnicodeTest-1481336374 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:09:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cc63fa19-e94a-4d65-805e-554f99c1eb43 tempest-CinderUnicodeTest-1481336374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0915fdd4-19cc-43b8-a313-92152fced6da 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:48 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-15669bf9-938d-43c8-a521-02def7cc30cb tempest-ProjectMemberTests-1145856324 None] Created reservations ['a8bdb0a7-02de-4597-9098-89968548e913', 'f3f33687-f868-4e2c-aebf-2304c57052bf', 'a995ff69-7568-4a16-bedc-455cd72795b4', '003d0680-0acc-4d81-937e-abbab1a83f90'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:09:48 devstack sudo[109056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0915fdd4-19cc-43b8-a313-92152fced6da 1073741824 Jul 30 17:09:48 devstack sudo[109056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:48 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-0ec29943-6b26-4825-8d23-7596fe961c39 tempest-VolumeDependencyTests-500709084 None] Create snapshot completed successfully Jul 30 17:09:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-15669bf9-938d-43c8-a521-02def7cc30cb tempest-ProjectMemberTests-1145856324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-15669bf9-938d-43c8-a521-02def7cc30cb tempest-ProjectMemberTests-1145856324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:48 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-15669bf9-938d-43c8-a521-02def7cc30cb tempest-ProjectMemberTests-1145856324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:48 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-15669bf9-938d-43c8-a521-02def7cc30cb tempest-ProjectMemberTests-1145856324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-15669bf9-938d-43c8-a521-02def7cc30cb tempest-ProjectMemberTests-1145856324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-15669bf9-938d-43c8-a521-02def7cc30cb tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:48 devstack sudo[109058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:09:48 devstack sudo[109058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:48 devstack sudo[109058]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-15669bf9-938d-43c8-a521-02def7cc30cb tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.282s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:48 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-15669bf9-938d-43c8-a521-02def7cc30cb tempest-ProjectMemberTests-1145856324 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:09:48 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-15669bf9-938d-43c8-a521-02def7cc30cb tempest-ProjectMemberTests-1145856324 None] Deleted volume successfully. Jul 30 17:09:48 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-15669bf9-938d-43c8-a521-02def7cc30cb tempest-ProjectMemberTests-1145856324 None] Lock "cinder-743f5c90-1a91-4771-acbc-427dc0ae751b-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:49 devstack sudo[109056]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cc63fa19-e94a-4d65-805e-554f99c1eb43 tempest-CinderUnicodeTest-1481336374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0915fdd4-19cc-43b8-a313-92152fced6da 1073741824" returned: 0 in 0.488s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cc63fa19-e94a-4d65-805e-554f99c1eb43 tempest-CinderUnicodeTest-1481336374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0915fdd4-19cc-43b8-a313-92152fced6da {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:49 devstack sudo[109065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0915fdd4-19cc-43b8-a313-92152fced6da Jul 30 17:09:49 devstack sudo[109065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:49 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c694b99-c940-4b79-95d9-939d66e5997e tempest-ProjectMemberTests-1145856324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:09:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5c694b99-c940-4b79-95d9-939d66e5997e tempest-ProjectMemberTests-1145856324 None] Flow 'volume_create_manager' (4d530074-658b-4e7c-8837-3d17459f5933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:09:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5c694b99-c940-4b79-95d9-939d66e5997e tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd71896d-479d-4975-bb3d-a293bce398de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5c694b99-c940-4b79-95d9-939d66e5997e tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd71896d-479d-4975-bb3d-a293bce398de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-981674834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71333762-ff1f-494b-8076-51720b5ae831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26c22addd8364bc982bc8002f431ee32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:09:49Z,use_quota=True,user_id='c9da4889b5dd47d3bb88b442a104a944',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5c694b99-c940-4b79-95d9-939d66e5997e tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1526882f-5a1b-4234-ada8-34cd530982ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5c694b99-c940-4b79-95d9-939d66e5997e tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1526882f-5a1b-4234-ada8-34cd530982ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5c694b99-c940-4b79-95d9-939d66e5997e tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a53c58a0-0f58-40b5-9011-b2db24e2240d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5c694b99-c940-4b79-95d9-939d66e5997e tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a53c58a0-0f58-40b5-9011-b2db24e2240d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71333762-ff1f-494b-8076-51720b5ae831', 'volume_name': 'volume-71333762-ff1f-494b-8076-51720b5ae831', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5c694b99-c940-4b79-95d9-939d66e5997e tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bacb29f3-9e89-444c-9f02-6f62763bb115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:49 devstack sudo[109065]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5c694b99-c940-4b79-95d9-939d66e5997e tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bacb29f3-9e89-444c-9f02-6f62763bb115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5c694b99-c940-4b79-95d9-939d66e5997e tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08a182b0-154d-44d9-9c31-8f2386a0376a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:49 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-5c694b99-c940-4b79-95d9-939d66e5997e tempest-ProjectMemberTests-1145856324 None] Volume 71333762-ff1f-494b-8076-51720b5ae831: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71333762-ff1f-494b-8076-51720b5ae831', 'volume_size': 1} Jul 30 17:09:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5c694b99-c940-4b79-95d9-939d66e5997e tempest-ProjectMemberTests-1145856324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cc63fa19-e94a-4d65-805e-554f99c1eb43 tempest-CinderUnicodeTest-1481336374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0915fdd4-19cc-43b8-a313-92152fced6da" returned: 0 in 0.291s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:49 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-cc63fa19-e94a-4d65-805e-554f99c1eb43 tempest-CinderUnicodeTest-1481336374 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:09:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-cc63fa19-e94a-4d65-805e-554f99c1eb43 tempest-CinderUnicodeTest-1481336374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5c694b99-c940-4b79-95d9-939d66e5997e tempest-ProjectMemberTests-1145856324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:49 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-5c694b99-c940-4b79-95d9-939d66e5997e tempest-ProjectMemberTests-1145856324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-981674834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71333762-ff1f-494b-8076-51720b5ae831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26c22addd8364bc982bc8002f431ee32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:09:49Z,use_quota=True,user_id='c9da4889b5dd47d3bb88b442a104a944',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:09:49 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-5c694b99-c940-4b79-95d9-939d66e5997e tempest-ProjectMemberTests-1145856324 None] Creating volume 71333762-ff1f-494b-8076-51720b5ae831 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:09:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5c694b99-c940-4b79-95d9-939d66e5997e tempest-ProjectMemberTests-1145856324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5c694b99-c940-4b79-95d9-939d66e5997e tempest-ProjectMemberTests-1145856324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:49 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-5c694b99-c940-4b79-95d9-939d66e5997e tempest-ProjectMemberTests-1145856324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:49 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-5c694b99-c940-4b79-95d9-939d66e5997e tempest-ProjectMemberTests-1145856324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5c694b99-c940-4b79-95d9-939d66e5997e tempest-ProjectMemberTests-1145856324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:49 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-5c694b99-c940-4b79-95d9-939d66e5997e tempest-ProjectMemberTests-1145856324 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:09:49 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-5c694b99-c940-4b79-95d9-939d66e5997e tempest-ProjectMemberTests-1145856324 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:09:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5c694b99-c940-4b79-95d9-939d66e5997e tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71333762-ff1f-494b-8076-51720b5ae831 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-cc63fa19-e94a-4d65-805e-554f99c1eb43 tempest-CinderUnicodeTest-1481336374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8745d553-61b9-4425-b3ea-5911af47dee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0915fdd4-19cc-43b8-a313-92152fced6da', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-cc63fa19-e94a-4d65-805e-554f99c1eb43 tempest-CinderUnicodeTest-1481336374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43c3d5e4-203f-4db4-89d9-0ac07365da33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:49 devstack sudo[109068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71333762-ff1f-494b-8076-51720b5ae831 1073741824 Jul 30 17:09:49 devstack sudo[109068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:49 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-cc63fa19-e94a-4d65-805e-554f99c1eb43 tempest-CinderUnicodeTest-1481336374 None] Volume volume-0915fdd4-19cc-43b8-a313-92152fced6da (0915fdd4-19cc-43b8-a313-92152fced6da): created successfully Jul 30 17:09:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-cc63fa19-e94a-4d65-805e-554f99c1eb43 tempest-CinderUnicodeTest-1481336374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43c3d5e4-203f-4db4-89d9-0ac07365da33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:49 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-cc63fa19-e94a-4d65-805e-554f99c1eb43 tempest-CinderUnicodeTest-1481336374 None] Flow 'volume_create_manager' (443fbd97-ee76-4dd8-a09d-add63340bd70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:09:49 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-cc63fa19-e94a-4d65-805e-554f99c1eb43 tempest-CinderUnicodeTest-1481336374 None] Created volume successfully. Jul 30 17:09:49 devstack sudo[109068]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5c694b99-c940-4b79-95d9-939d66e5997e tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71333762-ff1f-494b-8076-51720b5ae831 1073741824" returned: 0 in 0.442s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5c694b99-c940-4b79-95d9-939d66e5997e tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71333762-ff1f-494b-8076-51720b5ae831 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:49 devstack sudo[109074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71333762-ff1f-494b-8076-51720b5ae831 Jul 30 17:09:49 devstack sudo[109074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:50 devstack sudo[109074]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5c694b99-c940-4b79-95d9-939d66e5997e tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71333762-ff1f-494b-8076-51720b5ae831" returned: 0 in 0.274s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:50 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-5c694b99-c940-4b79-95d9-939d66e5997e tempest-ProjectMemberTests-1145856324 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:09:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5c694b99-c940-4b79-95d9-939d66e5997e tempest-ProjectMemberTests-1145856324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5c694b99-c940-4b79-95d9-939d66e5997e tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08a182b0-154d-44d9-9c31-8f2386a0376a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71333762-ff1f-494b-8076-51720b5ae831', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5c694b99-c940-4b79-95d9-939d66e5997e tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83b1109c-acc0-439a-9bf2-34d163111bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:50 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-5c694b99-c940-4b79-95d9-939d66e5997e tempest-ProjectMemberTests-1145856324 None] Volume volume-71333762-ff1f-494b-8076-51720b5ae831 (71333762-ff1f-494b-8076-51720b5ae831): created successfully Jul 30 17:09:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5c694b99-c940-4b79-95d9-939d66e5997e tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83b1109c-acc0-439a-9bf2-34d163111bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-5c694b99-c940-4b79-95d9-939d66e5997e tempest-ProjectMemberTests-1145856324 None] Flow 'volume_create_manager' (4d530074-658b-4e7c-8837-3d17459f5933) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:09:50 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-642474a0-e0bd-4370-b3a5-bfd1d3076c3f tempest-VolumeDependencyTests-500709084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:09:50 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-5c694b99-c940-4b79-95d9-939d66e5997e tempest-ProjectMemberTests-1145856324 None] Created volume successfully. Jul 30 17:09:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-642474a0-e0bd-4370-b3a5-bfd1d3076c3f tempest-VolumeDependencyTests-500709084 None] Flow 'volume_create_manager' (e6663265-b89d-4c2a-848f-67b94a872211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:09:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-642474a0-e0bd-4370-b3a5-bfd1d3076c3f tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (058935a6-683c-49ae-be8b-b86bedd2155e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-642474a0-e0bd-4370-b3a5-bfd1d3076c3f tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (058935a6-683c-49ae-be8b-b86bedd2155e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1491668507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8060db7-cb7a-48ae-a1e5-c74357d08868,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75be733264504175956c041c2312fa52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c08a9da3-21a7-49e9-ba15-255edab64abd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:09:50Z,use_quota=True,user_id='9ee0dab1317a4cfeafb4f6b50ca81a57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-642474a0-e0bd-4370-b3a5-bfd1d3076c3f tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37c54066-3f04-4c4c-8867-1c907a6f3745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-642474a0-e0bd-4370-b3a5-bfd1d3076c3f tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37c54066-3f04-4c4c-8867-1c907a6f3745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-642474a0-e0bd-4370-b3a5-bfd1d3076c3f tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f4fd446-4137-41f8-8d83-92e94028aa48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-642474a0-e0bd-4370-b3a5-bfd1d3076c3f tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f4fd446-4137-41f8-8d83-92e94028aa48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e8060db7-cb7a-48ae-a1e5-c74357d08868', 'volume_name': 'volume-e8060db7-cb7a-48ae-a1e5-c74357d08868', 'volume_size': 1, 'snapshot_id': 'c08a9da3-21a7-49e9-ba15-255edab64abd'}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-642474a0-e0bd-4370-b3a5-bfd1d3076c3f tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (849f63a5-1fce-423c-87f2-1a979f517641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-642474a0-e0bd-4370-b3a5-bfd1d3076c3f tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (849f63a5-1fce-423c-87f2-1a979f517641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:50 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-642474a0-e0bd-4370-b3a5-bfd1d3076c3f tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c3b7814-9e66-44c0-ab60-0e5886b79103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:50 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-642474a0-e0bd-4370-b3a5-bfd1d3076c3f tempest-VolumeDependencyTests-500709084 None] Volume e8060db7-cb7a-48ae-a1e5-c74357d08868: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e8060db7-cb7a-48ae-a1e5-c74357d08868', 'volume_size': 1, 'snapshot_id': 'c08a9da3-21a7-49e9-ba15-255edab64abd'} Jul 30 17:09:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-642474a0-e0bd-4370-b3a5-bfd1d3076c3f tempest-VolumeDependencyTests-500709084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-642474a0-e0bd-4370-b3a5-bfd1d3076c3f tempest-VolumeDependencyTests-500709084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:50 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-642474a0-e0bd-4370-b3a5-bfd1d3076c3f tempest-VolumeDependencyTests-500709084 None] Acquiring lock "cinder-quobyte-c08a9da3-21a7-49e9-ba15-255edab64abd-e8060db7-cb7a-48ae-a1e5-c74357d08868" by "_create_volume_from_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:50 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-642474a0-e0bd-4370-b3a5-bfd1d3076c3f tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-c08a9da3-21a7-49e9-ba15-255edab64abd-e8060db7-cb7a-48ae-a1e5-c74357d08868" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:50 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-642474a0-e0bd-4370-b3a5-bfd1d3076c3f tempest-VolumeDependencyTests-500709084 None] Creating volume e8060db7-cb7a-48ae-a1e5-c74357d08868 from snapshot c08a9da3-21a7-49e9-ba15-255edab64abd {{(pid=88591) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 30 17:09:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-642474a0-e0bd-4370-b3a5-bfd1d3076c3f tempest-VolumeDependencyTests-500709084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-642474a0-e0bd-4370-b3a5-bfd1d3076c3f tempest-VolumeDependencyTests-500709084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:50 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-642474a0-e0bd-4370-b3a5-bfd1d3076c3f tempest-VolumeDependencyTests-500709084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:50 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-642474a0-e0bd-4370-b3a5-bfd1d3076c3f tempest-VolumeDependencyTests-500709084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-642474a0-e0bd-4370-b3a5-bfd1d3076c3f tempest-VolumeDependencyTests-500709084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:50 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-642474a0-e0bd-4370-b3a5-bfd1d3076c3f tempest-VolumeDependencyTests-500709084 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:09:50 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-642474a0-e0bd-4370-b3a5-bfd1d3076c3f tempest-VolumeDependencyTests-500709084 None] Acquiring lock "cinder-quobyte-e8060db7-cb7a-48ae-a1e5-c74357d08868" by "_copy_volume_from_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-79798778-6e29-45ff-beb1-1397b0441076 tempest-CinderUnicodeTest-1481336374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:50 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-642474a0-e0bd-4370-b3a5-bfd1d3076c3f tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-e8060db7-cb7a-48ae-a1e5-c74357d08868" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:50 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-642474a0-e0bd-4370-b3a5-bfd1d3076c3f tempest-VolumeDependencyTests-500709084 None] snapshot: c08a9da3-21a7-49e9-ba15-255edab64abd, volume: e8060db7-cb7a-48ae-a1e5-c74357d08868, {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 17:09:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-642474a0-e0bd-4370-b3a5-bfd1d3076c3f tempest-VolumeDependencyTests-500709084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-642474a0-e0bd-4370-b3a5-bfd1d3076c3f tempest-VolumeDependencyTests-500709084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:50 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-642474a0-e0bd-4370-b3a5-bfd1d3076c3f tempest-VolumeDependencyTests-500709084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:50 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-642474a0-e0bd-4370-b3a5-bfd1d3076c3f tempest-VolumeDependencyTests-500709084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-642474a0-e0bd-4370-b3a5-bfd1d3076c3f tempest-VolumeDependencyTests-500709084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:50 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[0350069a-8a58-48d1-b8a2-3a1be56c81e3]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-642474a0-e0bd-4370-b3a5-bfd1d3076c3f tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c32018b7-3311-49c9-b350-b8c599c66834.c08a9da3-21a7-49e9-ba15-255edab64abd {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3ef45557-d6d3-4f04-bed8-d23056964956 tempest-ProjectMemberTests-1145856324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:50 devstack sudo[109077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c32018b7-3311-49c9-b350-b8c599c66834.c08a9da3-21a7-49e9-ba15-255edab64abd Jul 30 17:09:50 devstack sudo[109077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:50 devstack sudo[109077]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-642474a0-e0bd-4370-b3a5-bfd1d3076c3f tempest-VolumeDependencyTests-500709084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c32018b7-3311-49c9-b350-b8c599c66834.c08a9da3-21a7-49e9-ba15-255edab64abd" returned: 0 in 0.364s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:50 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-642474a0-e0bd-4370-b3a5-bfd1d3076c3f tempest-VolumeDependencyTests-500709084 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c32018b7-3311-49c9-b350-b8c599c66834(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:09:50 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cce5dd-a755-448b-aea7-8e9f4e9efc8a]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-642474a0-e0bd-4370-b3a5-bfd1d3076c3f tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c32018b7-3311-49c9-b350-b8c599c66834 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:51 devstack sudo[109082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c32018b7-3311-49c9-b350-b8c599c66834 Jul 30 17:09:51 devstack sudo[109082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:51 devstack sudo[109082]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-642474a0-e0bd-4370-b3a5-bfd1d3076c3f tempest-VolumeDependencyTests-500709084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c32018b7-3311-49c9-b350-b8c599c66834" returned: 0 in 0.367s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:51 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-642474a0-e0bd-4370-b3a5-bfd1d3076c3f tempest-VolumeDependencyTests-500709084 None] will copy from snapshot at /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c32018b7-3311-49c9-b350-b8c599c66834 {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 17:09:51 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-642474a0-e0bd-4370-b3a5-bfd1d3076c3f tempest-VolumeDependencyTests-500709084 None] Creating direct copy from snapshot {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 17:09:51 devstack cinder-volume[88591]: DEBUG cinder.utils [None req-642474a0-e0bd-4370-b3a5-bfd1d3076c3f tempest-VolumeDependencyTests-500709084 None] Path /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e8060db7-cb7a-48ae-a1e5-c74357d08868 not found in is_blk_device check {{(pid=88591) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 17:09:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-642474a0-e0bd-4370-b3a5-bfd1d3076c3f tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c32018b7-3311-49c9-b350-b8c599c66834 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e8060db7-cb7a-48ae-a1e5-c74357d08868 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:51 devstack sudo[109094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c32018b7-3311-49c9-b350-b8c599c66834 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e8060db7-cb7a-48ae-a1e5-c74357d08868 Jul 30 17:09:51 devstack sudo[109094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:55 devstack sudo[109094]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-642474a0-e0bd-4370-b3a5-bfd1d3076c3f tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c32018b7-3311-49c9-b350-b8c599c66834 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e8060db7-cb7a-48ae-a1e5-c74357d08868" returned: 0 in 4.290s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:55 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-642474a0-e0bd-4370-b3a5-bfd1d3076c3f tempest-VolumeDependencyTests-500709084 None] Image conversion details: src /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c32018b7-3311-49c9-b350-b8c599c66834, size 1024.00 MB, duration 4.29 sec, destination /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e8060db7-cb7a-48ae-a1e5-c74357d08868 {{(pid=88591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 17:09:55 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-642474a0-e0bd-4370-b3a5-bfd1d3076c3f tempest-VolumeDependencyTests-500709084 None] Converted 1024.00 MB image at 238.63 MB/s Jul 30 17:09:55 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-642474a0-e0bd-4370-b3a5-bfd1d3076c3f tempest-VolumeDependencyTests-500709084 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e8060db7-cb7a-48ae-a1e5-c74357d08868 is being set with open permissions: ugo+rw Jul 30 17:09:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-642474a0-e0bd-4370-b3a5-bfd1d3076c3f tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e8060db7-cb7a-48ae-a1e5-c74357d08868 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:55 devstack sudo[109144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e8060db7-cb7a-48ae-a1e5-c74357d08868 Jul 30 17:09:55 devstack sudo[109144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:55 devstack sudo[109144]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-642474a0-e0bd-4370-b3a5-bfd1d3076c3f tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e8060db7-cb7a-48ae-a1e5-c74357d08868" returned: 0 in 0.246s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:55 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-642474a0-e0bd-4370-b3a5-bfd1d3076c3f tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-e8060db7-cb7a-48ae-a1e5-c74357d08868" released by "_copy_volume_from_snapshot" :: held 5.356s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:55 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-642474a0-e0bd-4370-b3a5-bfd1d3076c3f tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-c08a9da3-21a7-49e9-ba15-255edab64abd-e8060db7-cb7a-48ae-a1e5-c74357d08868" released by "_create_volume_from_snapshot" :: held 5.427s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-642474a0-e0bd-4370-b3a5-bfd1d3076c3f tempest-VolumeDependencyTests-500709084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.454s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-79798778-6e29-45ff-beb1-1397b0441076 tempest-CinderUnicodeTest-1481336374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.412s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:55 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-79798778-6e29-45ff-beb1-1397b0441076 tempest-CinderUnicodeTest-1481336374 None] Creating offline snapshot c5a1a2c4-dddb-4d02-ba4d-058cb1e3ba4b of volume 0915fdd4-19cc-43b8-a313-92152fced6da {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:09:55 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-642474a0-e0bd-4370-b3a5-bfd1d3076c3f tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c3b7814-9e66-44c0-ab60-0e5886b79103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8060db7-cb7a-48ae-a1e5-c74357d08868', 'volume_size': 1, 'snapshot_id': 'c08a9da3-21a7-49e9-ba15-255edab64abd'}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:55 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-642474a0-e0bd-4370-b3a5-bfd1d3076c3f tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf7e1dd6-b942-4f86-b53e-ffd2de99be15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:09:55 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c314c7a-3f42-4cf8-9089-39b3cf4f9ae2]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-79798778-6e29-45ff-beb1-1397b0441076 tempest-CinderUnicodeTest-1481336374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0915fdd4-19cc-43b8-a313-92152fced6da {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:55 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-642474a0-e0bd-4370-b3a5-bfd1d3076c3f tempest-VolumeDependencyTests-500709084 None] Volume volume-e8060db7-cb7a-48ae-a1e5-c74357d08868 (e8060db7-cb7a-48ae-a1e5-c74357d08868): created successfully Jul 30 17:09:55 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-642474a0-e0bd-4370-b3a5-bfd1d3076c3f tempest-VolumeDependencyTests-500709084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf7e1dd6-b942-4f86-b53e-ffd2de99be15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:09:55 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-642474a0-e0bd-4370-b3a5-bfd1d3076c3f tempest-VolumeDependencyTests-500709084 None] Flow 'volume_create_manager' (e6663265-b89d-4c2a-848f-67b94a872211) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:09:56 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-642474a0-e0bd-4370-b3a5-bfd1d3076c3f tempest-VolumeDependencyTests-500709084 None] Created volume successfully. Jul 30 17:09:56 devstack sudo[109147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0915fdd4-19cc-43b8-a313-92152fced6da Jul 30 17:09:56 devstack sudo[109147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:56 devstack sudo[109147]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-79798778-6e29-45ff-beb1-1397b0441076 tempest-CinderUnicodeTest-1481336374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0915fdd4-19cc-43b8-a313-92152fced6da" returned: 0 in 0.364s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-79798778-6e29-45ff-beb1-1397b0441076 tempest-CinderUnicodeTest-1481336374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0915fdd4-19cc-43b8-a313-92152fced6da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0915fdd4-19cc-43b8-a313-92152fced6da.c5a1a2c4-dddb-4d02-ba4d-058cb1e3ba4b 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:56 devstack sudo[109152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0915fdd4-19cc-43b8-a313-92152fced6da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0915fdd4-19cc-43b8-a313-92152fced6da.c5a1a2c4-dddb-4d02-ba4d-058cb1e3ba4b 1G Jul 30 17:09:56 devstack sudo[109152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:56 devstack sudo[109152]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-79798778-6e29-45ff-beb1-1397b0441076 tempest-CinderUnicodeTest-1481336374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0915fdd4-19cc-43b8-a313-92152fced6da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0915fdd4-19cc-43b8-a313-92152fced6da.c5a1a2c4-dddb-4d02-ba4d-058cb1e3ba4b 1G" returned: 0 in 0.422s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-79798778-6e29-45ff-beb1-1397b0441076 tempest-CinderUnicodeTest-1481336374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0915fdd4-19cc-43b8-a313-92152fced6da -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0915fdd4-19cc-43b8-a313-92152fced6da.c5a1a2c4-dddb-4d02-ba4d-058cb1e3ba4b {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:56 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f7eca704-371b-4073-8eb2-4f47deffc277 tempest-VolumeDependencyTests-500709084 None] Acquiring lock "cinder-c08a9da3-21a7-49e9-ba15-255edab64abd-delete_snapshot" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:56 devstack sudo[109158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0915fdd4-19cc-43b8-a313-92152fced6da -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0915fdd4-19cc-43b8-a313-92152fced6da.c5a1a2c4-dddb-4d02-ba4d-058cb1e3ba4b Jul 30 17:09:56 devstack sudo[109158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:56 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f7eca704-371b-4073-8eb2-4f47deffc277 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-c08a9da3-21a7-49e9-ba15-255edab64abd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:56 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f7eca704-371b-4073-8eb2-4f47deffc277 tempest-VolumeDependencyTests-500709084 None] Acquiring lock "cinder-quobyte-c32018b7-3311-49c9-b350-b8c599c66834" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:56 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f7eca704-371b-4073-8eb2-4f47deffc277 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-c32018b7-3311-49c9-b350-b8c599c66834" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:56 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f7eca704-371b-4073-8eb2-4f47deffc277 tempest-VolumeDependencyTests-500709084 None] Acquiring lock "cinder-quobyte-c08a9da3-21a7-49e9-ba15-255edab64abd" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:56 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f7eca704-371b-4073-8eb2-4f47deffc277 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-c08a9da3-21a7-49e9-ba15-255edab64abd" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:56 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-f7eca704-371b-4073-8eb2-4f47deffc277 tempest-VolumeDependencyTests-500709084 None] Deleting offline snapshot c08a9da3-21a7-49e9-ba15-255edab64abd of volume c32018b7-3311-49c9-b350-b8c599c66834 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:09:56 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-f7eca704-371b-4073-8eb2-4f47deffc277 tempest-VolumeDependencyTests-500709084 None] snapshot_file for this snap is: volume-c32018b7-3311-49c9-b350-b8c599c66834.c08a9da3-21a7-49e9-ba15-255edab64abd {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:09:56 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ec2dbf-e215-4d05-ae7d-076bc445ac16]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f7eca704-371b-4073-8eb2-4f47deffc277 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c32018b7-3311-49c9-b350-b8c599c66834.c08a9da3-21a7-49e9-ba15-255edab64abd {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:56 devstack sudo[109160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c32018b7-3311-49c9-b350-b8c599c66834.c08a9da3-21a7-49e9-ba15-255edab64abd Jul 30 17:09:56 devstack sudo[109160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:57 devstack sudo[109158]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-79798778-6e29-45ff-beb1-1397b0441076 tempest-CinderUnicodeTest-1481336374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0915fdd4-19cc-43b8-a313-92152fced6da -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0915fdd4-19cc-43b8-a313-92152fced6da.c5a1a2c4-dddb-4d02-ba4d-058cb1e3ba4b" returned: 0 in 0.321s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:57 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-79798778-6e29-45ff-beb1-1397b0441076 tempest-CinderUnicodeTest-1481336374 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0915fdd4-19cc-43b8-a313-92152fced6da.c5a1a2c4-dddb-4d02-ba4d-058cb1e3ba4b is being set with open permissions: ugo+rw Jul 30 17:09:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-79798778-6e29-45ff-beb1-1397b0441076 tempest-CinderUnicodeTest-1481336374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0915fdd4-19cc-43b8-a313-92152fced6da.c5a1a2c4-dddb-4d02-ba4d-058cb1e3ba4b {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:57 devstack sudo[109166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0915fdd4-19cc-43b8-a313-92152fced6da.c5a1a2c4-dddb-4d02-ba4d-058cb1e3ba4b Jul 30 17:09:57 devstack sudo[109166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:57 devstack sudo[109160]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f7eca704-371b-4073-8eb2-4f47deffc277 tempest-VolumeDependencyTests-500709084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c32018b7-3311-49c9-b350-b8c599c66834.c08a9da3-21a7-49e9-ba15-255edab64abd" returned: 0 in 0.361s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:57 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-f7eca704-371b-4073-8eb2-4f47deffc277 tempest-VolumeDependencyTests-500709084 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c32018b7-3311-49c9-b350-b8c599c66834(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:09:57 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9eb4cca-a06e-437b-9f4d-991bcef1e990]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f7eca704-371b-4073-8eb2-4f47deffc277 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c32018b7-3311-49c9-b350-b8c599c66834 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:57 devstack sudo[109166]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-79798778-6e29-45ff-beb1-1397b0441076 tempest-CinderUnicodeTest-1481336374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0915fdd4-19cc-43b8-a313-92152fced6da.c5a1a2c4-dddb-4d02-ba4d-058cb1e3ba4b" returned: 0 in 0.255s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:57 devstack sudo[109171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c32018b7-3311-49c9-b350-b8c599c66834 Jul 30 17:09:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-79798778-6e29-45ff-beb1-1397b0441076 tempest-CinderUnicodeTest-1481336374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0915fdd4-19cc-43b8-a313-92152fced6da.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:57 devstack sudo[109171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:57 devstack sudo[109174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0915fdd4-19cc-43b8-a313-92152fced6da.info Jul 30 17:09:57 devstack sudo[109174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:57 devstack sudo[109174]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-79798778-6e29-45ff-beb1-1397b0441076 tempest-CinderUnicodeTest-1481336374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0915fdd4-19cc-43b8-a313-92152fced6da.info" returned: 0 in 0.249s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:57 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-79798778-6e29-45ff-beb1-1397b0441076 tempest-CinderUnicodeTest-1481336374 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0915fdd4-19cc-43b8-a313-92152fced6da.info is being set with open permissions: ugo+rw Jul 30 17:09:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-79798778-6e29-45ff-beb1-1397b0441076 tempest-CinderUnicodeTest-1481336374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0915fdd4-19cc-43b8-a313-92152fced6da.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:57 devstack sudo[109179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0915fdd4-19cc-43b8-a313-92152fced6da.info Jul 30 17:09:57 devstack sudo[109179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:57 devstack sudo[109171]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f7eca704-371b-4073-8eb2-4f47deffc277 tempest-VolumeDependencyTests-500709084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c32018b7-3311-49c9-b350-b8c599c66834" returned: 0 in 0.558s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f7eca704-371b-4073-8eb2-4f47deffc277 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c32018b7-3311-49c9-b350-b8c599c66834.c08a9da3-21a7-49e9-ba15-255edab64abd {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:57 devstack sudo[109183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c32018b7-3311-49c9-b350-b8c599c66834.c08a9da3-21a7-49e9-ba15-255edab64abd Jul 30 17:09:57 devstack sudo[109183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:57 devstack sudo[109179]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-79798778-6e29-45ff-beb1-1397b0441076 tempest-CinderUnicodeTest-1481336374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0915fdd4-19cc-43b8-a313-92152fced6da.info" returned: 0 in 0.259s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-79798778-6e29-45ff-beb1-1397b0441076 tempest-CinderUnicodeTest-1481336374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.975s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3ef45557-d6d3-4f04-bed8-d23056964956 tempest-ProjectMemberTests-1145856324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.292s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:57 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-3ef45557-d6d3-4f04-bed8-d23056964956 tempest-ProjectMemberTests-1145856324 None] Creating offline snapshot ee9d6447-a601-446e-8261-648e37377209 of volume 71333762-ff1f-494b-8076-51720b5ae831 {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:09:57 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-79798778-6e29-45ff-beb1-1397b0441076 tempest-CinderUnicodeTest-1481336374 None] Create snapshot completed successfully Jul 30 17:09:57 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[94538e41-7b87-47ad-93bb-89a5de73f542]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3ef45557-d6d3-4f04-bed8-d23056964956 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71333762-ff1f-494b-8076-51720b5ae831 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:58 devstack sudo[109185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71333762-ff1f-494b-8076-51720b5ae831 Jul 30 17:09:58 devstack sudo[109185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:58 devstack sudo[109183]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f7eca704-371b-4073-8eb2-4f47deffc277 tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c32018b7-3311-49c9-b350-b8c599c66834.c08a9da3-21a7-49e9-ba15-255edab64abd" returned: 0 in 0.363s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f7eca704-371b-4073-8eb2-4f47deffc277 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c32018b7-3311-49c9-b350-b8c599c66834.c08a9da3-21a7-49e9-ba15-255edab64abd {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:58 devstack sudo[109190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c32018b7-3311-49c9-b350-b8c599c66834.c08a9da3-21a7-49e9-ba15-255edab64abd Jul 30 17:09:58 devstack sudo[109190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:58 devstack sudo[109185]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3ef45557-d6d3-4f04-bed8-d23056964956 tempest-ProjectMemberTests-1145856324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71333762-ff1f-494b-8076-51720b5ae831" returned: 0 in 0.374s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3ef45557-d6d3-4f04-bed8-d23056964956 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71333762-ff1f-494b-8076-51720b5ae831,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71333762-ff1f-494b-8076-51720b5ae831.ee9d6447-a601-446e-8261-648e37377209 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:58 devstack sudo[109195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71333762-ff1f-494b-8076-51720b5ae831,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71333762-ff1f-494b-8076-51720b5ae831.ee9d6447-a601-446e-8261-648e37377209 1G Jul 30 17:09:58 devstack sudo[109195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:58 devstack sudo[109190]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f7eca704-371b-4073-8eb2-4f47deffc277 tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c32018b7-3311-49c9-b350-b8c599c66834.c08a9da3-21a7-49e9-ba15-255edab64abd" returned: 0 in 0.252s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:58 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f7eca704-371b-4073-8eb2-4f47deffc277 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-c08a9da3-21a7-49e9-ba15-255edab64abd" released by "_delete_snapshot" :: held 1.636s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:58 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f7eca704-371b-4073-8eb2-4f47deffc277 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-c32018b7-3311-49c9-b350-b8c599c66834" released by "delete_snapshot" :: held 1.666s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:58 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-f7eca704-371b-4073-8eb2-4f47deffc277 tempest-VolumeDependencyTests-500709084 None] Created reservations ['12089507-a8a5-4dd2-a4ee-245ffaf2ccdd', '672deed7-74d8-4032-ab17-c884a9879431', 'c29338c8-367e-4e1b-a531-6b6437e824d9', 'f7c09322-0561-4afe-9365-728366ce312f'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:09:58 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-f7eca704-371b-4073-8eb2-4f47deffc277 tempest-VolumeDependencyTests-500709084 None] Delete snapshot completed successfully. Jul 30 17:09:58 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f7eca704-371b-4073-8eb2-4f47deffc277 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-c08a9da3-21a7-49e9-ba15-255edab64abd-delete_snapshot" released by "delete_snapshot" :: held 1.803s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:58 devstack sudo[109195]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3ef45557-d6d3-4f04-bed8-d23056964956 tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71333762-ff1f-494b-8076-51720b5ae831,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71333762-ff1f-494b-8076-51720b5ae831.ee9d6447-a601-446e-8261-648e37377209 1G" returned: 0 in 0.405s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3ef45557-d6d3-4f04-bed8-d23056964956 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71333762-ff1f-494b-8076-51720b5ae831 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71333762-ff1f-494b-8076-51720b5ae831.ee9d6447-a601-446e-8261-648e37377209 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:58 devstack sudo[109201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71333762-ff1f-494b-8076-51720b5ae831 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71333762-ff1f-494b-8076-51720b5ae831.ee9d6447-a601-446e-8261-648e37377209 Jul 30 17:09:58 devstack sudo[109201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:58 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f5c238d1-45bd-40f3-ae79-2384973633bc tempest-VolumeDependencyTests-500709084 None] Acquiring lock "cinder-c32018b7-3311-49c9-b350-b8c599c66834-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:58 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c449df85-0b22-47b9-bce6-da34e1f6dc40 tempest-CinderUnicodeTest-1481336374 None] Acquiring lock "cinder-c5a1a2c4-dddb-4d02-ba4d-058cb1e3ba4b-delete_snapshot" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:58 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f5c238d1-45bd-40f3-ae79-2384973633bc tempest-VolumeDependencyTests-500709084 None] Lock "cinder-c32018b7-3311-49c9-b350-b8c599c66834-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:58 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c449df85-0b22-47b9-bce6-da34e1f6dc40 tempest-CinderUnicodeTest-1481336374 None] Lock "cinder-c5a1a2c4-dddb-4d02-ba4d-058cb1e3ba4b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:59 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c449df85-0b22-47b9-bce6-da34e1f6dc40 tempest-CinderUnicodeTest-1481336374 None] Acquiring lock "cinder-quobyte-0915fdd4-19cc-43b8-a313-92152fced6da" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:59 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c449df85-0b22-47b9-bce6-da34e1f6dc40 tempest-CinderUnicodeTest-1481336374 None] Lock "cinder-quobyte-0915fdd4-19cc-43b8-a313-92152fced6da" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:59 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c449df85-0b22-47b9-bce6-da34e1f6dc40 tempest-CinderUnicodeTest-1481336374 None] Acquiring lock "cinder-quobyte-c5a1a2c4-dddb-4d02-ba4d-058cb1e3ba4b" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:59 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f5c238d1-45bd-40f3-ae79-2384973633bc tempest-VolumeDependencyTests-500709084 None] Acquiring lock "cinder-quobyte-c32018b7-3311-49c9-b350-b8c599c66834" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:09:59 devstack sudo[109201]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:59 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c449df85-0b22-47b9-bce6-da34e1f6dc40 tempest-CinderUnicodeTest-1481336374 None] Lock "cinder-quobyte-c5a1a2c4-dddb-4d02-ba4d-058cb1e3ba4b" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:59 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-c449df85-0b22-47b9-bce6-da34e1f6dc40 tempest-CinderUnicodeTest-1481336374 None] Deleting offline snapshot c5a1a2c4-dddb-4d02-ba4d-058cb1e3ba4b of volume 0915fdd4-19cc-43b8-a313-92152fced6da {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:09:59 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-c449df85-0b22-47b9-bce6-da34e1f6dc40 tempest-CinderUnicodeTest-1481336374 None] snapshot_file for this snap is: volume-0915fdd4-19cc-43b8-a313-92152fced6da.c5a1a2c4-dddb-4d02-ba4d-058cb1e3ba4b {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:09:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3ef45557-d6d3-4f04-bed8-d23056964956 tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71333762-ff1f-494b-8076-51720b5ae831 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71333762-ff1f-494b-8076-51720b5ae831.ee9d6447-a601-446e-8261-648e37377209" returned: 0 in 0.366s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:59 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-3ef45557-d6d3-4f04-bed8-d23056964956 tempest-ProjectMemberTests-1145856324 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71333762-ff1f-494b-8076-51720b5ae831.ee9d6447-a601-446e-8261-648e37377209 is being set with open permissions: ugo+rw Jul 30 17:09:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3ef45557-d6d3-4f04-bed8-d23056964956 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71333762-ff1f-494b-8076-51720b5ae831.ee9d6447-a601-446e-8261-648e37377209 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:59 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b3373b-98a6-4fe4-be83-19d891be61a9]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:59 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f5c238d1-45bd-40f3-ae79-2384973633bc tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-c32018b7-3311-49c9-b350-b8c599c66834" acquired by "delete_volume" :: waited 0.045s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:09:59 devstack sudo[109206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71333762-ff1f-494b-8076-51720b5ae831.ee9d6447-a601-446e-8261-648e37377209 Jul 30 17:09:59 devstack sudo[109206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c449df85-0b22-47b9-bce6-da34e1f6dc40 tempest-CinderUnicodeTest-1481336374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0915fdd4-19cc-43b8-a313-92152fced6da.c5a1a2c4-dddb-4d02-ba4d-058cb1e3ba4b {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:59 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e97826-6824-465e-bebc-32b308396736]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f5c238d1-45bd-40f3-ae79-2384973633bc tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c32018b7-3311-49c9-b350-b8c599c66834 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:59 devstack sudo[109208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0915fdd4-19cc-43b8-a313-92152fced6da.c5a1a2c4-dddb-4d02-ba4d-058cb1e3ba4b Jul 30 17:09:59 devstack sudo[109208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:59 devstack sudo[109209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c32018b7-3311-49c9-b350-b8c599c66834 Jul 30 17:09:59 devstack sudo[109209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:59 devstack sudo[109206]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3ef45557-d6d3-4f04-bed8-d23056964956 tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71333762-ff1f-494b-8076-51720b5ae831.ee9d6447-a601-446e-8261-648e37377209" returned: 0 in 0.256s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3ef45557-d6d3-4f04-bed8-d23056964956 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71333762-ff1f-494b-8076-51720b5ae831.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:59 devstack sudo[109213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71333762-ff1f-494b-8076-51720b5ae831.info Jul 30 17:09:59 devstack sudo[109213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:59 devstack sudo[109208]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c449df85-0b22-47b9-bce6-da34e1f6dc40 tempest-CinderUnicodeTest-1481336374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0915fdd4-19cc-43b8-a313-92152fced6da.c5a1a2c4-dddb-4d02-ba4d-058cb1e3ba4b" returned: 0 in 0.378s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:59 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-c449df85-0b22-47b9-bce6-da34e1f6dc40 tempest-CinderUnicodeTest-1481336374 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0915fdd4-19cc-43b8-a313-92152fced6da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:09:59 devstack sudo[109209]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f5c238d1-45bd-40f3-ae79-2384973633bc tempest-VolumeDependencyTests-500709084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c32018b7-3311-49c9-b350-b8c599c66834" returned: 0 in 0.389s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f5c238d1-45bd-40f3-ae79-2384973633bc tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c32018b7-3311-49c9-b350-b8c599c66834 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:59 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[24820b41-c559-4d53-ba30-29be5c816729]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:09:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c449df85-0b22-47b9-bce6-da34e1f6dc40 tempest-CinderUnicodeTest-1481336374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0915fdd4-19cc-43b8-a313-92152fced6da {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:59 devstack sudo[109221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c32018b7-3311-49c9-b350-b8c599c66834 Jul 30 17:09:59 devstack sudo[109221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:59 devstack sudo[109213]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3ef45557-d6d3-4f04-bed8-d23056964956 tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71333762-ff1f-494b-8076-51720b5ae831.info" returned: 0 in 0.297s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:59 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-3ef45557-d6d3-4f04-bed8-d23056964956 tempest-ProjectMemberTests-1145856324 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71333762-ff1f-494b-8076-51720b5ae831.info is being set with open permissions: ugo+rw Jul 30 17:09:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3ef45557-d6d3-4f04-bed8-d23056964956 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71333762-ff1f-494b-8076-51720b5ae831.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:59 devstack sudo[109222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0915fdd4-19cc-43b8-a313-92152fced6da Jul 30 17:09:59 devstack sudo[109222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:59 devstack sudo[109226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71333762-ff1f-494b-8076-51720b5ae831.info Jul 30 17:09:59 devstack sudo[109226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:59 devstack sudo[109221]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f5c238d1-45bd-40f3-ae79-2384973633bc tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c32018b7-3311-49c9-b350-b8c599c66834" returned: 0 in 0.246s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:59 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f5c238d1-45bd-40f3-ae79-2384973633bc tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-c32018b7-3311-49c9-b350-b8c599c66834" released by "delete_volume" :: held 0.707s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:09:59 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-f5c238d1-45bd-40f3-ae79-2384973633bc tempest-VolumeDependencyTests-500709084 None] Created reservations ['7b0b2cce-973d-452d-8e1e-775bf9cc65f8', '86978a99-3a81-4191-95cc-00ee1dd95d05', '94d9d52f-057c-4199-b39f-c58c5fbd5abc', '2bde82f1-6a74-4626-ae3f-a11a0f337984'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:09:59 devstack sudo[109226]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f5c238d1-45bd-40f3-ae79-2384973633bc tempest-VolumeDependencyTests-500709084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:09:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f5c238d1-45bd-40f3-ae79-2384973633bc tempest-VolumeDependencyTests-500709084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:09:59 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f5c238d1-45bd-40f3-ae79-2384973633bc tempest-VolumeDependencyTests-500709084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:09:59 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f5c238d1-45bd-40f3-ae79-2384973633bc tempest-VolumeDependencyTests-500709084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:09:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f5c238d1-45bd-40f3-ae79-2384973633bc tempest-VolumeDependencyTests-500709084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f5c238d1-45bd-40f3-ae79-2384973633bc tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:09:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3ef45557-d6d3-4f04-bed8-d23056964956 tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71333762-ff1f-494b-8076-51720b5ae831.info" returned: 0 in 0.278s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:59 devstack sudo[109222]: pam_unix(sudo:session): session closed for user root Jul 30 17:09:59 devstack sudo[109234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:09:59 devstack sudo[109234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:09:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3ef45557-d6d3-4f04-bed8-d23056964956 tempest-ProjectMemberTests-1145856324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.080s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:09:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c449df85-0b22-47b9-bce6-da34e1f6dc40 tempest-CinderUnicodeTest-1481336374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0915fdd4-19cc-43b8-a313-92152fced6da" returned: 0 in 0.421s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:09:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c449df85-0b22-47b9-bce6-da34e1f6dc40 tempest-CinderUnicodeTest-1481336374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0915fdd4-19cc-43b8-a313-92152fced6da.c5a1a2c4-dddb-4d02-ba4d-058cb1e3ba4b {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:00 devstack sudo[109236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0915fdd4-19cc-43b8-a313-92152fced6da.c5a1a2c4-dddb-4d02-ba4d-058cb1e3ba4b Jul 30 17:10:00 devstack sudo[109236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:00 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-3ef45557-d6d3-4f04-bed8-d23056964956 tempest-ProjectMemberTests-1145856324 None] Create snapshot completed successfully Jul 30 17:10:00 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-71e4757c-b07d-453e-9737-94cd0e078906 tempest-VolumeDependencyTests-500709084 None] Acquiring lock "cinder-e8060db7-cb7a-48ae-a1e5-c74357d08868-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:00 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-71e4757c-b07d-453e-9737-94cd0e078906 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-e8060db7-cb7a-48ae-a1e5-c74357d08868-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:00 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-71e4757c-b07d-453e-9737-94cd0e078906 tempest-VolumeDependencyTests-500709084 None] Acquiring lock "cinder-quobyte-e8060db7-cb7a-48ae-a1e5-c74357d08868" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:00 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-71e4757c-b07d-453e-9737-94cd0e078906 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-e8060db7-cb7a-48ae-a1e5-c74357d08868" acquired by "delete_volume" :: waited 0.027s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:00 devstack sudo[109234]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f5c238d1-45bd-40f3-ae79-2384973633bc tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.330s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:00 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-f5c238d1-45bd-40f3-ae79-2384973633bc tempest-VolumeDependencyTests-500709084 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:10:00 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-f5c238d1-45bd-40f3-ae79-2384973633bc tempest-VolumeDependencyTests-500709084 None] Deleted volume successfully. Jul 30 17:10:00 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[46eac9f8-4148-431f-a784-376362bc2ada]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-71e4757c-b07d-453e-9737-94cd0e078906 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e8060db7-cb7a-48ae-a1e5-c74357d08868 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:00 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f5c238d1-45bd-40f3-ae79-2384973633bc tempest-VolumeDependencyTests-500709084 None] Lock "cinder-c32018b7-3311-49c9-b350-b8c599c66834-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:00 devstack sudo[109236]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c449df85-0b22-47b9-bce6-da34e1f6dc40 tempest-CinderUnicodeTest-1481336374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0915fdd4-19cc-43b8-a313-92152fced6da.c5a1a2c4-dddb-4d02-ba4d-058cb1e3ba4b" returned: 0 in 0.409s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c449df85-0b22-47b9-bce6-da34e1f6dc40 tempest-CinderUnicodeTest-1481336374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0915fdd4-19cc-43b8-a313-92152fced6da.c5a1a2c4-dddb-4d02-ba4d-058cb1e3ba4b {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:00 devstack sudo[109242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e8060db7-cb7a-48ae-a1e5-c74357d08868 Jul 30 17:10:00 devstack sudo[109242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:00 devstack sudo[109244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0915fdd4-19cc-43b8-a313-92152fced6da.c5a1a2c4-dddb-4d02-ba4d-058cb1e3ba4b Jul 30 17:10:00 devstack sudo[109244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:00 devstack sudo[109244]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:00 devstack sudo[109242]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c449df85-0b22-47b9-bce6-da34e1f6dc40 tempest-CinderUnicodeTest-1481336374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0915fdd4-19cc-43b8-a313-92152fced6da.c5a1a2c4-dddb-4d02-ba4d-058cb1e3ba4b" returned: 0 in 0.263s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-71e4757c-b07d-453e-9737-94cd0e078906 tempest-VolumeDependencyTests-500709084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e8060db7-cb7a-48ae-a1e5-c74357d08868" returned: 0 in 0.374s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-71e4757c-b07d-453e-9737-94cd0e078906 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e8060db7-cb7a-48ae-a1e5-c74357d08868 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:00 devstack sudo[109251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e8060db7-cb7a-48ae-a1e5-c74357d08868 Jul 30 17:10:00 devstack sudo[109251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:00 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c449df85-0b22-47b9-bce6-da34e1f6dc40 tempest-CinderUnicodeTest-1481336374 None] Lock "cinder-quobyte-c5a1a2c4-dddb-4d02-ba4d-058cb1e3ba4b" released by "_delete_snapshot" :: held 1.640s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:00 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c449df85-0b22-47b9-bce6-da34e1f6dc40 tempest-CinderUnicodeTest-1481336374 None] Lock "cinder-quobyte-0915fdd4-19cc-43b8-a313-92152fced6da" released by "delete_snapshot" :: held 1.682s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:00 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-c449df85-0b22-47b9-bce6-da34e1f6dc40 tempest-CinderUnicodeTest-1481336374 None] Created reservations ['ca657221-c7ba-4621-b71a-094c5f098677', 'c3b06d01-df04-441a-8c15-05afbb9ae019', '967d935a-5483-4f22-b7a0-9ac900896346', 'dee25ec7-37ec-4d39-9dc9-e733dad4c155'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:10:00 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-c449df85-0b22-47b9-bce6-da34e1f6dc40 tempest-CinderUnicodeTest-1481336374 None] Delete snapshot completed successfully. Jul 30 17:10:00 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c449df85-0b22-47b9-bce6-da34e1f6dc40 tempest-CinderUnicodeTest-1481336374 None] Lock "cinder-c5a1a2c4-dddb-4d02-ba4d-058cb1e3ba4b-delete_snapshot" released by "delete_snapshot" :: held 1.849s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:00 devstack sudo[109251]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-71e4757c-b07d-453e-9737-94cd0e078906 tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e8060db7-cb7a-48ae-a1e5-c74357d08868" returned: 0 in 0.283s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:00 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-71e4757c-b07d-453e-9737-94cd0e078906 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-quobyte-e8060db7-cb7a-48ae-a1e5-c74357d08868" released by "delete_volume" :: held 0.702s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:01 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-71e4757c-b07d-453e-9737-94cd0e078906 tempest-VolumeDependencyTests-500709084 None] Created reservations ['fecf372a-91f5-4f7a-97ab-c32e08615dae', '2fdc0d28-c88b-48bf-b615-a8efe0e68242', '6bda1980-865d-4824-84dd-e642d8a32d4c', '3aa1b9c1-54b4-466e-9519-02254cc1b823'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:10:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-71e4757c-b07d-453e-9737-94cd0e078906 tempest-VolumeDependencyTests-500709084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-71e4757c-b07d-453e-9737-94cd0e078906 tempest-VolumeDependencyTests-500709084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:01 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-71e4757c-b07d-453e-9737-94cd0e078906 tempest-VolumeDependencyTests-500709084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:01 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-71e4757c-b07d-453e-9737-94cd0e078906 tempest-VolumeDependencyTests-500709084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-71e4757c-b07d-453e-9737-94cd0e078906 tempest-VolumeDependencyTests-500709084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-71e4757c-b07d-453e-9737-94cd0e078906 tempest-VolumeDependencyTests-500709084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:01 devstack sudo[109255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:10:01 devstack sudo[109255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:01 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-3b13a568-2dd5-45f2-adfa-9a87771117fc tempest-CinderUnicodeTest-1481336374 None] Acquiring lock "cinder-0915fdd4-19cc-43b8-a313-92152fced6da-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:01 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-8404baf5-f262-4cca-869c-038ebc8d4f1b tempest-ProjectMemberTests-1145856324 None] Acquiring lock "cinder-ee9d6447-a601-446e-8261-648e37377209-delete_snapshot" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:01 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-3b13a568-2dd5-45f2-adfa-9a87771117fc tempest-CinderUnicodeTest-1481336374 None] Lock "cinder-0915fdd4-19cc-43b8-a313-92152fced6da-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:01 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-8404baf5-f262-4cca-869c-038ebc8d4f1b tempest-ProjectMemberTests-1145856324 None] Lock "cinder-ee9d6447-a601-446e-8261-648e37377209-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:01 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-8404baf5-f262-4cca-869c-038ebc8d4f1b tempest-ProjectMemberTests-1145856324 None] Acquiring lock "cinder-quobyte-71333762-ff1f-494b-8076-51720b5ae831" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:01 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-8404baf5-f262-4cca-869c-038ebc8d4f1b tempest-ProjectMemberTests-1145856324 None] Lock "cinder-quobyte-71333762-ff1f-494b-8076-51720b5ae831" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:01 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-8404baf5-f262-4cca-869c-038ebc8d4f1b tempest-ProjectMemberTests-1145856324 None] Acquiring lock "cinder-quobyte-ee9d6447-a601-446e-8261-648e37377209" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:01 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-8404baf5-f262-4cca-869c-038ebc8d4f1b tempest-ProjectMemberTests-1145856324 None] Lock "cinder-quobyte-ee9d6447-a601-446e-8261-648e37377209" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:01 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-8404baf5-f262-4cca-869c-038ebc8d4f1b tempest-ProjectMemberTests-1145856324 None] Deleting offline snapshot ee9d6447-a601-446e-8261-648e37377209 of volume 71333762-ff1f-494b-8076-51720b5ae831 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:10:01 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-8404baf5-f262-4cca-869c-038ebc8d4f1b tempest-ProjectMemberTests-1145856324 None] snapshot_file for this snap is: volume-71333762-ff1f-494b-8076-51720b5ae831.ee9d6447-a601-446e-8261-648e37377209 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:10:01 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-3b13a568-2dd5-45f2-adfa-9a87771117fc tempest-CinderUnicodeTest-1481336374 None] Acquiring lock "cinder-quobyte-0915fdd4-19cc-43b8-a313-92152fced6da" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:01 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[e774887e-5409-4860-bca2-c2db38322450]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8404baf5-f262-4cca-869c-038ebc8d4f1b tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71333762-ff1f-494b-8076-51720b5ae831.ee9d6447-a601-446e-8261-648e37377209 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:01 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-3b13a568-2dd5-45f2-adfa-9a87771117fc tempest-CinderUnicodeTest-1481336374 None] Lock "cinder-quobyte-0915fdd4-19cc-43b8-a313-92152fced6da" acquired by "delete_volume" :: waited 0.046s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:01 devstack sudo[109255]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-71e4757c-b07d-453e-9737-94cd0e078906 tempest-VolumeDependencyTests-500709084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.308s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:01 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-71e4757c-b07d-453e-9737-94cd0e078906 tempest-VolumeDependencyTests-500709084 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:10:01 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-71e4757c-b07d-453e-9737-94cd0e078906 tempest-VolumeDependencyTests-500709084 None] Deleted volume successfully. Jul 30 17:10:01 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6b1fbf-a182-42f8-9f98-d86478aee4d7]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3b13a568-2dd5-45f2-adfa-9a87771117fc tempest-CinderUnicodeTest-1481336374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0915fdd4-19cc-43b8-a313-92152fced6da {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:01 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-71e4757c-b07d-453e-9737-94cd0e078906 tempest-VolumeDependencyTests-500709084 None] Lock "cinder-e8060db7-cb7a-48ae-a1e5-c74357d08868-delete_volume" released by "delete_volume" :: held 1.274s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:01 devstack sudo[109258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71333762-ff1f-494b-8076-51720b5ae831.ee9d6447-a601-446e-8261-648e37377209 Jul 30 17:10:01 devstack sudo[109258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:01 devstack sudo[109259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0915fdd4-19cc-43b8-a313-92152fced6da Jul 30 17:10:01 devstack sudo[109259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:01 devstack sudo[109258]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8404baf5-f262-4cca-869c-038ebc8d4f1b tempest-ProjectMemberTests-1145856324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71333762-ff1f-494b-8076-51720b5ae831.ee9d6447-a601-446e-8261-648e37377209" returned: 0 in 0.411s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:01 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-8404baf5-f262-4cca-869c-038ebc8d4f1b tempest-ProjectMemberTests-1145856324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71333762-ff1f-494b-8076-51720b5ae831(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:10:01 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ddeef30-8619-480b-99c3-f572bf349498]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8404baf5-f262-4cca-869c-038ebc8d4f1b tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71333762-ff1f-494b-8076-51720b5ae831 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:01 devstack sudo[109259]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3b13a568-2dd5-45f2-adfa-9a87771117fc tempest-CinderUnicodeTest-1481336374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0915fdd4-19cc-43b8-a313-92152fced6da" returned: 0 in 0.442s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3b13a568-2dd5-45f2-adfa-9a87771117fc tempest-CinderUnicodeTest-1481336374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0915fdd4-19cc-43b8-a313-92152fced6da {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:01 devstack sudo[109267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71333762-ff1f-494b-8076-51720b5ae831 Jul 30 17:10:01 devstack sudo[109267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:01 devstack sudo[109270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0915fdd4-19cc-43b8-a313-92152fced6da Jul 30 17:10:01 devstack sudo[109270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:02 devstack sudo[109270]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3b13a568-2dd5-45f2-adfa-9a87771117fc tempest-CinderUnicodeTest-1481336374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0915fdd4-19cc-43b8-a313-92152fced6da" returned: 0 in 0.268s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:02 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-3b13a568-2dd5-45f2-adfa-9a87771117fc tempest-CinderUnicodeTest-1481336374 None] Lock "cinder-quobyte-0915fdd4-19cc-43b8-a313-92152fced6da" released by "delete_volume" :: held 0.793s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:02 devstack sudo[109267]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8404baf5-f262-4cca-869c-038ebc8d4f1b tempest-ProjectMemberTests-1145856324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71333762-ff1f-494b-8076-51720b5ae831" returned: 0 in 0.440s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8404baf5-f262-4cca-869c-038ebc8d4f1b tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71333762-ff1f-494b-8076-51720b5ae831.ee9d6447-a601-446e-8261-648e37377209 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:02 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-3b13a568-2dd5-45f2-adfa-9a87771117fc tempest-CinderUnicodeTest-1481336374 None] Created reservations ['7a34b5bf-7ed8-4fa6-938b-b5def81f8e66', '7bfa54d7-ffb4-4f64-9201-9d21f0f912a3', '063e9a20-b390-45bc-a9d6-63cd8eaf7099', '7ea537ed-3983-4854-bb7d-db373fb1533b'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:10:02 devstack sudo[109277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71333762-ff1f-494b-8076-51720b5ae831.ee9d6447-a601-446e-8261-648e37377209 Jul 30 17:10:02 devstack sudo[109277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3b13a568-2dd5-45f2-adfa-9a87771117fc tempest-CinderUnicodeTest-1481336374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3b13a568-2dd5-45f2-adfa-9a87771117fc tempest-CinderUnicodeTest-1481336374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:02 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-3b13a568-2dd5-45f2-adfa-9a87771117fc tempest-CinderUnicodeTest-1481336374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:02 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-3b13a568-2dd5-45f2-adfa-9a87771117fc tempest-CinderUnicodeTest-1481336374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3b13a568-2dd5-45f2-adfa-9a87771117fc tempest-CinderUnicodeTest-1481336374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3b13a568-2dd5-45f2-adfa-9a87771117fc tempest-CinderUnicodeTest-1481336374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:02 devstack sudo[109279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:10:02 devstack sudo[109279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:02 devstack sudo[109279]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:02 devstack sudo[109277]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3b13a568-2dd5-45f2-adfa-9a87771117fc tempest-CinderUnicodeTest-1481336374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.268s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:02 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-3b13a568-2dd5-45f2-adfa-9a87771117fc tempest-CinderUnicodeTest-1481336374 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:10:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8404baf5-f262-4cca-869c-038ebc8d4f1b tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71333762-ff1f-494b-8076-51720b5ae831.ee9d6447-a601-446e-8261-648e37377209" returned: 0 in 0.443s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8404baf5-f262-4cca-869c-038ebc8d4f1b tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71333762-ff1f-494b-8076-51720b5ae831.ee9d6447-a601-446e-8261-648e37377209 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:02 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-3b13a568-2dd5-45f2-adfa-9a87771117fc tempest-CinderUnicodeTest-1481336374 None] Deleted volume successfully. Jul 30 17:10:02 devstack sudo[109286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71333762-ff1f-494b-8076-51720b5ae831.ee9d6447-a601-446e-8261-648e37377209 Jul 30 17:10:02 devstack sudo[109286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:02 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-3b13a568-2dd5-45f2-adfa-9a87771117fc tempest-CinderUnicodeTest-1481336374 None] Lock "cinder-0915fdd4-19cc-43b8-a313-92152fced6da-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:02 devstack sudo[109286]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8404baf5-f262-4cca-869c-038ebc8d4f1b tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71333762-ff1f-494b-8076-51720b5ae831.ee9d6447-a601-446e-8261-648e37377209" returned: 0 in 0.275s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:02 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-8404baf5-f262-4cca-869c-038ebc8d4f1b tempest-ProjectMemberTests-1145856324 None] Lock "cinder-quobyte-ee9d6447-a601-446e-8261-648e37377209" released by "_delete_snapshot" :: held 1.709s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:02 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-8404baf5-f262-4cca-869c-038ebc8d4f1b tempest-ProjectMemberTests-1145856324 None] Lock "cinder-quobyte-71333762-ff1f-494b-8076-51720b5ae831" released by "delete_snapshot" :: held 1.750s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:03 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-8404baf5-f262-4cca-869c-038ebc8d4f1b tempest-ProjectMemberTests-1145856324 None] Created reservations ['23aa7db8-53c7-40d4-866d-a6a9f9cec388', 'b74b7555-148b-4738-a3ad-cf697b806299', '95c3cbd9-b465-478d-a040-9fd82a28f0f6', '6118a712-c355-47e3-9291-564a8f2bd676'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:10:03 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-8404baf5-f262-4cca-869c-038ebc8d4f1b tempest-ProjectMemberTests-1145856324 None] Delete snapshot completed successfully. Jul 30 17:10:03 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-8404baf5-f262-4cca-869c-038ebc8d4f1b tempest-ProjectMemberTests-1145856324 None] Lock "cinder-ee9d6447-a601-446e-8261-648e37377209-delete_snapshot" released by "delete_snapshot" :: held 1.897s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:03 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-2befe1df-e8cb-43f1-8581-46d066072e6f tempest-ProjectMemberTests-1145856324 None] Acquiring lock "cinder-71333762-ff1f-494b-8076-51720b5ae831-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:03 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-2befe1df-e8cb-43f1-8581-46d066072e6f tempest-ProjectMemberTests-1145856324 None] Lock "cinder-71333762-ff1f-494b-8076-51720b5ae831-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:03 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-2befe1df-e8cb-43f1-8581-46d066072e6f tempest-ProjectMemberTests-1145856324 None] Acquiring lock "cinder-quobyte-71333762-ff1f-494b-8076-51720b5ae831" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:03 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-2befe1df-e8cb-43f1-8581-46d066072e6f tempest-ProjectMemberTests-1145856324 None] Lock "cinder-quobyte-71333762-ff1f-494b-8076-51720b5ae831" acquired by "delete_volume" :: waited 0.027s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:03 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c4c63c53-acf3-4861-9e82-88ede3737fcb tempest-CinderUnicodeTest-1481336374 None] Acquiring lock "cinder-2943dab2-ae50-4e59-97ce-24945c23a755-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:03 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec334944-8781-4e38-bf78-9ef1ce77cb20]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2befe1df-e8cb-43f1-8581-46d066072e6f tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71333762-ff1f-494b-8076-51720b5ae831 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:03 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c4c63c53-acf3-4861-9e82-88ede3737fcb tempest-CinderUnicodeTest-1481336374 None] Lock "cinder-2943dab2-ae50-4e59-97ce-24945c23a755-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:03 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c4c63c53-acf3-4861-9e82-88ede3737fcb tempest-CinderUnicodeTest-1481336374 None] Acquiring lock "cinder-quobyte-2943dab2-ae50-4e59-97ce-24945c23a755" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:03 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c4c63c53-acf3-4861-9e82-88ede3737fcb tempest-CinderUnicodeTest-1481336374 None] Lock "cinder-quobyte-2943dab2-ae50-4e59-97ce-24945c23a755" acquired by "delete_volume" :: waited 0.020s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:03 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b345fb-1696-4336-84a1-aec084738772]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c4c63c53-acf3-4861-9e82-88ede3737fcb tempest-CinderUnicodeTest-1481336374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2943dab2-ae50-4e59-97ce-24945c23a755 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:03 devstack sudo[109289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71333762-ff1f-494b-8076-51720b5ae831 Jul 30 17:10:03 devstack sudo[109289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:03 devstack sudo[109290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2943dab2-ae50-4e59-97ce-24945c23a755 Jul 30 17:10:03 devstack sudo[109290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:03 devstack sudo[109289]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2befe1df-e8cb-43f1-8581-46d066072e6f tempest-ProjectMemberTests-1145856324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71333762-ff1f-494b-8076-51720b5ae831" returned: 0 in 0.420s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2befe1df-e8cb-43f1-8581-46d066072e6f tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71333762-ff1f-494b-8076-51720b5ae831 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:03 devstack sudo[109296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71333762-ff1f-494b-8076-51720b5ae831 Jul 30 17:10:03 devstack sudo[109296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:04 devstack sudo[109290]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c4c63c53-acf3-4861-9e82-88ede3737fcb tempest-CinderUnicodeTest-1481336374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2943dab2-ae50-4e59-97ce-24945c23a755" returned: 0 in 0.432s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c4c63c53-acf3-4861-9e82-88ede3737fcb tempest-CinderUnicodeTest-1481336374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2943dab2-ae50-4e59-97ce-24945c23a755 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:04 devstack sudo[109302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2943dab2-ae50-4e59-97ce-24945c23a755 Jul 30 17:10:04 devstack sudo[109302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:04 devstack sudo[109296]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2befe1df-e8cb-43f1-8581-46d066072e6f tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-71333762-ff1f-494b-8076-51720b5ae831" returned: 0 in 0.309s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:04 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-2befe1df-e8cb-43f1-8581-46d066072e6f tempest-ProjectMemberTests-1145856324 None] Lock "cinder-quobyte-71333762-ff1f-494b-8076-51720b5ae831" released by "delete_volume" :: held 0.820s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:04 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-2befe1df-e8cb-43f1-8581-46d066072e6f tempest-ProjectMemberTests-1145856324 None] Created reservations ['3f2e53a6-c5c1-4082-b0cc-3354d8657769', '91d73578-fe66-492b-a570-a4fda0dc9e24', '4842829a-cee0-42d1-8e1d-bf42ff6b9ceb', '2aac0df5-8907-4ed1-ae7d-de2166daeee8'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:10:04 devstack sudo[109302]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c4c63c53-acf3-4861-9e82-88ede3737fcb tempest-CinderUnicodeTest-1481336374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-2943dab2-ae50-4e59-97ce-24945c23a755" returned: 0 in 0.299s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:04 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c4c63c53-acf3-4861-9e82-88ede3737fcb tempest-CinderUnicodeTest-1481336374 None] Lock "cinder-quobyte-2943dab2-ae50-4e59-97ce-24945c23a755" released by "delete_volume" :: held 0.789s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2befe1df-e8cb-43f1-8581-46d066072e6f tempest-ProjectMemberTests-1145856324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2befe1df-e8cb-43f1-8581-46d066072e6f tempest-ProjectMemberTests-1145856324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:04 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-2befe1df-e8cb-43f1-8581-46d066072e6f tempest-ProjectMemberTests-1145856324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:04 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-2befe1df-e8cb-43f1-8581-46d066072e6f tempest-ProjectMemberTests-1145856324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-2befe1df-e8cb-43f1-8581-46d066072e6f tempest-ProjectMemberTests-1145856324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2befe1df-e8cb-43f1-8581-46d066072e6f tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:04 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-c4c63c53-acf3-4861-9e82-88ede3737fcb tempest-CinderUnicodeTest-1481336374 None] Created reservations ['7bdb2e5a-ac6f-47b8-9aee-1d57278c69c6', 'b4c376ec-ea78-4db2-9003-67999e0ae7a4', '8cf0282b-1982-41f2-ba89-a4367bc1e5be', 'f18e8089-3847-4614-99c5-d57ab0e70cdb'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:10:04 devstack sudo[109306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:10:04 devstack sudo[109306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c4c63c53-acf3-4861-9e82-88ede3737fcb tempest-CinderUnicodeTest-1481336374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c4c63c53-acf3-4861-9e82-88ede3737fcb tempest-CinderUnicodeTest-1481336374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:04 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-c4c63c53-acf3-4861-9e82-88ede3737fcb tempest-CinderUnicodeTest-1481336374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:04 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-c4c63c53-acf3-4861-9e82-88ede3737fcb tempest-CinderUnicodeTest-1481336374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c4c63c53-acf3-4861-9e82-88ede3737fcb tempest-CinderUnicodeTest-1481336374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c4c63c53-acf3-4861-9e82-88ede3737fcb tempest-CinderUnicodeTest-1481336374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:04 devstack sudo[109308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:10:04 devstack sudo[109308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:04 devstack sudo[109306]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-2befe1df-e8cb-43f1-8581-46d066072e6f tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.386s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:04 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-2befe1df-e8cb-43f1-8581-46d066072e6f tempest-ProjectMemberTests-1145856324 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:10:04 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-2befe1df-e8cb-43f1-8581-46d066072e6f tempest-ProjectMemberTests-1145856324 None] Deleted volume successfully. Jul 30 17:10:04 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-2befe1df-e8cb-43f1-8581-46d066072e6f tempest-ProjectMemberTests-1145856324 None] Lock "cinder-71333762-ff1f-494b-8076-51720b5ae831-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:04 devstack sudo[109308]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c4c63c53-acf3-4861-9e82-88ede3737fcb tempest-CinderUnicodeTest-1481336374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.425s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:05 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-c4c63c53-acf3-4861-9e82-88ede3737fcb tempest-CinderUnicodeTest-1481336374 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:10:05 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-c4c63c53-acf3-4861-9e82-88ede3737fcb tempest-CinderUnicodeTest-1481336374 None] Deleted volume successfully. Jul 30 17:10:05 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c4c63c53-acf3-4861-9e82-88ede3737fcb tempest-CinderUnicodeTest-1481336374 None] Lock "cinder-2943dab2-ae50-4e59-97ce-24945c23a755-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:05 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dea3932-7913-4b12-a8e0-b8cd287b0da6 tempest-ProjectMemberTests-1145856324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:10:05 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-4dea3932-7913-4b12-a8e0-b8cd287b0da6 tempest-ProjectMemberTests-1145856324 None] Flow 'volume_create_manager' (1402312b-21f2-4d89-9b94-4bfd02ad5456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:10:05 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-4dea3932-7913-4b12-a8e0-b8cd287b0da6 tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21644c62-3b18-43fd-910c-63c2b645fe46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:05 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-4dea3932-7913-4b12-a8e0-b8cd287b0da6 tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21644c62-3b18-43fd-910c-63c2b645fe46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:10:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1575663687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26c22addd8364bc982bc8002f431ee32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:10:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:10:05Z,use_quota=True,user_id='c9da4889b5dd47d3bb88b442a104a944',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:05 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-4dea3932-7913-4b12-a8e0-b8cd287b0da6 tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11ff178b-b213-45bc-af51-addb5b93c8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:05 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-4dea3932-7913-4b12-a8e0-b8cd287b0da6 tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11ff178b-b213-45bc-af51-addb5b93c8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:05 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-4dea3932-7913-4b12-a8e0-b8cd287b0da6 tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc12577a-6381-4e20-a0a7-6f7a4a11dccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:05 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-4dea3932-7913-4b12-a8e0-b8cd287b0da6 tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc12577a-6381-4e20-a0a7-6f7a4a11dccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1', 'volume_name': 'volume-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:05 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-4dea3932-7913-4b12-a8e0-b8cd287b0da6 tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b464542-0ea6-4430-9ad4-49af2f355e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:05 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-4dea3932-7913-4b12-a8e0-b8cd287b0da6 tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b464542-0ea6-4430-9ad4-49af2f355e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:05 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-4dea3932-7913-4b12-a8e0-b8cd287b0da6 tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2061727b-39e3-4323-ae60-259d62475045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:05 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-4dea3932-7913-4b12-a8e0-b8cd287b0da6 tempest-ProjectMemberTests-1145856324 None] Volume 3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1', 'volume_size': 1} Jul 30 17:10:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-4dea3932-7913-4b12-a8e0-b8cd287b0da6 tempest-ProjectMemberTests-1145856324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-4dea3932-7913-4b12-a8e0-b8cd287b0da6 tempest-ProjectMemberTests-1145856324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:05 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-4dea3932-7913-4b12-a8e0-b8cd287b0da6 tempest-ProjectMemberTests-1145856324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:10:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1575663687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26c22addd8364bc982bc8002f431ee32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:10:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:10:05Z,use_quota=True,user_id='c9da4889b5dd47d3bb88b442a104a944',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:10:05 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-4dea3932-7913-4b12-a8e0-b8cd287b0da6 tempest-ProjectMemberTests-1145856324 None] Creating volume 3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:10:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-4dea3932-7913-4b12-a8e0-b8cd287b0da6 tempest-ProjectMemberTests-1145856324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-4dea3932-7913-4b12-a8e0-b8cd287b0da6 tempest-ProjectMemberTests-1145856324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:05 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-4dea3932-7913-4b12-a8e0-b8cd287b0da6 tempest-ProjectMemberTests-1145856324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:05 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-4dea3932-7913-4b12-a8e0-b8cd287b0da6 tempest-ProjectMemberTests-1145856324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-4dea3932-7913-4b12-a8e0-b8cd287b0da6 tempest-ProjectMemberTests-1145856324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:05 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-4dea3932-7913-4b12-a8e0-b8cd287b0da6 tempest-ProjectMemberTests-1145856324 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:10:05 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-4dea3932-7913-4b12-a8e0-b8cd287b0da6 tempest-ProjectMemberTests-1145856324 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:10:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4dea3932-7913-4b12-a8e0-b8cd287b0da6 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:05 devstack sudo[109312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1 1073741824 Jul 30 17:10:05 devstack sudo[109312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:05 devstack sudo[109312]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4dea3932-7913-4b12-a8e0-b8cd287b0da6 tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1 1073741824" returned: 0 in 0.563s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4dea3932-7913-4b12-a8e0-b8cd287b0da6 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:05 devstack sudo[109317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1 Jul 30 17:10:05 devstack sudo[109317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:06 devstack sudo[109317]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-4dea3932-7913-4b12-a8e0-b8cd287b0da6 tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1" returned: 0 in 0.296s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:06 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-4dea3932-7913-4b12-a8e0-b8cd287b0da6 tempest-ProjectMemberTests-1145856324 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:10:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-4dea3932-7913-4b12-a8e0-b8cd287b0da6 tempest-ProjectMemberTests-1145856324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:06 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-4dea3932-7913-4b12-a8e0-b8cd287b0da6 tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2061727b-39e3-4323-ae60-259d62475045) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:06 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-4dea3932-7913-4b12-a8e0-b8cd287b0da6 tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20254a32-c84d-475b-80f5-30fd7113231b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:06 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-4dea3932-7913-4b12-a8e0-b8cd287b0da6 tempest-ProjectMemberTests-1145856324 None] Volume volume-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1 (3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1): created successfully Jul 30 17:10:06 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-4dea3932-7913-4b12-a8e0-b8cd287b0da6 tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20254a32-c84d-475b-80f5-30fd7113231b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:06 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-4dea3932-7913-4b12-a8e0-b8cd287b0da6 tempest-ProjectMemberTests-1145856324 None] Flow 'volume_create_manager' (1402312b-21f2-4d89-9b94-4bfd02ad5456) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:10:06 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-4dea3932-7913-4b12-a8e0-b8cd287b0da6 tempest-ProjectMemberTests-1145856324 None] Created volume successfully. Jul 30 17:10:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-63fa7ce4-5dc1-4a1a-b184-88fd8bdbf613 tempest-ProjectMemberTests-1145856324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-63fa7ce4-5dc1-4a1a-b184-88fd8bdbf613 tempest-ProjectMemberTests-1145856324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:07 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-63fa7ce4-5dc1-4a1a-b184-88fd8bdbf613 tempest-ProjectMemberTests-1145856324 None] Creating offline snapshot 25d8b92a-b127-4cb4-a481-22c9f4e732da of volume 3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1 {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:10:07 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa4895d-f1d7-46ee-a853-d613f19e6f8b]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-63fa7ce4-5dc1-4a1a-b184-88fd8bdbf613 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:07 devstack sudo[109320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1 Jul 30 17:10:07 devstack sudo[109320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:07 devstack sudo[109320]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-63fa7ce4-5dc1-4a1a-b184-88fd8bdbf613 tempest-ProjectMemberTests-1145856324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1" returned: 0 in 0.430s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-63fa7ce4-5dc1-4a1a-b184-88fd8bdbf613 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1.25d8b92a-b127-4cb4-a481-22c9f4e732da 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:07 devstack sudo[109325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1.25d8b92a-b127-4cb4-a481-22c9f4e732da 1G Jul 30 17:10:07 devstack sudo[109325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:08 devstack sudo[109325]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-63fa7ce4-5dc1-4a1a-b184-88fd8bdbf613 tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1.25d8b92a-b127-4cb4-a481-22c9f4e732da 1G" returned: 0 in 0.548s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-63fa7ce4-5dc1-4a1a-b184-88fd8bdbf613 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1.25d8b92a-b127-4cb4-a481-22c9f4e732da {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:08 devstack sudo[109332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1.25d8b92a-b127-4cb4-a481-22c9f4e732da Jul 30 17:10:08 devstack sudo[109332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:08 devstack sudo[109332]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-63fa7ce4-5dc1-4a1a-b184-88fd8bdbf613 tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1.25d8b92a-b127-4cb4-a481-22c9f4e732da" returned: 0 in 0.326s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:08 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-63fa7ce4-5dc1-4a1a-b184-88fd8bdbf613 tempest-ProjectMemberTests-1145856324 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1.25d8b92a-b127-4cb4-a481-22c9f4e732da is being set with open permissions: ugo+rw Jul 30 17:10:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-63fa7ce4-5dc1-4a1a-b184-88fd8bdbf613 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1.25d8b92a-b127-4cb4-a481-22c9f4e732da {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:08 devstack sudo[109338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1.25d8b92a-b127-4cb4-a481-22c9f4e732da Jul 30 17:10:08 devstack sudo[109338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:09 devstack sudo[109338]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-63fa7ce4-5dc1-4a1a-b184-88fd8bdbf613 tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1.25d8b92a-b127-4cb4-a481-22c9f4e732da" returned: 0 in 0.248s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-63fa7ce4-5dc1-4a1a-b184-88fd8bdbf613 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:09 devstack sudo[109341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1.info Jul 30 17:10:09 devstack sudo[109341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:09 devstack sudo[109341]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-63fa7ce4-5dc1-4a1a-b184-88fd8bdbf613 tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1.info" returned: 0 in 0.255s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:09 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-63fa7ce4-5dc1-4a1a-b184-88fd8bdbf613 tempest-ProjectMemberTests-1145856324 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1.info is being set with open permissions: ugo+rw Jul 30 17:10:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-63fa7ce4-5dc1-4a1a-b184-88fd8bdbf613 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:09 devstack sudo[109344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1.info Jul 30 17:10:09 devstack sudo[109344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:09 devstack sudo[109344]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-63fa7ce4-5dc1-4a1a-b184-88fd8bdbf613 tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1.info" returned: 0 in 0.255s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-63fa7ce4-5dc1-4a1a-b184-88fd8bdbf613 tempest-ProjectMemberTests-1145856324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.164s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:09 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-63fa7ce4-5dc1-4a1a-b184-88fd8bdbf613 tempest-ProjectMemberTests-1145856324 None] Create snapshot completed successfully Jul 30 17:10:10 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d5b9a611-1bbc-4100-bc1d-d3d7eb1c5fb2 tempest-ProjectMemberTests-1145856324 None] Acquiring lock "cinder-25d8b92a-b127-4cb4-a481-22c9f4e732da-delete_snapshot" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:10 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d5b9a611-1bbc-4100-bc1d-d3d7eb1c5fb2 tempest-ProjectMemberTests-1145856324 None] Lock "cinder-25d8b92a-b127-4cb4-a481-22c9f4e732da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:10 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d5b9a611-1bbc-4100-bc1d-d3d7eb1c5fb2 tempest-ProjectMemberTests-1145856324 None] Acquiring lock "cinder-quobyte-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:10 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d5b9a611-1bbc-4100-bc1d-d3d7eb1c5fb2 tempest-ProjectMemberTests-1145856324 None] Lock "cinder-quobyte-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:10 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d5b9a611-1bbc-4100-bc1d-d3d7eb1c5fb2 tempest-ProjectMemberTests-1145856324 None] Acquiring lock "cinder-quobyte-25d8b92a-b127-4cb4-a481-22c9f4e732da" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:10 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d5b9a611-1bbc-4100-bc1d-d3d7eb1c5fb2 tempest-ProjectMemberTests-1145856324 None] Lock "cinder-quobyte-25d8b92a-b127-4cb4-a481-22c9f4e732da" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:10 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-d5b9a611-1bbc-4100-bc1d-d3d7eb1c5fb2 tempest-ProjectMemberTests-1145856324 None] Deleting offline snapshot 25d8b92a-b127-4cb4-a481-22c9f4e732da of volume 3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:10:10 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-d5b9a611-1bbc-4100-bc1d-d3d7eb1c5fb2 tempest-ProjectMemberTests-1145856324 None] snapshot_file for this snap is: volume-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1.25d8b92a-b127-4cb4-a481-22c9f4e732da {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:10:10 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd46baad-b8bf-4fc5-8212-b96dc1719ca8]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d5b9a611-1bbc-4100-bc1d-d3d7eb1c5fb2 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1.25d8b92a-b127-4cb4-a481-22c9f4e732da {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:10 devstack sudo[109347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1.25d8b92a-b127-4cb4-a481-22c9f4e732da Jul 30 17:10:10 devstack sudo[109347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:11 devstack sudo[109347]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d5b9a611-1bbc-4100-bc1d-d3d7eb1c5fb2 tempest-ProjectMemberTests-1145856324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1.25d8b92a-b127-4cb4-a481-22c9f4e732da" returned: 0 in 0.383s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:11 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-d5b9a611-1bbc-4100-bc1d-d3d7eb1c5fb2 tempest-ProjectMemberTests-1145856324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:10:11 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a19b7d4-cdfc-48fe-abd5-ef8d8d7f797f]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d5b9a611-1bbc-4100-bc1d-d3d7eb1c5fb2 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:11 devstack sudo[109352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1 Jul 30 17:10:11 devstack sudo[109352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:11 devstack sudo[109352]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d5b9a611-1bbc-4100-bc1d-d3d7eb1c5fb2 tempest-ProjectMemberTests-1145856324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1" returned: 0 in 0.393s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d5b9a611-1bbc-4100-bc1d-d3d7eb1c5fb2 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1.25d8b92a-b127-4cb4-a481-22c9f4e732da {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:11 devstack sudo[109357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1.25d8b92a-b127-4cb4-a481-22c9f4e732da Jul 30 17:10:11 devstack sudo[109357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:12 devstack sudo[109357]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d5b9a611-1bbc-4100-bc1d-d3d7eb1c5fb2 tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1.25d8b92a-b127-4cb4-a481-22c9f4e732da" returned: 0 in 0.419s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d5b9a611-1bbc-4100-bc1d-d3d7eb1c5fb2 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1.25d8b92a-b127-4cb4-a481-22c9f4e732da {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:12 devstack sudo[109363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1.25d8b92a-b127-4cb4-a481-22c9f4e732da Jul 30 17:10:12 devstack sudo[109363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:12 devstack sudo[109363]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d5b9a611-1bbc-4100-bc1d-d3d7eb1c5fb2 tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1.25d8b92a-b127-4cb4-a481-22c9f4e732da" returned: 0 in 0.284s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:12 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d5b9a611-1bbc-4100-bc1d-d3d7eb1c5fb2 tempest-ProjectMemberTests-1145856324 None] Lock "cinder-quobyte-25d8b92a-b127-4cb4-a481-22c9f4e732da" released by "_delete_snapshot" :: held 1.595s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:12 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d5b9a611-1bbc-4100-bc1d-d3d7eb1c5fb2 tempest-ProjectMemberTests-1145856324 None] Lock "cinder-quobyte-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1" released by "delete_snapshot" :: held 1.619s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:12 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:SELECT=222,cinder:INSERT=89,cinder:UPDATE=291,cinder:DELETE=23 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:10:12 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:SELECT=221,cinder:UPDATE=277,cinder:INSERT=77,cinder:DELETE=24 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:10:12 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-d5b9a611-1bbc-4100-bc1d-d3d7eb1c5fb2 tempest-ProjectMemberTests-1145856324 None] Created reservations ['2c4c07ba-3e4e-4d96-888c-2672e66c5fdc', '178fc1fa-403e-44b4-91c0-8aeb565eeadc', '29b201f7-a1ae-4a49-aa3d-de5e0c62d1f4', 'ffdf47f3-237d-4cdb-8f38-944f105b452f'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:10:12 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-d5b9a611-1bbc-4100-bc1d-d3d7eb1c5fb2 tempest-ProjectMemberTests-1145856324 None] Delete snapshot completed successfully. Jul 30 17:10:12 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d5b9a611-1bbc-4100-bc1d-d3d7eb1c5fb2 tempest-ProjectMemberTests-1145856324 None] Lock "cinder-25d8b92a-b127-4cb4-a481-22c9f4e732da-delete_snapshot" released by "delete_snapshot" :: held 1.802s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:12 devstack cinder-volume[88591]: DEBUG oslo_service.periodic_task [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 17:10:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:12 devstack sudo[109369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:10:12 devstack sudo[109369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:12 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-48adc492-bad5-4a86-bb9c-88ab0706a041 tempest-ProjectMemberTests-1145856324 None] Acquiring lock "cinder-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:12 devstack sudo[109369]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.278s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:12 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:10:12 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-48adc492-bad5-4a86-bb9c-88ab0706a041 tempest-ProjectMemberTests-1145856324 None] Lock "cinder-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:12 devstack cinder-volume[88591]: DEBUG oslo_service.periodic_task [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running periodic task VolumeManager._thread_info {{(pid=88591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 17:10:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] thread count: 28 {{(pid=88591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 17:10:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] thread info: [<_MainThread(MainThread, started 140677178003584)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 17:10:13 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-48adc492-bad5-4a86-bb9c-88ab0706a041 tempest-ProjectMemberTests-1145856324 None] Acquiring lock "cinder-quobyte-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:13 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-48adc492-bad5-4a86-bb9c-88ab0706a041 tempest-ProjectMemberTests-1145856324 None] Lock "cinder-quobyte-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1" acquired by "delete_volume" :: waited 0.026s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:13 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f5a608-0b4e-4328-b81a-70f395643653]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-48adc492-bad5-4a86-bb9c-88ab0706a041 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:13 devstack sudo[109373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1 Jul 30 17:10:13 devstack sudo[109373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:13 devstack sudo[109373]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-48adc492-bad5-4a86-bb9c-88ab0706a041 tempest-ProjectMemberTests-1145856324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1" returned: 0 in 0.442s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-48adc492-bad5-4a86-bb9c-88ab0706a041 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:13 devstack sudo[109378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1 Jul 30 17:10:13 devstack sudo[109378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:13 devstack sudo[109378]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-48adc492-bad5-4a86-bb9c-88ab0706a041 tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1" returned: 0 in 0.288s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:13 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-48adc492-bad5-4a86-bb9c-88ab0706a041 tempest-ProjectMemberTests-1145856324 None] Lock "cinder-quobyte-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1" released by "delete_volume" :: held 0.824s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:13 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-48adc492-bad5-4a86-bb9c-88ab0706a041 tempest-ProjectMemberTests-1145856324 None] Created reservations ['75e1a15b-bfdd-4abb-a5cd-d36f3652827e', '14242d2f-b30b-47a9-abc3-a0a8eab50509', 'ff67ea8a-cb03-4dc7-b333-944520f3b6fb', 'cbcdf7fd-192a-46d1-ae7a-1237ab725db4'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:10:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-48adc492-bad5-4a86-bb9c-88ab0706a041 tempest-ProjectMemberTests-1145856324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-48adc492-bad5-4a86-bb9c-88ab0706a041 tempest-ProjectMemberTests-1145856324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:14 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-48adc492-bad5-4a86-bb9c-88ab0706a041 tempest-ProjectMemberTests-1145856324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:14 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-48adc492-bad5-4a86-bb9c-88ab0706a041 tempest-ProjectMemberTests-1145856324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-48adc492-bad5-4a86-bb9c-88ab0706a041 tempest-ProjectMemberTests-1145856324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-48adc492-bad5-4a86-bb9c-88ab0706a041 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:14 devstack sudo[109381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:10:14 devstack sudo[109381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:14 devstack sudo[109381]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-48adc492-bad5-4a86-bb9c-88ab0706a041 tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.265s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:14 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-48adc492-bad5-4a86-bb9c-88ab0706a041 tempest-ProjectMemberTests-1145856324 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:10:14 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-48adc492-bad5-4a86-bb9c-88ab0706a041 tempest-ProjectMemberTests-1145856324 None] Deleted volume successfully. Jul 30 17:10:14 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-48adc492-bad5-4a86-bb9c-88ab0706a041 tempest-ProjectMemberTests-1145856324 None] Lock "cinder-3fc3e7a8-4cee-4ab5-962b-f68cf7a913a1-delete_volume" released by "delete_volume" :: held 1.418s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:14 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-09cbadbe-29ba-465a-89f0-4bdf8fecb55a tempest-ProjectMemberTests-1145856324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:10:14 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-09cbadbe-29ba-465a-89f0-4bdf8fecb55a tempest-ProjectMemberTests-1145856324 None] Flow 'volume_create_manager' (4d3f4611-3d2d-4302-baf1-4308d5cfa0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:10:14 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-09cbadbe-29ba-465a-89f0-4bdf8fecb55a tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f18c435-849c-4e24-8294-8f72f166a37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:14 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-09cbadbe-29ba-465a-89f0-4bdf8fecb55a tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f18c435-849c-4e24-8294-8f72f166a37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:10:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1877011075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75fc11b6-7b02-4688-8419-c7e1039e6e69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26c22addd8364bc982bc8002f431ee32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:10:15Z,use_quota=True,user_id='c9da4889b5dd47d3bb88b442a104a944',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:14 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-09cbadbe-29ba-465a-89f0-4bdf8fecb55a tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55ff8c70-542a-4594-87c8-0e85dcb20b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:14 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-09cbadbe-29ba-465a-89f0-4bdf8fecb55a tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55ff8c70-542a-4594-87c8-0e85dcb20b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:14 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-09cbadbe-29ba-465a-89f0-4bdf8fecb55a tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0747fd03-b46e-446f-a4a9-a7fcf7d4a747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:14 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-09cbadbe-29ba-465a-89f0-4bdf8fecb55a tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0747fd03-b46e-446f-a4a9-a7fcf7d4a747) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75fc11b6-7b02-4688-8419-c7e1039e6e69', 'volume_name': 'volume-75fc11b6-7b02-4688-8419-c7e1039e6e69', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:14 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-09cbadbe-29ba-465a-89f0-4bdf8fecb55a tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14eb9d44-4de6-4bcb-8728-b809b31fa930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:14 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-09cbadbe-29ba-465a-89f0-4bdf8fecb55a tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14eb9d44-4de6-4bcb-8728-b809b31fa930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:14 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-09cbadbe-29ba-465a-89f0-4bdf8fecb55a tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9199b3f2-7e0b-4c67-8347-16d7d3fa2951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:14 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-09cbadbe-29ba-465a-89f0-4bdf8fecb55a tempest-ProjectMemberTests-1145856324 None] Volume 75fc11b6-7b02-4688-8419-c7e1039e6e69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75fc11b6-7b02-4688-8419-c7e1039e6e69', 'volume_size': 1} Jul 30 17:10:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-09cbadbe-29ba-465a-89f0-4bdf8fecb55a tempest-ProjectMemberTests-1145856324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-09cbadbe-29ba-465a-89f0-4bdf8fecb55a tempest-ProjectMemberTests-1145856324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:14 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-09cbadbe-29ba-465a-89f0-4bdf8fecb55a tempest-ProjectMemberTests-1145856324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:10:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1877011075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75fc11b6-7b02-4688-8419-c7e1039e6e69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26c22addd8364bc982bc8002f431ee32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:10:15Z,use_quota=True,user_id='c9da4889b5dd47d3bb88b442a104a944',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:10:14 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-09cbadbe-29ba-465a-89f0-4bdf8fecb55a tempest-ProjectMemberTests-1145856324 None] Creating volume 75fc11b6-7b02-4688-8419-c7e1039e6e69 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:10:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-09cbadbe-29ba-465a-89f0-4bdf8fecb55a tempest-ProjectMemberTests-1145856324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-09cbadbe-29ba-465a-89f0-4bdf8fecb55a tempest-ProjectMemberTests-1145856324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:14 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-09cbadbe-29ba-465a-89f0-4bdf8fecb55a tempest-ProjectMemberTests-1145856324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:14 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-09cbadbe-29ba-465a-89f0-4bdf8fecb55a tempest-ProjectMemberTests-1145856324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-09cbadbe-29ba-465a-89f0-4bdf8fecb55a tempest-ProjectMemberTests-1145856324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:14 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-09cbadbe-29ba-465a-89f0-4bdf8fecb55a tempest-ProjectMemberTests-1145856324 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:10:14 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-09cbadbe-29ba-465a-89f0-4bdf8fecb55a tempest-ProjectMemberTests-1145856324 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:10:14 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-09cbadbe-29ba-465a-89f0-4bdf8fecb55a tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-75fc11b6-7b02-4688-8419-c7e1039e6e69 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:14 devstack sudo[109384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-75fc11b6-7b02-4688-8419-c7e1039e6e69 1073741824 Jul 30 17:10:14 devstack sudo[109384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:15 devstack sudo[109384]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-09cbadbe-29ba-465a-89f0-4bdf8fecb55a tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-75fc11b6-7b02-4688-8419-c7e1039e6e69 1073741824" returned: 0 in 0.440s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-09cbadbe-29ba-465a-89f0-4bdf8fecb55a tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-75fc11b6-7b02-4688-8419-c7e1039e6e69 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:15 devstack sudo[109390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-75fc11b6-7b02-4688-8419-c7e1039e6e69 Jul 30 17:10:15 devstack sudo[109390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:15 devstack sudo[109390]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-09cbadbe-29ba-465a-89f0-4bdf8fecb55a tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-75fc11b6-7b02-4688-8419-c7e1039e6e69" returned: 0 in 0.258s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:15 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-09cbadbe-29ba-465a-89f0-4bdf8fecb55a tempest-ProjectMemberTests-1145856324 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:10:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-09cbadbe-29ba-465a-89f0-4bdf8fecb55a tempest-ProjectMemberTests-1145856324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:15 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-09cbadbe-29ba-465a-89f0-4bdf8fecb55a tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9199b3f2-7e0b-4c67-8347-16d7d3fa2951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75fc11b6-7b02-4688-8419-c7e1039e6e69', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:15 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-09cbadbe-29ba-465a-89f0-4bdf8fecb55a tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a48b4755-937d-4c92-9b98-cc6ef564052f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:15 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-09cbadbe-29ba-465a-89f0-4bdf8fecb55a tempest-ProjectMemberTests-1145856324 None] Volume volume-75fc11b6-7b02-4688-8419-c7e1039e6e69 (75fc11b6-7b02-4688-8419-c7e1039e6e69): created successfully Jul 30 17:10:15 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-09cbadbe-29ba-465a-89f0-4bdf8fecb55a tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a48b4755-937d-4c92-9b98-cc6ef564052f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:15 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-09cbadbe-29ba-465a-89f0-4bdf8fecb55a tempest-ProjectMemberTests-1145856324 None] Flow 'volume_create_manager' (4d3f4611-3d2d-4302-baf1-4308d5cfa0e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:10:15 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-09cbadbe-29ba-465a-89f0-4bdf8fecb55a tempest-ProjectMemberTests-1145856324 None] Created volume successfully. Jul 30 17:10:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-cf6fc036-2289-4768-8998-722458fd3cea tempest-ProjectMemberTests-1145856324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-cf6fc036-2289-4768-8998-722458fd3cea tempest-ProjectMemberTests-1145856324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:15 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-cf6fc036-2289-4768-8998-722458fd3cea tempest-ProjectMemberTests-1145856324 None] Creating offline snapshot da3b7eec-cda0-4233-8532-218e522ab342 of volume 75fc11b6-7b02-4688-8419-c7e1039e6e69 {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:10:15 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec2288a-0c46-4e6c-8026-b757d6d6c978]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cf6fc036-2289-4768-8998-722458fd3cea tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-75fc11b6-7b02-4688-8419-c7e1039e6e69 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:15 devstack sudo[109393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-75fc11b6-7b02-4688-8419-c7e1039e6e69 Jul 30 17:10:15 devstack sudo[109393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:16 devstack sudo[109393]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:16 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cf6fc036-2289-4768-8998-722458fd3cea tempest-ProjectMemberTests-1145856324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-75fc11b6-7b02-4688-8419-c7e1039e6e69" returned: 0 in 0.375s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:16 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cf6fc036-2289-4768-8998-722458fd3cea tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-75fc11b6-7b02-4688-8419-c7e1039e6e69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-75fc11b6-7b02-4688-8419-c7e1039e6e69.da3b7eec-cda0-4233-8532-218e522ab342 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:16 devstack sudo[109398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-75fc11b6-7b02-4688-8419-c7e1039e6e69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-75fc11b6-7b02-4688-8419-c7e1039e6e69.da3b7eec-cda0-4233-8532-218e522ab342 1G Jul 30 17:10:16 devstack sudo[109398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:16 devstack sudo[109398]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:16 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cf6fc036-2289-4768-8998-722458fd3cea tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-75fc11b6-7b02-4688-8419-c7e1039e6e69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-75fc11b6-7b02-4688-8419-c7e1039e6e69.da3b7eec-cda0-4233-8532-218e522ab342 1G" returned: 0 in 0.398s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:16 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cf6fc036-2289-4768-8998-722458fd3cea tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75fc11b6-7b02-4688-8419-c7e1039e6e69 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-75fc11b6-7b02-4688-8419-c7e1039e6e69.da3b7eec-cda0-4233-8532-218e522ab342 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:16 devstack sudo[109404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75fc11b6-7b02-4688-8419-c7e1039e6e69 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-75fc11b6-7b02-4688-8419-c7e1039e6e69.da3b7eec-cda0-4233-8532-218e522ab342 Jul 30 17:10:16 devstack sudo[109404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:16 devstack sudo[109404]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:16 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cf6fc036-2289-4768-8998-722458fd3cea tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75fc11b6-7b02-4688-8419-c7e1039e6e69 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-75fc11b6-7b02-4688-8419-c7e1039e6e69.da3b7eec-cda0-4233-8532-218e522ab342" returned: 0 in 0.278s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:16 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-cf6fc036-2289-4768-8998-722458fd3cea tempest-ProjectMemberTests-1145856324 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-75fc11b6-7b02-4688-8419-c7e1039e6e69.da3b7eec-cda0-4233-8532-218e522ab342 is being set with open permissions: ugo+rw Jul 30 17:10:16 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cf6fc036-2289-4768-8998-722458fd3cea tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-75fc11b6-7b02-4688-8419-c7e1039e6e69.da3b7eec-cda0-4233-8532-218e522ab342 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:16 devstack sudo[109409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-75fc11b6-7b02-4688-8419-c7e1039e6e69.da3b7eec-cda0-4233-8532-218e522ab342 Jul 30 17:10:16 devstack sudo[109409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:17 devstack sudo[109409]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cf6fc036-2289-4768-8998-722458fd3cea tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-75fc11b6-7b02-4688-8419-c7e1039e6e69.da3b7eec-cda0-4233-8532-218e522ab342" returned: 0 in 0.241s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cf6fc036-2289-4768-8998-722458fd3cea tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-75fc11b6-7b02-4688-8419-c7e1039e6e69.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:17 devstack sudo[109412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-75fc11b6-7b02-4688-8419-c7e1039e6e69.info Jul 30 17:10:17 devstack sudo[109412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:17 devstack sudo[109412]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cf6fc036-2289-4768-8998-722458fd3cea tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-75fc11b6-7b02-4688-8419-c7e1039e6e69.info" returned: 0 in 0.260s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:17 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-cf6fc036-2289-4768-8998-722458fd3cea tempest-ProjectMemberTests-1145856324 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-75fc11b6-7b02-4688-8419-c7e1039e6e69.info is being set with open permissions: ugo+rw Jul 30 17:10:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cf6fc036-2289-4768-8998-722458fd3cea tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-75fc11b6-7b02-4688-8419-c7e1039e6e69.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:17 devstack sudo[109415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-75fc11b6-7b02-4688-8419-c7e1039e6e69.info Jul 30 17:10:17 devstack sudo[109415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:17 devstack sudo[109415]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cf6fc036-2289-4768-8998-722458fd3cea tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-75fc11b6-7b02-4688-8419-c7e1039e6e69.info" returned: 0 in 0.260s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-cf6fc036-2289-4768-8998-722458fd3cea tempest-ProjectMemberTests-1145856324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.906s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:17 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-cf6fc036-2289-4768-8998-722458fd3cea tempest-ProjectMemberTests-1145856324 None] Create snapshot completed successfully Jul 30 17:10:17 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b4fa4b1a-405d-4840-9cc0-58b6b4df6314 tempest-ProjectMemberTests-1145856324 None] Acquiring lock "cinder-da3b7eec-cda0-4233-8532-218e522ab342-delete_snapshot" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:17 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b4fa4b1a-405d-4840-9cc0-58b6b4df6314 tempest-ProjectMemberTests-1145856324 None] Lock "cinder-da3b7eec-cda0-4233-8532-218e522ab342-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:17 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b4fa4b1a-405d-4840-9cc0-58b6b4df6314 tempest-ProjectMemberTests-1145856324 None] Acquiring lock "cinder-quobyte-75fc11b6-7b02-4688-8419-c7e1039e6e69" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:18 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b4fa4b1a-405d-4840-9cc0-58b6b4df6314 tempest-ProjectMemberTests-1145856324 None] Lock "cinder-quobyte-75fc11b6-7b02-4688-8419-c7e1039e6e69" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:18 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b4fa4b1a-405d-4840-9cc0-58b6b4df6314 tempest-ProjectMemberTests-1145856324 None] Acquiring lock "cinder-quobyte-da3b7eec-cda0-4233-8532-218e522ab342" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:18 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b4fa4b1a-405d-4840-9cc0-58b6b4df6314 tempest-ProjectMemberTests-1145856324 None] Lock "cinder-quobyte-da3b7eec-cda0-4233-8532-218e522ab342" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:18 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-b4fa4b1a-405d-4840-9cc0-58b6b4df6314 tempest-ProjectMemberTests-1145856324 None] Deleting offline snapshot da3b7eec-cda0-4233-8532-218e522ab342 of volume 75fc11b6-7b02-4688-8419-c7e1039e6e69 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:10:18 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-b4fa4b1a-405d-4840-9cc0-58b6b4df6314 tempest-ProjectMemberTests-1145856324 None] snapshot_file for this snap is: volume-75fc11b6-7b02-4688-8419-c7e1039e6e69.da3b7eec-cda0-4233-8532-218e522ab342 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:10:18 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[4823f2ab-cf32-4e60-b9e9-25d5b08203e0]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b4fa4b1a-405d-4840-9cc0-58b6b4df6314 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-75fc11b6-7b02-4688-8419-c7e1039e6e69.da3b7eec-cda0-4233-8532-218e522ab342 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:18 devstack sudo[109418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-75fc11b6-7b02-4688-8419-c7e1039e6e69.da3b7eec-cda0-4233-8532-218e522ab342 Jul 30 17:10:18 devstack sudo[109418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:18 devstack sudo[109418]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b4fa4b1a-405d-4840-9cc0-58b6b4df6314 tempest-ProjectMemberTests-1145856324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-75fc11b6-7b02-4688-8419-c7e1039e6e69.da3b7eec-cda0-4233-8532-218e522ab342" returned: 0 in 0.392s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:18 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-b4fa4b1a-405d-4840-9cc0-58b6b4df6314 tempest-ProjectMemberTests-1145856324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75fc11b6-7b02-4688-8419-c7e1039e6e69(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:10:18 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[141f87e7-2a80-4fda-a6a3-e6ec73bf8ee6]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b4fa4b1a-405d-4840-9cc0-58b6b4df6314 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-75fc11b6-7b02-4688-8419-c7e1039e6e69 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:18 devstack sudo[109423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-75fc11b6-7b02-4688-8419-c7e1039e6e69 Jul 30 17:10:18 devstack sudo[109423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:18 devstack sudo[109423]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b4fa4b1a-405d-4840-9cc0-58b6b4df6314 tempest-ProjectMemberTests-1145856324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-75fc11b6-7b02-4688-8419-c7e1039e6e69" returned: 0 in 0.386s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b4fa4b1a-405d-4840-9cc0-58b6b4df6314 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-75fc11b6-7b02-4688-8419-c7e1039e6e69.da3b7eec-cda0-4233-8532-218e522ab342 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:18 devstack sudo[109429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-75fc11b6-7b02-4688-8419-c7e1039e6e69.da3b7eec-cda0-4233-8532-218e522ab342 Jul 30 17:10:18 devstack sudo[109429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:19 devstack sudo[109429]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b4fa4b1a-405d-4840-9cc0-58b6b4df6314 tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-75fc11b6-7b02-4688-8419-c7e1039e6e69.da3b7eec-cda0-4233-8532-218e522ab342" returned: 0 in 0.398s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b4fa4b1a-405d-4840-9cc0-58b6b4df6314 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-75fc11b6-7b02-4688-8419-c7e1039e6e69.da3b7eec-cda0-4233-8532-218e522ab342 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:19 devstack sudo[109434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-75fc11b6-7b02-4688-8419-c7e1039e6e69.da3b7eec-cda0-4233-8532-218e522ab342 Jul 30 17:10:19 devstack sudo[109434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:19 devstack sudo[109434]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-b4fa4b1a-405d-4840-9cc0-58b6b4df6314 tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-75fc11b6-7b02-4688-8419-c7e1039e6e69.da3b7eec-cda0-4233-8532-218e522ab342" returned: 0 in 0.264s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:19 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b4fa4b1a-405d-4840-9cc0-58b6b4df6314 tempest-ProjectMemberTests-1145856324 None] Lock "cinder-quobyte-da3b7eec-cda0-4233-8532-218e522ab342" released by "_delete_snapshot" :: held 1.547s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:19 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b4fa4b1a-405d-4840-9cc0-58b6b4df6314 tempest-ProjectMemberTests-1145856324 None] Lock "cinder-quobyte-75fc11b6-7b02-4688-8419-c7e1039e6e69" released by "delete_snapshot" :: held 1.573s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:19 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-b4fa4b1a-405d-4840-9cc0-58b6b4df6314 tempest-ProjectMemberTests-1145856324 None] Created reservations ['ba044456-ec77-4b21-ae9d-96e040dcde6a', 'ed4fbc33-ac36-45cf-bd14-a79685990406', '581835f1-3762-47e1-8083-06c6b74a2797', '688ce609-fad1-4104-aed2-49011cee439a'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:10:19 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-b4fa4b1a-405d-4840-9cc0-58b6b4df6314 tempest-ProjectMemberTests-1145856324 None] Delete snapshot completed successfully. Jul 30 17:10:19 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-b4fa4b1a-405d-4840-9cc0-58b6b4df6314 tempest-ProjectMemberTests-1145856324 None] Lock "cinder-da3b7eec-cda0-4233-8532-218e522ab342-delete_snapshot" released by "delete_snapshot" :: held 1.725s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:20 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7bf14b46-6461-47cf-9247-4442b30eca32 tempest-ProjectMemberTests-1145856324 None] Acquiring lock "cinder-75fc11b6-7b02-4688-8419-c7e1039e6e69-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:20 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7bf14b46-6461-47cf-9247-4442b30eca32 tempest-ProjectMemberTests-1145856324 None] Lock "cinder-75fc11b6-7b02-4688-8419-c7e1039e6e69-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:20 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7bf14b46-6461-47cf-9247-4442b30eca32 tempest-ProjectMemberTests-1145856324 None] Acquiring lock "cinder-quobyte-75fc11b6-7b02-4688-8419-c7e1039e6e69" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:20 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7bf14b46-6461-47cf-9247-4442b30eca32 tempest-ProjectMemberTests-1145856324 None] Lock "cinder-quobyte-75fc11b6-7b02-4688-8419-c7e1039e6e69" acquired by "delete_volume" :: waited 0.020s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:20 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[09cff310-35f8-4c8c-9ecc-6925365fff42]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7bf14b46-6461-47cf-9247-4442b30eca32 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-75fc11b6-7b02-4688-8419-c7e1039e6e69 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:20 devstack sudo[109437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-75fc11b6-7b02-4688-8419-c7e1039e6e69 Jul 30 17:10:20 devstack sudo[109437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:20 devstack sudo[109437]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7bf14b46-6461-47cf-9247-4442b30eca32 tempest-ProjectMemberTests-1145856324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-75fc11b6-7b02-4688-8419-c7e1039e6e69" returned: 0 in 0.368s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7bf14b46-6461-47cf-9247-4442b30eca32 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-75fc11b6-7b02-4688-8419-c7e1039e6e69 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:20 devstack sudo[109442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-75fc11b6-7b02-4688-8419-c7e1039e6e69 Jul 30 17:10:20 devstack sudo[109442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:20 devstack sudo[109442]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7bf14b46-6461-47cf-9247-4442b30eca32 tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-75fc11b6-7b02-4688-8419-c7e1039e6e69" returned: 0 in 0.253s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:20 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7bf14b46-6461-47cf-9247-4442b30eca32 tempest-ProjectMemberTests-1145856324 None] Lock "cinder-quobyte-75fc11b6-7b02-4688-8419-c7e1039e6e69" released by "delete_volume" :: held 0.679s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:20 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-7bf14b46-6461-47cf-9247-4442b30eca32 tempest-ProjectMemberTests-1145856324 None] Created reservations ['67611c78-0598-417f-9cd0-2ad1e71995a4', '572669cb-6b56-463c-b7ad-e590b11ad600', 'af35adb6-5e02-4d9b-a97f-560b105c63dc', 'f0cccada-8088-468c-b708-0ad8d9ad8267'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:10:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7bf14b46-6461-47cf-9247-4442b30eca32 tempest-ProjectMemberTests-1145856324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7bf14b46-6461-47cf-9247-4442b30eca32 tempest-ProjectMemberTests-1145856324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:21 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7bf14b46-6461-47cf-9247-4442b30eca32 tempest-ProjectMemberTests-1145856324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:21 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7bf14b46-6461-47cf-9247-4442b30eca32 tempest-ProjectMemberTests-1145856324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7bf14b46-6461-47cf-9247-4442b30eca32 tempest-ProjectMemberTests-1145856324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7bf14b46-6461-47cf-9247-4442b30eca32 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:21 devstack sudo[109445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:10:21 devstack sudo[109445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:21 devstack sudo[109445]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7bf14b46-6461-47cf-9247-4442b30eca32 tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.283s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:21 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-7bf14b46-6461-47cf-9247-4442b30eca32 tempest-ProjectMemberTests-1145856324 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:10:21 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-7bf14b46-6461-47cf-9247-4442b30eca32 tempest-ProjectMemberTests-1145856324 None] Deleted volume successfully. Jul 30 17:10:21 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7bf14b46-6461-47cf-9247-4442b30eca32 tempest-ProjectMemberTests-1145856324 None] Lock "cinder-75fc11b6-7b02-4688-8419-c7e1039e6e69-delete_volume" released by "delete_volume" :: held 1.185s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:21 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-12656f44-553d-4e09-9350-ca29d3d8d274 tempest-ProjectMemberTests-1145856324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:10:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-12656f44-553d-4e09-9350-ca29d3d8d274 tempest-ProjectMemberTests-1145856324 None] Flow 'volume_create_manager' (93142ab6-6d95-49dc-9968-f0e8739defbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:10:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-12656f44-553d-4e09-9350-ca29d3d8d274 tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eee0623e-00ed-4965-9a94-01b8fd999843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-12656f44-553d-4e09-9350-ca29d3d8d274 tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eee0623e-00ed-4965-9a94-01b8fd999843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-738438587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=710aebf5-4038-48dd-aac2-83c7580c871d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26c22addd8364bc982bc8002f431ee32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:10:22Z,use_quota=True,user_id='c9da4889b5dd47d3bb88b442a104a944',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-12656f44-553d-4e09-9350-ca29d3d8d274 tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a99057cc-b45a-4865-a797-9d7f2261f8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-12656f44-553d-4e09-9350-ca29d3d8d274 tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a99057cc-b45a-4865-a797-9d7f2261f8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-12656f44-553d-4e09-9350-ca29d3d8d274 tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80dc011c-fc04-4c51-9401-ee3d0f0bd75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-12656f44-553d-4e09-9350-ca29d3d8d274 tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80dc011c-fc04-4c51-9401-ee3d0f0bd75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '710aebf5-4038-48dd-aac2-83c7580c871d', 'volume_name': 'volume-710aebf5-4038-48dd-aac2-83c7580c871d', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-12656f44-553d-4e09-9350-ca29d3d8d274 tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (477ddcbb-2570-4ce6-a5f8-8795c5f573a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-12656f44-553d-4e09-9350-ca29d3d8d274 tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (477ddcbb-2570-4ce6-a5f8-8795c5f573a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-12656f44-553d-4e09-9350-ca29d3d8d274 tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78a2f111-f73b-40fa-af57-b3474e440c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:21 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-12656f44-553d-4e09-9350-ca29d3d8d274 tempest-ProjectMemberTests-1145856324 None] Volume 710aebf5-4038-48dd-aac2-83c7580c871d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-710aebf5-4038-48dd-aac2-83c7580c871d', 'volume_size': 1} Jul 30 17:10:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-12656f44-553d-4e09-9350-ca29d3d8d274 tempest-ProjectMemberTests-1145856324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-12656f44-553d-4e09-9350-ca29d3d8d274 tempest-ProjectMemberTests-1145856324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:21 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-12656f44-553d-4e09-9350-ca29d3d8d274 tempest-ProjectMemberTests-1145856324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-738438587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=710aebf5-4038-48dd-aac2-83c7580c871d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26c22addd8364bc982bc8002f431ee32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:10:22Z,use_quota=True,user_id='c9da4889b5dd47d3bb88b442a104a944',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:10:21 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-12656f44-553d-4e09-9350-ca29d3d8d274 tempest-ProjectMemberTests-1145856324 None] Creating volume 710aebf5-4038-48dd-aac2-83c7580c871d {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:10:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-12656f44-553d-4e09-9350-ca29d3d8d274 tempest-ProjectMemberTests-1145856324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-12656f44-553d-4e09-9350-ca29d3d8d274 tempest-ProjectMemberTests-1145856324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:21 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-12656f44-553d-4e09-9350-ca29d3d8d274 tempest-ProjectMemberTests-1145856324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:21 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-12656f44-553d-4e09-9350-ca29d3d8d274 tempest-ProjectMemberTests-1145856324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-12656f44-553d-4e09-9350-ca29d3d8d274 tempest-ProjectMemberTests-1145856324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:21 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-12656f44-553d-4e09-9350-ca29d3d8d274 tempest-ProjectMemberTests-1145856324 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:10:21 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-12656f44-553d-4e09-9350-ca29d3d8d274 tempest-ProjectMemberTests-1145856324 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:10:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-12656f44-553d-4e09-9350-ca29d3d8d274 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-710aebf5-4038-48dd-aac2-83c7580c871d 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:21 devstack sudo[109448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-710aebf5-4038-48dd-aac2-83c7580c871d 1073741824 Jul 30 17:10:21 devstack sudo[109448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:22 devstack sudo[109448]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-12656f44-553d-4e09-9350-ca29d3d8d274 tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-710aebf5-4038-48dd-aac2-83c7580c871d 1073741824" returned: 0 in 0.447s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-12656f44-553d-4e09-9350-ca29d3d8d274 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-710aebf5-4038-48dd-aac2-83c7580c871d {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:22 devstack sudo[109455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-710aebf5-4038-48dd-aac2-83c7580c871d Jul 30 17:10:22 devstack sudo[109455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:22 devstack sudo[109455]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-12656f44-553d-4e09-9350-ca29d3d8d274 tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-710aebf5-4038-48dd-aac2-83c7580c871d" returned: 0 in 0.247s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:22 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-12656f44-553d-4e09-9350-ca29d3d8d274 tempest-ProjectMemberTests-1145856324 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:10:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-12656f44-553d-4e09-9350-ca29d3d8d274 tempest-ProjectMemberTests-1145856324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:22 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-12656f44-553d-4e09-9350-ca29d3d8d274 tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78a2f111-f73b-40fa-af57-b3474e440c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-710aebf5-4038-48dd-aac2-83c7580c871d', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:22 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-12656f44-553d-4e09-9350-ca29d3d8d274 tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (817781f9-5e3c-43bc-a05b-be92a051f602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:22 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-12656f44-553d-4e09-9350-ca29d3d8d274 tempest-ProjectMemberTests-1145856324 None] Volume volume-710aebf5-4038-48dd-aac2-83c7580c871d (710aebf5-4038-48dd-aac2-83c7580c871d): created successfully Jul 30 17:10:22 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-12656f44-553d-4e09-9350-ca29d3d8d274 tempest-ProjectMemberTests-1145856324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (817781f9-5e3c-43bc-a05b-be92a051f602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:22 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-12656f44-553d-4e09-9350-ca29d3d8d274 tempest-ProjectMemberTests-1145856324 None] Flow 'volume_create_manager' (93142ab6-6d95-49dc-9968-f0e8739defbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:10:22 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-12656f44-553d-4e09-9350-ca29d3d8d274 tempest-ProjectMemberTests-1145856324 None] Created volume successfully. Jul 30 17:10:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-36d6afce-a917-4e29-a97e-d2e13e8e30e3 tempest-ProjectMemberTests-1145856324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-36d6afce-a917-4e29-a97e-d2e13e8e30e3 tempest-ProjectMemberTests-1145856324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:22 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-36d6afce-a917-4e29-a97e-d2e13e8e30e3 tempest-ProjectMemberTests-1145856324 None] Creating offline snapshot 53d364a7-bbc3-4eb7-bdea-137599a0f43d of volume 710aebf5-4038-48dd-aac2-83c7580c871d {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:10:22 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71f70e5-5923-4e71-ba0d-59cd6ca6593d]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-36d6afce-a917-4e29-a97e-d2e13e8e30e3 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-710aebf5-4038-48dd-aac2-83c7580c871d {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:23 devstack sudo[109459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-710aebf5-4038-48dd-aac2-83c7580c871d Jul 30 17:10:23 devstack sudo[109459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:23 devstack sudo[109459]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-36d6afce-a917-4e29-a97e-d2e13e8e30e3 tempest-ProjectMemberTests-1145856324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-710aebf5-4038-48dd-aac2-83c7580c871d" returned: 0 in 0.432s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-36d6afce-a917-4e29-a97e-d2e13e8e30e3 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-710aebf5-4038-48dd-aac2-83c7580c871d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-710aebf5-4038-48dd-aac2-83c7580c871d.53d364a7-bbc3-4eb7-bdea-137599a0f43d 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:23 devstack sudo[109464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-710aebf5-4038-48dd-aac2-83c7580c871d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-710aebf5-4038-48dd-aac2-83c7580c871d.53d364a7-bbc3-4eb7-bdea-137599a0f43d 1G Jul 30 17:10:23 devstack sudo[109464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:23 devstack sudo[109464]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-36d6afce-a917-4e29-a97e-d2e13e8e30e3 tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-710aebf5-4038-48dd-aac2-83c7580c871d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-710aebf5-4038-48dd-aac2-83c7580c871d.53d364a7-bbc3-4eb7-bdea-137599a0f43d 1G" returned: 0 in 0.418s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:23 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-36d6afce-a917-4e29-a97e-d2e13e8e30e3 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-710aebf5-4038-48dd-aac2-83c7580c871d -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-710aebf5-4038-48dd-aac2-83c7580c871d.53d364a7-bbc3-4eb7-bdea-137599a0f43d {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:23 devstack sudo[109471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-710aebf5-4038-48dd-aac2-83c7580c871d -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-710aebf5-4038-48dd-aac2-83c7580c871d.53d364a7-bbc3-4eb7-bdea-137599a0f43d Jul 30 17:10:23 devstack sudo[109471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:24 devstack sudo[109471]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-36d6afce-a917-4e29-a97e-d2e13e8e30e3 tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-710aebf5-4038-48dd-aac2-83c7580c871d -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-710aebf5-4038-48dd-aac2-83c7580c871d.53d364a7-bbc3-4eb7-bdea-137599a0f43d" returned: 0 in 0.288s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:24 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-36d6afce-a917-4e29-a97e-d2e13e8e30e3 tempest-ProjectMemberTests-1145856324 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-710aebf5-4038-48dd-aac2-83c7580c871d.53d364a7-bbc3-4eb7-bdea-137599a0f43d is being set with open permissions: ugo+rw Jul 30 17:10:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-36d6afce-a917-4e29-a97e-d2e13e8e30e3 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-710aebf5-4038-48dd-aac2-83c7580c871d.53d364a7-bbc3-4eb7-bdea-137599a0f43d {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:24 devstack sudo[109476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-710aebf5-4038-48dd-aac2-83c7580c871d.53d364a7-bbc3-4eb7-bdea-137599a0f43d Jul 30 17:10:24 devstack sudo[109476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:24 devstack sudo[109476]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-36d6afce-a917-4e29-a97e-d2e13e8e30e3 tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-710aebf5-4038-48dd-aac2-83c7580c871d.53d364a7-bbc3-4eb7-bdea-137599a0f43d" returned: 0 in 0.235s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-36d6afce-a917-4e29-a97e-d2e13e8e30e3 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-710aebf5-4038-48dd-aac2-83c7580c871d.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:24 devstack sudo[109480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-710aebf5-4038-48dd-aac2-83c7580c871d.info Jul 30 17:10:24 devstack sudo[109480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:24 devstack sudo[109480]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-36d6afce-a917-4e29-a97e-d2e13e8e30e3 tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-710aebf5-4038-48dd-aac2-83c7580c871d.info" returned: 0 in 0.251s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:24 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-36d6afce-a917-4e29-a97e-d2e13e8e30e3 tempest-ProjectMemberTests-1145856324 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-710aebf5-4038-48dd-aac2-83c7580c871d.info is being set with open permissions: ugo+rw Jul 30 17:10:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-36d6afce-a917-4e29-a97e-d2e13e8e30e3 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-710aebf5-4038-48dd-aac2-83c7580c871d.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:24 devstack sudo[109484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-710aebf5-4038-48dd-aac2-83c7580c871d.info Jul 30 17:10:24 devstack sudo[109484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:24 devstack sudo[109484]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-36d6afce-a917-4e29-a97e-d2e13e8e30e3 tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-710aebf5-4038-48dd-aac2-83c7580c871d.info" returned: 0 in 0.238s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:24 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-36d6afce-a917-4e29-a97e-d2e13e8e30e3 tempest-ProjectMemberTests-1145856324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.951s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:24 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-36d6afce-a917-4e29-a97e-d2e13e8e30e3 tempest-ProjectMemberTests-1145856324 None] Create snapshot completed successfully Jul 30 17:10:25 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-552bbb23-9eb6-4b36-a375-df3567486d93 tempest-ProjectMemberTests-1145856324 None] Acquiring lock "cinder-53d364a7-bbc3-4eb7-bdea-137599a0f43d-delete_snapshot" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:25 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-552bbb23-9eb6-4b36-a375-df3567486d93 tempest-ProjectMemberTests-1145856324 None] Lock "cinder-53d364a7-bbc3-4eb7-bdea-137599a0f43d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:25 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-552bbb23-9eb6-4b36-a375-df3567486d93 tempest-ProjectMemberTests-1145856324 None] Acquiring lock "cinder-quobyte-710aebf5-4038-48dd-aac2-83c7580c871d" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:25 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-552bbb23-9eb6-4b36-a375-df3567486d93 tempest-ProjectMemberTests-1145856324 None] Lock "cinder-quobyte-710aebf5-4038-48dd-aac2-83c7580c871d" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:25 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-552bbb23-9eb6-4b36-a375-df3567486d93 tempest-ProjectMemberTests-1145856324 None] Acquiring lock "cinder-quobyte-53d364a7-bbc3-4eb7-bdea-137599a0f43d" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:25 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-552bbb23-9eb6-4b36-a375-df3567486d93 tempest-ProjectMemberTests-1145856324 None] Lock "cinder-quobyte-53d364a7-bbc3-4eb7-bdea-137599a0f43d" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:25 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-552bbb23-9eb6-4b36-a375-df3567486d93 tempest-ProjectMemberTests-1145856324 None] Deleting offline snapshot 53d364a7-bbc3-4eb7-bdea-137599a0f43d of volume 710aebf5-4038-48dd-aac2-83c7580c871d {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:10:25 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-552bbb23-9eb6-4b36-a375-df3567486d93 tempest-ProjectMemberTests-1145856324 None] snapshot_file for this snap is: volume-710aebf5-4038-48dd-aac2-83c7580c871d.53d364a7-bbc3-4eb7-bdea-137599a0f43d {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:10:25 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e6e7b7-117a-4c20-80a9-774087d1c5e9]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-552bbb23-9eb6-4b36-a375-df3567486d93 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-710aebf5-4038-48dd-aac2-83c7580c871d.53d364a7-bbc3-4eb7-bdea-137599a0f43d {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:25 devstack sudo[109487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-710aebf5-4038-48dd-aac2-83c7580c871d.53d364a7-bbc3-4eb7-bdea-137599a0f43d Jul 30 17:10:25 devstack sudo[109487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:25 devstack sudo[109487]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-552bbb23-9eb6-4b36-a375-df3567486d93 tempest-ProjectMemberTests-1145856324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-710aebf5-4038-48dd-aac2-83c7580c871d.53d364a7-bbc3-4eb7-bdea-137599a0f43d" returned: 0 in 0.347s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:25 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-552bbb23-9eb6-4b36-a375-df3567486d93 tempest-ProjectMemberTests-1145856324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-710aebf5-4038-48dd-aac2-83c7580c871d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:10:25 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[d641b116-56db-49c8-9dee-06af2b1ca5cd]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-552bbb23-9eb6-4b36-a375-df3567486d93 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-710aebf5-4038-48dd-aac2-83c7580c871d {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:25 devstack sudo[109492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-710aebf5-4038-48dd-aac2-83c7580c871d Jul 30 17:10:25 devstack sudo[109492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:25 devstack sudo[109492]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-552bbb23-9eb6-4b36-a375-df3567486d93 tempest-ProjectMemberTests-1145856324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-710aebf5-4038-48dd-aac2-83c7580c871d" returned: 0 in 0.348s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:25 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-552bbb23-9eb6-4b36-a375-df3567486d93 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-710aebf5-4038-48dd-aac2-83c7580c871d.53d364a7-bbc3-4eb7-bdea-137599a0f43d {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:25 devstack sudo[109497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-710aebf5-4038-48dd-aac2-83c7580c871d.53d364a7-bbc3-4eb7-bdea-137599a0f43d Jul 30 17:10:25 devstack sudo[109497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:26 devstack sudo[109497]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-552bbb23-9eb6-4b36-a375-df3567486d93 tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-710aebf5-4038-48dd-aac2-83c7580c871d.53d364a7-bbc3-4eb7-bdea-137599a0f43d" returned: 0 in 0.337s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-552bbb23-9eb6-4b36-a375-df3567486d93 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-710aebf5-4038-48dd-aac2-83c7580c871d.53d364a7-bbc3-4eb7-bdea-137599a0f43d {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:26 devstack sudo[109502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-710aebf5-4038-48dd-aac2-83c7580c871d.53d364a7-bbc3-4eb7-bdea-137599a0f43d Jul 30 17:10:26 devstack sudo[109502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:26 devstack sudo[109502]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:26 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-552bbb23-9eb6-4b36-a375-df3567486d93 tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-710aebf5-4038-48dd-aac2-83c7580c871d.53d364a7-bbc3-4eb7-bdea-137599a0f43d" returned: 0 in 0.239s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:26 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-552bbb23-9eb6-4b36-a375-df3567486d93 tempest-ProjectMemberTests-1145856324 None] Lock "cinder-quobyte-53d364a7-bbc3-4eb7-bdea-137599a0f43d" released by "_delete_snapshot" :: held 1.356s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:26 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-552bbb23-9eb6-4b36-a375-df3567486d93 tempest-ProjectMemberTests-1145856324 None] Lock "cinder-quobyte-710aebf5-4038-48dd-aac2-83c7580c871d" released by "delete_snapshot" :: held 1.375s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:26 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-552bbb23-9eb6-4b36-a375-df3567486d93 tempest-ProjectMemberTests-1145856324 None] Created reservations ['58ca6284-66f8-4716-8d90-79136c5b8e5e', '69688f96-81c3-4182-845d-d411a2d358b3', '7a7edbf6-1e93-4ced-8af1-e2aaf3273615', 'a139968c-bdc4-4a1a-936a-766ef83ff1db'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:10:26 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-552bbb23-9eb6-4b36-a375-df3567486d93 tempest-ProjectMemberTests-1145856324 None] Delete snapshot completed successfully. Jul 30 17:10:26 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-552bbb23-9eb6-4b36-a375-df3567486d93 tempest-ProjectMemberTests-1145856324 None] Lock "cinder-53d364a7-bbc3-4eb7-bdea-137599a0f43d-delete_snapshot" released by "delete_snapshot" :: held 1.506s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:27 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-1fddb4af-84e9-4958-8630-6bf0468dd942 tempest-ProjectMemberTests-1145856324 None] Acquiring lock "cinder-710aebf5-4038-48dd-aac2-83c7580c871d-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:27 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-1fddb4af-84e9-4958-8630-6bf0468dd942 tempest-ProjectMemberTests-1145856324 None] Lock "cinder-710aebf5-4038-48dd-aac2-83c7580c871d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:27 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-1fddb4af-84e9-4958-8630-6bf0468dd942 tempest-ProjectMemberTests-1145856324 None] Acquiring lock "cinder-quobyte-710aebf5-4038-48dd-aac2-83c7580c871d" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:27 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-1fddb4af-84e9-4958-8630-6bf0468dd942 tempest-ProjectMemberTests-1145856324 None] Lock "cinder-quobyte-710aebf5-4038-48dd-aac2-83c7580c871d" acquired by "delete_volume" :: waited 0.013s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:27 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[29edff89-1d5e-40a3-af50-d91e10b987e6]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1fddb4af-84e9-4958-8630-6bf0468dd942 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-710aebf5-4038-48dd-aac2-83c7580c871d {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:27 devstack sudo[109505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-710aebf5-4038-48dd-aac2-83c7580c871d Jul 30 17:10:27 devstack sudo[109505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:27 devstack sudo[109505]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1fddb4af-84e9-4958-8630-6bf0468dd942 tempest-ProjectMemberTests-1145856324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-710aebf5-4038-48dd-aac2-83c7580c871d" returned: 0 in 0.344s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:27 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1fddb4af-84e9-4958-8630-6bf0468dd942 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-710aebf5-4038-48dd-aac2-83c7580c871d {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:27 devstack sudo[109510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-710aebf5-4038-48dd-aac2-83c7580c871d Jul 30 17:10:27 devstack sudo[109510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:28 devstack sudo[109510]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1fddb4af-84e9-4958-8630-6bf0468dd942 tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-710aebf5-4038-48dd-aac2-83c7580c871d" returned: 0 in 0.242s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:28 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-1fddb4af-84e9-4958-8630-6bf0468dd942 tempest-ProjectMemberTests-1145856324 None] Lock "cinder-quobyte-710aebf5-4038-48dd-aac2-83c7580c871d" released by "delete_volume" :: held 0.637s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:28 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-1fddb4af-84e9-4958-8630-6bf0468dd942 tempest-ProjectMemberTests-1145856324 None] Created reservations ['39d8548d-4171-4381-ab7e-d59d8c806323', 'd39fa23c-3d27-491e-8a19-cd88ccd8270d', '4206344f-62c3-4a02-be95-dd77addac518', '496a5560-0ff9-4503-89e0-2dd45bfd2a59'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:10:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1fddb4af-84e9-4958-8630-6bf0468dd942 tempest-ProjectMemberTests-1145856324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1fddb4af-84e9-4958-8630-6bf0468dd942 tempest-ProjectMemberTests-1145856324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:28 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-1fddb4af-84e9-4958-8630-6bf0468dd942 tempest-ProjectMemberTests-1145856324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:28 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-1fddb4af-84e9-4958-8630-6bf0468dd942 tempest-ProjectMemberTests-1145856324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1fddb4af-84e9-4958-8630-6bf0468dd942 tempest-ProjectMemberTests-1145856324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1fddb4af-84e9-4958-8630-6bf0468dd942 tempest-ProjectMemberTests-1145856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:28 devstack sudo[109513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:10:28 devstack sudo[109513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:28 devstack sudo[109513]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:28 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1fddb4af-84e9-4958-8630-6bf0468dd942 tempest-ProjectMemberTests-1145856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.247s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:28 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-1fddb4af-84e9-4958-8630-6bf0468dd942 tempest-ProjectMemberTests-1145856324 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:10:28 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-1fddb4af-84e9-4958-8630-6bf0468dd942 tempest-ProjectMemberTests-1145856324 None] Deleted volume successfully. Jul 30 17:10:28 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-1fddb4af-84e9-4958-8630-6bf0468dd942 tempest-ProjectMemberTests-1145856324 None] Lock "cinder-710aebf5-4038-48dd-aac2-83c7580c871d-delete_volume" released by "delete_volume" :: held 1.084s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:32 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-254335da-92af-4b92-9f28-464843099248 tempest-ProjectReaderTests-1606856988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:10:32 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-254335da-92af-4b92-9f28-464843099248 tempest-ProjectReaderTests-1606856988 None] Flow 'volume_create_manager' (6102271c-7aac-49ff-8213-278a3027a10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:10:32 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-254335da-92af-4b92-9f28-464843099248 tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4790c0c0-557b-488f-97c9-145c9e6fcb50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:32 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-254335da-92af-4b92-9f28-464843099248 tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4790c0c0-557b-488f-97c9-145c9e6fcb50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-134895106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c619dd77-bc5d-4535-8c74-39c52e0fae52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f482a6a4b7864a8285af84b12a4c0ba7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:10:32Z,use_quota=True,user_id='6e6b52d8637b4f35b11882b9c0ef86cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:32 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-254335da-92af-4b92-9f28-464843099248 tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feb47012-2f02-4c26-aa23-62684788d465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:32 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-254335da-92af-4b92-9f28-464843099248 tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feb47012-2f02-4c26-aa23-62684788d465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:32 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-254335da-92af-4b92-9f28-464843099248 tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (911947a7-38cb-42c5-ac03-1979a817521c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:32 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-254335da-92af-4b92-9f28-464843099248 tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (911947a7-38cb-42c5-ac03-1979a817521c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c619dd77-bc5d-4535-8c74-39c52e0fae52', 'volume_name': 'volume-c619dd77-bc5d-4535-8c74-39c52e0fae52', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:32 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-254335da-92af-4b92-9f28-464843099248 tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08b29d64-39d9-4cf1-9485-9debb2107ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:32 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-254335da-92af-4b92-9f28-464843099248 tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08b29d64-39d9-4cf1-9485-9debb2107ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:32 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-254335da-92af-4b92-9f28-464843099248 tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a42c6ea0-9db4-428f-adb3-b43643ae8aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:32 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-254335da-92af-4b92-9f28-464843099248 tempest-ProjectReaderTests-1606856988 None] Volume c619dd77-bc5d-4535-8c74-39c52e0fae52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c619dd77-bc5d-4535-8c74-39c52e0fae52', 'volume_size': 1} Jul 30 17:10:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-254335da-92af-4b92-9f28-464843099248 tempest-ProjectReaderTests-1606856988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-254335da-92af-4b92-9f28-464843099248 tempest-ProjectReaderTests-1606856988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:32 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-254335da-92af-4b92-9f28-464843099248 tempest-ProjectReaderTests-1606856988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-134895106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c619dd77-bc5d-4535-8c74-39c52e0fae52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f482a6a4b7864a8285af84b12a4c0ba7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:10:32Z,use_quota=True,user_id='6e6b52d8637b4f35b11882b9c0ef86cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:10:32 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-254335da-92af-4b92-9f28-464843099248 tempest-ProjectReaderTests-1606856988 None] Creating volume c619dd77-bc5d-4535-8c74-39c52e0fae52 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:10:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-254335da-92af-4b92-9f28-464843099248 tempest-ProjectReaderTests-1606856988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-254335da-92af-4b92-9f28-464843099248 tempest-ProjectReaderTests-1606856988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:32 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-254335da-92af-4b92-9f28-464843099248 tempest-ProjectReaderTests-1606856988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:32 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-254335da-92af-4b92-9f28-464843099248 tempest-ProjectReaderTests-1606856988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-254335da-92af-4b92-9f28-464843099248 tempest-ProjectReaderTests-1606856988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:32 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-254335da-92af-4b92-9f28-464843099248 tempest-ProjectReaderTests-1606856988 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:10:32 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-254335da-92af-4b92-9f28-464843099248 tempest-ProjectReaderTests-1606856988 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:10:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-254335da-92af-4b92-9f28-464843099248 tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c619dd77-bc5d-4535-8c74-39c52e0fae52 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:32 devstack sudo[109516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c619dd77-bc5d-4535-8c74-39c52e0fae52 1073741824 Jul 30 17:10:32 devstack sudo[109516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:32 devstack sudo[109516]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-254335da-92af-4b92-9f28-464843099248 tempest-ProjectReaderTests-1606856988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c619dd77-bc5d-4535-8c74-39c52e0fae52 1073741824" returned: 0 in 0.411s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-254335da-92af-4b92-9f28-464843099248 tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c619dd77-bc5d-4535-8c74-39c52e0fae52 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:32 devstack sudo[109522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c619dd77-bc5d-4535-8c74-39c52e0fae52 Jul 30 17:10:32 devstack sudo[109522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:32 devstack sudo[109522]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-254335da-92af-4b92-9f28-464843099248 tempest-ProjectReaderTests-1606856988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c619dd77-bc5d-4535-8c74-39c52e0fae52" returned: 0 in 0.244s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:32 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-254335da-92af-4b92-9f28-464843099248 tempest-ProjectReaderTests-1606856988 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:10:32 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-254335da-92af-4b92-9f28-464843099248 tempest-ProjectReaderTests-1606856988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:32 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-254335da-92af-4b92-9f28-464843099248 tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a42c6ea0-9db4-428f-adb3-b43643ae8aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c619dd77-bc5d-4535-8c74-39c52e0fae52', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:32 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-254335da-92af-4b92-9f28-464843099248 tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c05357c-d38d-45ef-ba6e-13104acce207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:32 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-254335da-92af-4b92-9f28-464843099248 tempest-ProjectReaderTests-1606856988 None] Volume volume-c619dd77-bc5d-4535-8c74-39c52e0fae52 (c619dd77-bc5d-4535-8c74-39c52e0fae52): created successfully Jul 30 17:10:32 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-254335da-92af-4b92-9f28-464843099248 tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c05357c-d38d-45ef-ba6e-13104acce207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:32 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-254335da-92af-4b92-9f28-464843099248 tempest-ProjectReaderTests-1606856988 None] Flow 'volume_create_manager' (6102271c-7aac-49ff-8213-278a3027a10f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:10:32 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-254335da-92af-4b92-9f28-464843099248 tempest-ProjectReaderTests-1606856988 None] Created volume successfully. Jul 30 17:10:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-03549478-6056-4b1b-8cb9-01ccf6a17dcb tempest-ProjectReaderTests-1606856988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-03549478-6056-4b1b-8cb9-01ccf6a17dcb tempest-ProjectReaderTests-1606856988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:33 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-03549478-6056-4b1b-8cb9-01ccf6a17dcb tempest-ProjectReaderTests-1606856988 None] Creating offline snapshot bd4eecb3-9d17-43b8-9f73-7f3753d819d5 of volume c619dd77-bc5d-4535-8c74-39c52e0fae52 {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:10:33 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ba5315-54e9-4372-8ad0-65d0d520d55b]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-03549478-6056-4b1b-8cb9-01ccf6a17dcb tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c619dd77-bc5d-4535-8c74-39c52e0fae52 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:33 devstack sudo[109525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c619dd77-bc5d-4535-8c74-39c52e0fae52 Jul 30 17:10:33 devstack sudo[109525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:33 devstack sudo[109525]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-03549478-6056-4b1b-8cb9-01ccf6a17dcb tempest-ProjectReaderTests-1606856988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c619dd77-bc5d-4535-8c74-39c52e0fae52" returned: 0 in 0.346s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:33 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-03549478-6056-4b1b-8cb9-01ccf6a17dcb tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c619dd77-bc5d-4535-8c74-39c52e0fae52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c619dd77-bc5d-4535-8c74-39c52e0fae52.bd4eecb3-9d17-43b8-9f73-7f3753d819d5 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:33 devstack sudo[109530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c619dd77-bc5d-4535-8c74-39c52e0fae52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c619dd77-bc5d-4535-8c74-39c52e0fae52.bd4eecb3-9d17-43b8-9f73-7f3753d819d5 1G Jul 30 17:10:33 devstack sudo[109530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:34 devstack sudo[109530]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-03549478-6056-4b1b-8cb9-01ccf6a17dcb tempest-ProjectReaderTests-1606856988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c619dd77-bc5d-4535-8c74-39c52e0fae52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c619dd77-bc5d-4535-8c74-39c52e0fae52.bd4eecb3-9d17-43b8-9f73-7f3753d819d5 1G" returned: 0 in 0.400s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-03549478-6056-4b1b-8cb9-01ccf6a17dcb tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c619dd77-bc5d-4535-8c74-39c52e0fae52 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c619dd77-bc5d-4535-8c74-39c52e0fae52.bd4eecb3-9d17-43b8-9f73-7f3753d819d5 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:34 devstack sudo[109536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c619dd77-bc5d-4535-8c74-39c52e0fae52 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c619dd77-bc5d-4535-8c74-39c52e0fae52.bd4eecb3-9d17-43b8-9f73-7f3753d819d5 Jul 30 17:10:34 devstack sudo[109536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:34 devstack sudo[109536]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-03549478-6056-4b1b-8cb9-01ccf6a17dcb tempest-ProjectReaderTests-1606856988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c619dd77-bc5d-4535-8c74-39c52e0fae52 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c619dd77-bc5d-4535-8c74-39c52e0fae52.bd4eecb3-9d17-43b8-9f73-7f3753d819d5" returned: 0 in 0.280s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:34 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-03549478-6056-4b1b-8cb9-01ccf6a17dcb tempest-ProjectReaderTests-1606856988 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c619dd77-bc5d-4535-8c74-39c52e0fae52.bd4eecb3-9d17-43b8-9f73-7f3753d819d5 is being set with open permissions: ugo+rw Jul 30 17:10:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-03549478-6056-4b1b-8cb9-01ccf6a17dcb tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c619dd77-bc5d-4535-8c74-39c52e0fae52.bd4eecb3-9d17-43b8-9f73-7f3753d819d5 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:34 devstack sudo[109541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c619dd77-bc5d-4535-8c74-39c52e0fae52.bd4eecb3-9d17-43b8-9f73-7f3753d819d5 Jul 30 17:10:34 devstack sudo[109541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:34 devstack sudo[109541]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-03549478-6056-4b1b-8cb9-01ccf6a17dcb tempest-ProjectReaderTests-1606856988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c619dd77-bc5d-4535-8c74-39c52e0fae52.bd4eecb3-9d17-43b8-9f73-7f3753d819d5" returned: 0 in 0.238s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-03549478-6056-4b1b-8cb9-01ccf6a17dcb tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c619dd77-bc5d-4535-8c74-39c52e0fae52.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:34 devstack sudo[109544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c619dd77-bc5d-4535-8c74-39c52e0fae52.info Jul 30 17:10:34 devstack sudo[109544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:34 devstack sudo[109544]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-03549478-6056-4b1b-8cb9-01ccf6a17dcb tempest-ProjectReaderTests-1606856988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c619dd77-bc5d-4535-8c74-39c52e0fae52.info" returned: 0 in 0.240s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:34 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-03549478-6056-4b1b-8cb9-01ccf6a17dcb tempest-ProjectReaderTests-1606856988 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c619dd77-bc5d-4535-8c74-39c52e0fae52.info is being set with open permissions: ugo+rw Jul 30 17:10:34 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-03549478-6056-4b1b-8cb9-01ccf6a17dcb tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c619dd77-bc5d-4535-8c74-39c52e0fae52.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:34 devstack sudo[109547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c619dd77-bc5d-4535-8c74-39c52e0fae52.info Jul 30 17:10:34 devstack sudo[109547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:35 devstack sudo[109547]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-03549478-6056-4b1b-8cb9-01ccf6a17dcb tempest-ProjectReaderTests-1606856988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c619dd77-bc5d-4535-8c74-39c52e0fae52.info" returned: 0 in 0.242s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-03549478-6056-4b1b-8cb9-01ccf6a17dcb tempest-ProjectReaderTests-1606856988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.828s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:35 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-03549478-6056-4b1b-8cb9-01ccf6a17dcb tempest-ProjectReaderTests-1606856988 None] Create snapshot completed successfully Jul 30 17:10:35 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-acb38bc2-7533-4165-9b8a-8d202c291918 tempest-ProjectReaderTests-1606856988 None] Acquiring lock "cinder-bd4eecb3-9d17-43b8-9f73-7f3753d819d5-delete_snapshot" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:35 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-acb38bc2-7533-4165-9b8a-8d202c291918 tempest-ProjectReaderTests-1606856988 None] Lock "cinder-bd4eecb3-9d17-43b8-9f73-7f3753d819d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:35 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-acb38bc2-7533-4165-9b8a-8d202c291918 tempest-ProjectReaderTests-1606856988 None] Acquiring lock "cinder-quobyte-c619dd77-bc5d-4535-8c74-39c52e0fae52" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:35 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-acb38bc2-7533-4165-9b8a-8d202c291918 tempest-ProjectReaderTests-1606856988 None] Lock "cinder-quobyte-c619dd77-bc5d-4535-8c74-39c52e0fae52" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:35 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-acb38bc2-7533-4165-9b8a-8d202c291918 tempest-ProjectReaderTests-1606856988 None] Acquiring lock "cinder-quobyte-bd4eecb3-9d17-43b8-9f73-7f3753d819d5" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:35 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-acb38bc2-7533-4165-9b8a-8d202c291918 tempest-ProjectReaderTests-1606856988 None] Lock "cinder-quobyte-bd4eecb3-9d17-43b8-9f73-7f3753d819d5" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:35 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-acb38bc2-7533-4165-9b8a-8d202c291918 tempest-ProjectReaderTests-1606856988 None] Deleting offline snapshot bd4eecb3-9d17-43b8-9f73-7f3753d819d5 of volume c619dd77-bc5d-4535-8c74-39c52e0fae52 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:10:35 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-acb38bc2-7533-4165-9b8a-8d202c291918 tempest-ProjectReaderTests-1606856988 None] snapshot_file for this snap is: volume-c619dd77-bc5d-4535-8c74-39c52e0fae52.bd4eecb3-9d17-43b8-9f73-7f3753d819d5 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:10:35 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d09d890-ce97-48af-b9c3-5a04590dacb7]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-acb38bc2-7533-4165-9b8a-8d202c291918 tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c619dd77-bc5d-4535-8c74-39c52e0fae52.bd4eecb3-9d17-43b8-9f73-7f3753d819d5 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:35 devstack sudo[109550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c619dd77-bc5d-4535-8c74-39c52e0fae52.bd4eecb3-9d17-43b8-9f73-7f3753d819d5 Jul 30 17:10:35 devstack sudo[109550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:35 devstack sudo[109550]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-acb38bc2-7533-4165-9b8a-8d202c291918 tempest-ProjectReaderTests-1606856988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c619dd77-bc5d-4535-8c74-39c52e0fae52.bd4eecb3-9d17-43b8-9f73-7f3753d819d5" returned: 0 in 0.351s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:35 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-acb38bc2-7533-4165-9b8a-8d202c291918 tempest-ProjectReaderTests-1606856988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c619dd77-bc5d-4535-8c74-39c52e0fae52(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:10:35 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b881041-72c0-47c2-a276-3a4124674a3c]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-acb38bc2-7533-4165-9b8a-8d202c291918 tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c619dd77-bc5d-4535-8c74-39c52e0fae52 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:36 devstack sudo[109555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c619dd77-bc5d-4535-8c74-39c52e0fae52 Jul 30 17:10:36 devstack sudo[109555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:36 devstack sudo[109555]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-acb38bc2-7533-4165-9b8a-8d202c291918 tempest-ProjectReaderTests-1606856988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c619dd77-bc5d-4535-8c74-39c52e0fae52" returned: 0 in 0.349s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-acb38bc2-7533-4165-9b8a-8d202c291918 tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c619dd77-bc5d-4535-8c74-39c52e0fae52.bd4eecb3-9d17-43b8-9f73-7f3753d819d5 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:36 devstack sudo[109560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c619dd77-bc5d-4535-8c74-39c52e0fae52.bd4eecb3-9d17-43b8-9f73-7f3753d819d5 Jul 30 17:10:36 devstack sudo[109560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:36 devstack sudo[109560]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-acb38bc2-7533-4165-9b8a-8d202c291918 tempest-ProjectReaderTests-1606856988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c619dd77-bc5d-4535-8c74-39c52e0fae52.bd4eecb3-9d17-43b8-9f73-7f3753d819d5" returned: 0 in 0.332s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-acb38bc2-7533-4165-9b8a-8d202c291918 tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c619dd77-bc5d-4535-8c74-39c52e0fae52.bd4eecb3-9d17-43b8-9f73-7f3753d819d5 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:36 devstack sudo[109565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c619dd77-bc5d-4535-8c74-39c52e0fae52.bd4eecb3-9d17-43b8-9f73-7f3753d819d5 Jul 30 17:10:36 devstack sudo[109565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:36 devstack sudo[109565]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-acb38bc2-7533-4165-9b8a-8d202c291918 tempest-ProjectReaderTests-1606856988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c619dd77-bc5d-4535-8c74-39c52e0fae52.bd4eecb3-9d17-43b8-9f73-7f3753d819d5" returned: 0 in 0.243s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:36 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-acb38bc2-7533-4165-9b8a-8d202c291918 tempest-ProjectReaderTests-1606856988 None] Lock "cinder-quobyte-bd4eecb3-9d17-43b8-9f73-7f3753d819d5" released by "_delete_snapshot" :: held 1.362s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:36 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-acb38bc2-7533-4165-9b8a-8d202c291918 tempest-ProjectReaderTests-1606856988 None] Lock "cinder-quobyte-c619dd77-bc5d-4535-8c74-39c52e0fae52" released by "delete_snapshot" :: held 1.382s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:36 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-acb38bc2-7533-4165-9b8a-8d202c291918 tempest-ProjectReaderTests-1606856988 None] Created reservations ['d30afef3-ba8a-4ba4-adb5-21ef7fa2c14b', '76013221-b5cf-40ef-b1f4-68b31c271d27', '45100200-31ae-4341-8ddf-6cdbcf200f30', '63db8004-e8b2-405e-85f1-4d145c1792ad'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:10:37 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-acb38bc2-7533-4165-9b8a-8d202c291918 tempest-ProjectReaderTests-1606856988 None] Delete snapshot completed successfully. Jul 30 17:10:37 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-acb38bc2-7533-4165-9b8a-8d202c291918 tempest-ProjectReaderTests-1606856988 None] Lock "cinder-bd4eecb3-9d17-43b8-9f73-7f3753d819d5-delete_snapshot" released by "delete_snapshot" :: held 1.527s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:37 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d95d0f1b-33d1-48c0-a12e-cf07c06a6c3b tempest-ProjectReaderTests-1606856988 None] Acquiring lock "cinder-c619dd77-bc5d-4535-8c74-39c52e0fae52-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:37 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d95d0f1b-33d1-48c0-a12e-cf07c06a6c3b tempest-ProjectReaderTests-1606856988 None] Lock "cinder-c619dd77-bc5d-4535-8c74-39c52e0fae52-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:37 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d95d0f1b-33d1-48c0-a12e-cf07c06a6c3b tempest-ProjectReaderTests-1606856988 None] Acquiring lock "cinder-quobyte-c619dd77-bc5d-4535-8c74-39c52e0fae52" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:37 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d95d0f1b-33d1-48c0-a12e-cf07c06a6c3b tempest-ProjectReaderTests-1606856988 None] Lock "cinder-quobyte-c619dd77-bc5d-4535-8c74-39c52e0fae52" acquired by "delete_volume" :: waited 0.013s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:37 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5bc8e3-6748-4e0e-80cf-6c867da75236]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d95d0f1b-33d1-48c0-a12e-cf07c06a6c3b tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c619dd77-bc5d-4535-8c74-39c52e0fae52 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:37 devstack sudo[109568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c619dd77-bc5d-4535-8c74-39c52e0fae52 Jul 30 17:10:37 devstack sudo[109568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:38 devstack sudo[109568]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d95d0f1b-33d1-48c0-a12e-cf07c06a6c3b tempest-ProjectReaderTests-1606856988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c619dd77-bc5d-4535-8c74-39c52e0fae52" returned: 0 in 0.369s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d95d0f1b-33d1-48c0-a12e-cf07c06a6c3b tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c619dd77-bc5d-4535-8c74-39c52e0fae52 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:38 devstack sudo[109573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c619dd77-bc5d-4535-8c74-39c52e0fae52 Jul 30 17:10:38 devstack sudo[109573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:38 devstack sudo[109573]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d95d0f1b-33d1-48c0-a12e-cf07c06a6c3b tempest-ProjectReaderTests-1606856988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c619dd77-bc5d-4535-8c74-39c52e0fae52" returned: 0 in 0.244s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:38 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d95d0f1b-33d1-48c0-a12e-cf07c06a6c3b tempest-ProjectReaderTests-1606856988 None] Lock "cinder-quobyte-c619dd77-bc5d-4535-8c74-39c52e0fae52" released by "delete_volume" :: held 0.666s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:38 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-d95d0f1b-33d1-48c0-a12e-cf07c06a6c3b tempest-ProjectReaderTests-1606856988 None] Created reservations ['877736cd-09a6-4cda-a53b-3561f3db24ed', '2c9ba71f-f97b-4d16-9e47-96f23eeb07c1', 'd7f9431d-2cda-42bd-92dd-701d2a47916e', '5704bd25-f613-4da0-bbaf-67735324588c'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:10:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d95d0f1b-33d1-48c0-a12e-cf07c06a6c3b tempest-ProjectReaderTests-1606856988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d95d0f1b-33d1-48c0-a12e-cf07c06a6c3b tempest-ProjectReaderTests-1606856988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:38 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d95d0f1b-33d1-48c0-a12e-cf07c06a6c3b tempest-ProjectReaderTests-1606856988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:38 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d95d0f1b-33d1-48c0-a12e-cf07c06a6c3b tempest-ProjectReaderTests-1606856988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d95d0f1b-33d1-48c0-a12e-cf07c06a6c3b tempest-ProjectReaderTests-1606856988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d95d0f1b-33d1-48c0-a12e-cf07c06a6c3b tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:38 devstack sudo[109576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:10:38 devstack sudo[109576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:38 devstack sudo[109576]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d95d0f1b-33d1-48c0-a12e-cf07c06a6c3b tempest-ProjectReaderTests-1606856988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.254s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:38 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-d95d0f1b-33d1-48c0-a12e-cf07c06a6c3b tempest-ProjectReaderTests-1606856988 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:10:38 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-d95d0f1b-33d1-48c0-a12e-cf07c06a6c3b tempest-ProjectReaderTests-1606856988 None] Deleted volume successfully. Jul 30 17:10:38 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d95d0f1b-33d1-48c0-a12e-cf07c06a6c3b tempest-ProjectReaderTests-1606856988 None] Lock "cinder-c619dd77-bc5d-4535-8c74-39c52e0fae52-delete_volume" released by "delete_volume" :: held 1.104s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:39 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b8018dc-67ad-41dd-8b4a-c3730adb4a30 tempest-ProjectReaderTests-1606856988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:10:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-9b8018dc-67ad-41dd-8b4a-c3730adb4a30 tempest-ProjectReaderTests-1606856988 None] Flow 'volume_create_manager' (044d2a3d-70e7-42b4-9ce5-a94c5c0ebe84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:10:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-9b8018dc-67ad-41dd-8b4a-c3730adb4a30 tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd0f2359-3c18-40fa-b280-d17a087fece2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-9b8018dc-67ad-41dd-8b4a-c3730adb4a30 tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd0f2359-3c18-40fa-b280-d17a087fece2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:10:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-971696027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=086ea88a-df81-45e9-9cd5-5cbea602268d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f482a6a4b7864a8285af84b12a4c0ba7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:10:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:10:39Z,use_quota=True,user_id='6e6b52d8637b4f35b11882b9c0ef86cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-9b8018dc-67ad-41dd-8b4a-c3730adb4a30 tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c1387f6-8fc5-439c-a00b-2264713a38e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-9b8018dc-67ad-41dd-8b4a-c3730adb4a30 tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c1387f6-8fc5-439c-a00b-2264713a38e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-9b8018dc-67ad-41dd-8b4a-c3730adb4a30 tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55249067-d0e8-4e0b-8992-1f1c193e6acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-9b8018dc-67ad-41dd-8b4a-c3730adb4a30 tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55249067-d0e8-4e0b-8992-1f1c193e6acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '086ea88a-df81-45e9-9cd5-5cbea602268d', 'volume_name': 'volume-086ea88a-df81-45e9-9cd5-5cbea602268d', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-9b8018dc-67ad-41dd-8b4a-c3730adb4a30 tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c64b38f5-65f1-422f-a6c2-85465d4217f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-9b8018dc-67ad-41dd-8b4a-c3730adb4a30 tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c64b38f5-65f1-422f-a6c2-85465d4217f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-9b8018dc-67ad-41dd-8b4a-c3730adb4a30 tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a31da98-23c2-455e-b4c8-e460fc9441de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:39 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-9b8018dc-67ad-41dd-8b4a-c3730adb4a30 tempest-ProjectReaderTests-1606856988 None] Volume 086ea88a-df81-45e9-9cd5-5cbea602268d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-086ea88a-df81-45e9-9cd5-5cbea602268d', 'volume_size': 1} Jul 30 17:10:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-9b8018dc-67ad-41dd-8b4a-c3730adb4a30 tempest-ProjectReaderTests-1606856988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-9b8018dc-67ad-41dd-8b4a-c3730adb4a30 tempest-ProjectReaderTests-1606856988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:39 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-9b8018dc-67ad-41dd-8b4a-c3730adb4a30 tempest-ProjectReaderTests-1606856988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:10:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-971696027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=086ea88a-df81-45e9-9cd5-5cbea602268d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f482a6a4b7864a8285af84b12a4c0ba7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:10:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:10:39Z,use_quota=True,user_id='6e6b52d8637b4f35b11882b9c0ef86cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:10:39 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-9b8018dc-67ad-41dd-8b4a-c3730adb4a30 tempest-ProjectReaderTests-1606856988 None] Creating volume 086ea88a-df81-45e9-9cd5-5cbea602268d {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:10:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-9b8018dc-67ad-41dd-8b4a-c3730adb4a30 tempest-ProjectReaderTests-1606856988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-9b8018dc-67ad-41dd-8b4a-c3730adb4a30 tempest-ProjectReaderTests-1606856988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:39 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-9b8018dc-67ad-41dd-8b4a-c3730adb4a30 tempest-ProjectReaderTests-1606856988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:39 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-9b8018dc-67ad-41dd-8b4a-c3730adb4a30 tempest-ProjectReaderTests-1606856988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-9b8018dc-67ad-41dd-8b4a-c3730adb4a30 tempest-ProjectReaderTests-1606856988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:39 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-9b8018dc-67ad-41dd-8b4a-c3730adb4a30 tempest-ProjectReaderTests-1606856988 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:10:39 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-9b8018dc-67ad-41dd-8b4a-c3730adb4a30 tempest-ProjectReaderTests-1606856988 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:10:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9b8018dc-67ad-41dd-8b4a-c3730adb4a30 tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-086ea88a-df81-45e9-9cd5-5cbea602268d 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:39 devstack sudo[109579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-086ea88a-df81-45e9-9cd5-5cbea602268d 1073741824 Jul 30 17:10:39 devstack sudo[109579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:39 devstack sudo[109579]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9b8018dc-67ad-41dd-8b4a-c3730adb4a30 tempest-ProjectReaderTests-1606856988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-086ea88a-df81-45e9-9cd5-5cbea602268d 1073741824" returned: 0 in 0.402s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9b8018dc-67ad-41dd-8b4a-c3730adb4a30 tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-086ea88a-df81-45e9-9cd5-5cbea602268d {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:39 devstack sudo[109585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-086ea88a-df81-45e9-9cd5-5cbea602268d Jul 30 17:10:39 devstack sudo[109585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:39 devstack sudo[109585]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9b8018dc-67ad-41dd-8b4a-c3730adb4a30 tempest-ProjectReaderTests-1606856988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-086ea88a-df81-45e9-9cd5-5cbea602268d" returned: 0 in 0.246s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:39 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-9b8018dc-67ad-41dd-8b4a-c3730adb4a30 tempest-ProjectReaderTests-1606856988 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:10:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-9b8018dc-67ad-41dd-8b4a-c3730adb4a30 tempest-ProjectReaderTests-1606856988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-9b8018dc-67ad-41dd-8b4a-c3730adb4a30 tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a31da98-23c2-455e-b4c8-e460fc9441de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-086ea88a-df81-45e9-9cd5-5cbea602268d', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:39 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-9b8018dc-67ad-41dd-8b4a-c3730adb4a30 tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e38e50d-b896-4fa6-ba27-9ed2e7226e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:40 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-9b8018dc-67ad-41dd-8b4a-c3730adb4a30 tempest-ProjectReaderTests-1606856988 None] Volume volume-086ea88a-df81-45e9-9cd5-5cbea602268d (086ea88a-df81-45e9-9cd5-5cbea602268d): created successfully Jul 30 17:10:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-9b8018dc-67ad-41dd-8b4a-c3730adb4a30 tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e38e50d-b896-4fa6-ba27-9ed2e7226e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-9b8018dc-67ad-41dd-8b4a-c3730adb4a30 tempest-ProjectReaderTests-1606856988 None] Flow 'volume_create_manager' (044d2a3d-70e7-42b4-9ce5-a94c5c0ebe84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:10:40 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-9b8018dc-67ad-41dd-8b4a-c3730adb4a30 tempest-ProjectReaderTests-1606856988 None] Created volume successfully. Jul 30 17:10:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-404ff3ce-7b0d-4fd2-a239-15f547e97c37 tempest-ProjectReaderTests-1606856988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-404ff3ce-7b0d-4fd2-a239-15f547e97c37 tempest-ProjectReaderTests-1606856988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:40 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-404ff3ce-7b0d-4fd2-a239-15f547e97c37 tempest-ProjectReaderTests-1606856988 None] Creating offline snapshot 28f25a49-b6c3-4f34-976e-c9afc32b94b6 of volume 086ea88a-df81-45e9-9cd5-5cbea602268d {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:10:40 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[7180858f-64ee-4d9d-bb00-e159261861a7]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-404ff3ce-7b0d-4fd2-a239-15f547e97c37 tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-086ea88a-df81-45e9-9cd5-5cbea602268d {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:40 devstack sudo[109588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-086ea88a-df81-45e9-9cd5-5cbea602268d Jul 30 17:10:40 devstack sudo[109588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:40 devstack sudo[109588]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-404ff3ce-7b0d-4fd2-a239-15f547e97c37 tempest-ProjectReaderTests-1606856988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-086ea88a-df81-45e9-9cd5-5cbea602268d" returned: 0 in 0.349s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-404ff3ce-7b0d-4fd2-a239-15f547e97c37 tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-086ea88a-df81-45e9-9cd5-5cbea602268d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-086ea88a-df81-45e9-9cd5-5cbea602268d.28f25a49-b6c3-4f34-976e-c9afc32b94b6 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:40 devstack sudo[109593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-086ea88a-df81-45e9-9cd5-5cbea602268d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-086ea88a-df81-45e9-9cd5-5cbea602268d.28f25a49-b6c3-4f34-976e-c9afc32b94b6 1G Jul 30 17:10:40 devstack sudo[109593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:41 devstack sudo[109593]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-404ff3ce-7b0d-4fd2-a239-15f547e97c37 tempest-ProjectReaderTests-1606856988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-086ea88a-df81-45e9-9cd5-5cbea602268d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-086ea88a-df81-45e9-9cd5-5cbea602268d.28f25a49-b6c3-4f34-976e-c9afc32b94b6 1G" returned: 0 in 0.382s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-404ff3ce-7b0d-4fd2-a239-15f547e97c37 tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-086ea88a-df81-45e9-9cd5-5cbea602268d -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-086ea88a-df81-45e9-9cd5-5cbea602268d.28f25a49-b6c3-4f34-976e-c9afc32b94b6 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:41 devstack sudo[109598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-086ea88a-df81-45e9-9cd5-5cbea602268d -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-086ea88a-df81-45e9-9cd5-5cbea602268d.28f25a49-b6c3-4f34-976e-c9afc32b94b6 Jul 30 17:10:41 devstack sudo[109598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:41 devstack sudo[109598]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-404ff3ce-7b0d-4fd2-a239-15f547e97c37 tempest-ProjectReaderTests-1606856988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-086ea88a-df81-45e9-9cd5-5cbea602268d -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-086ea88a-df81-45e9-9cd5-5cbea602268d.28f25a49-b6c3-4f34-976e-c9afc32b94b6" returned: 0 in 0.277s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:41 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-404ff3ce-7b0d-4fd2-a239-15f547e97c37 tempest-ProjectReaderTests-1606856988 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-086ea88a-df81-45e9-9cd5-5cbea602268d.28f25a49-b6c3-4f34-976e-c9afc32b94b6 is being set with open permissions: ugo+rw Jul 30 17:10:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-404ff3ce-7b0d-4fd2-a239-15f547e97c37 tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-086ea88a-df81-45e9-9cd5-5cbea602268d.28f25a49-b6c3-4f34-976e-c9afc32b94b6 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:41 devstack sudo[109603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-086ea88a-df81-45e9-9cd5-5cbea602268d.28f25a49-b6c3-4f34-976e-c9afc32b94b6 Jul 30 17:10:41 devstack sudo[109603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:41 devstack sudo[109603]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-404ff3ce-7b0d-4fd2-a239-15f547e97c37 tempest-ProjectReaderTests-1606856988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-086ea88a-df81-45e9-9cd5-5cbea602268d.28f25a49-b6c3-4f34-976e-c9afc32b94b6" returned: 0 in 0.244s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-404ff3ce-7b0d-4fd2-a239-15f547e97c37 tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-086ea88a-df81-45e9-9cd5-5cbea602268d.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:41 devstack sudo[109606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-086ea88a-df81-45e9-9cd5-5cbea602268d.info Jul 30 17:10:41 devstack sudo[109606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:41 devstack sudo[109606]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-404ff3ce-7b0d-4fd2-a239-15f547e97c37 tempest-ProjectReaderTests-1606856988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-086ea88a-df81-45e9-9cd5-5cbea602268d.info" returned: 0 in 0.244s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:41 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-404ff3ce-7b0d-4fd2-a239-15f547e97c37 tempest-ProjectReaderTests-1606856988 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-086ea88a-df81-45e9-9cd5-5cbea602268d.info is being set with open permissions: ugo+rw Jul 30 17:10:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-404ff3ce-7b0d-4fd2-a239-15f547e97c37 tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-086ea88a-df81-45e9-9cd5-5cbea602268d.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:41 devstack sudo[109609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-086ea88a-df81-45e9-9cd5-5cbea602268d.info Jul 30 17:10:41 devstack sudo[109609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:42 devstack sudo[109609]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-404ff3ce-7b0d-4fd2-a239-15f547e97c37 tempest-ProjectReaderTests-1606856988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-086ea88a-df81-45e9-9cd5-5cbea602268d.info" returned: 0 in 0.241s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-404ff3ce-7b0d-4fd2-a239-15f547e97c37 tempest-ProjectReaderTests-1606856988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.812s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:42 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-404ff3ce-7b0d-4fd2-a239-15f547e97c37 tempest-ProjectReaderTests-1606856988 None] Create snapshot completed successfully Jul 30 17:10:42 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-421a3a95-5a90-486e-b52c-963dc671149c tempest-ProjectReaderTests-1606856988 None] Acquiring lock "cinder-28f25a49-b6c3-4f34-976e-c9afc32b94b6-delete_snapshot" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:42 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-421a3a95-5a90-486e-b52c-963dc671149c tempest-ProjectReaderTests-1606856988 None] Lock "cinder-28f25a49-b6c3-4f34-976e-c9afc32b94b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:42 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-421a3a95-5a90-486e-b52c-963dc671149c tempest-ProjectReaderTests-1606856988 None] Acquiring lock "cinder-quobyte-086ea88a-df81-45e9-9cd5-5cbea602268d" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:42 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-421a3a95-5a90-486e-b52c-963dc671149c tempest-ProjectReaderTests-1606856988 None] Lock "cinder-quobyte-086ea88a-df81-45e9-9cd5-5cbea602268d" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:42 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-421a3a95-5a90-486e-b52c-963dc671149c tempest-ProjectReaderTests-1606856988 None] Acquiring lock "cinder-quobyte-28f25a49-b6c3-4f34-976e-c9afc32b94b6" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:42 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-421a3a95-5a90-486e-b52c-963dc671149c tempest-ProjectReaderTests-1606856988 None] Lock "cinder-quobyte-28f25a49-b6c3-4f34-976e-c9afc32b94b6" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:42 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-421a3a95-5a90-486e-b52c-963dc671149c tempest-ProjectReaderTests-1606856988 None] Deleting offline snapshot 28f25a49-b6c3-4f34-976e-c9afc32b94b6 of volume 086ea88a-df81-45e9-9cd5-5cbea602268d {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:10:42 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-421a3a95-5a90-486e-b52c-963dc671149c tempest-ProjectReaderTests-1606856988 None] snapshot_file for this snap is: volume-086ea88a-df81-45e9-9cd5-5cbea602268d.28f25a49-b6c3-4f34-976e-c9afc32b94b6 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:10:42 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb815ae-c9c1-4430-95ac-4d7dba0bd500]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-421a3a95-5a90-486e-b52c-963dc671149c tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-086ea88a-df81-45e9-9cd5-5cbea602268d.28f25a49-b6c3-4f34-976e-c9afc32b94b6 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:42 devstack sudo[109613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-086ea88a-df81-45e9-9cd5-5cbea602268d.28f25a49-b6c3-4f34-976e-c9afc32b94b6 Jul 30 17:10:42 devstack sudo[109613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:42 devstack sudo[109613]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-421a3a95-5a90-486e-b52c-963dc671149c tempest-ProjectReaderTests-1606856988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-086ea88a-df81-45e9-9cd5-5cbea602268d.28f25a49-b6c3-4f34-976e-c9afc32b94b6" returned: 0 in 0.357s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:42 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-421a3a95-5a90-486e-b52c-963dc671149c tempest-ProjectReaderTests-1606856988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-086ea88a-df81-45e9-9cd5-5cbea602268d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:10:42 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[121b9438-0c4a-4c97-848f-a6c475178d1c]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-421a3a95-5a90-486e-b52c-963dc671149c tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-086ea88a-df81-45e9-9cd5-5cbea602268d {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:43 devstack sudo[109618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-086ea88a-df81-45e9-9cd5-5cbea602268d Jul 30 17:10:43 devstack sudo[109618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:43 devstack sudo[109618]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-421a3a95-5a90-486e-b52c-963dc671149c tempest-ProjectReaderTests-1606856988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-086ea88a-df81-45e9-9cd5-5cbea602268d" returned: 0 in 0.350s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-421a3a95-5a90-486e-b52c-963dc671149c tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-086ea88a-df81-45e9-9cd5-5cbea602268d.28f25a49-b6c3-4f34-976e-c9afc32b94b6 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:43 devstack sudo[109623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-086ea88a-df81-45e9-9cd5-5cbea602268d.28f25a49-b6c3-4f34-976e-c9afc32b94b6 Jul 30 17:10:43 devstack sudo[109623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:43 devstack sudo[109623]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-421a3a95-5a90-486e-b52c-963dc671149c tempest-ProjectReaderTests-1606856988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-086ea88a-df81-45e9-9cd5-5cbea602268d.28f25a49-b6c3-4f34-976e-c9afc32b94b6" returned: 0 in 0.332s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-421a3a95-5a90-486e-b52c-963dc671149c tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-086ea88a-df81-45e9-9cd5-5cbea602268d.28f25a49-b6c3-4f34-976e-c9afc32b94b6 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:43 devstack sudo[109628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-086ea88a-df81-45e9-9cd5-5cbea602268d.28f25a49-b6c3-4f34-976e-c9afc32b94b6 Jul 30 17:10:43 devstack sudo[109628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:43 devstack sudo[109628]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-421a3a95-5a90-486e-b52c-963dc671149c tempest-ProjectReaderTests-1606856988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-086ea88a-df81-45e9-9cd5-5cbea602268d.28f25a49-b6c3-4f34-976e-c9afc32b94b6" returned: 0 in 0.239s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:43 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-421a3a95-5a90-486e-b52c-963dc671149c tempest-ProjectReaderTests-1606856988 None] Lock "cinder-quobyte-28f25a49-b6c3-4f34-976e-c9afc32b94b6" released by "_delete_snapshot" :: held 1.364s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:43 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-421a3a95-5a90-486e-b52c-963dc671149c tempest-ProjectReaderTests-1606856988 None] Lock "cinder-quobyte-086ea88a-df81-45e9-9cd5-5cbea602268d" released by "delete_snapshot" :: held 1.387s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:43 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-421a3a95-5a90-486e-b52c-963dc671149c tempest-ProjectReaderTests-1606856988 None] Created reservations ['da787b2f-084e-43f4-8a26-7539f54882d6', '7ca5dcf5-7e39-446d-86fb-a8a28dca8523', 'a4f0091d-b56e-4af0-afbd-f763b61a0837', 'e616c1b2-5132-4e2d-af19-6ce070c214d9'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:10:44 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-421a3a95-5a90-486e-b52c-963dc671149c tempest-ProjectReaderTests-1606856988 None] Delete snapshot completed successfully. Jul 30 17:10:44 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-421a3a95-5a90-486e-b52c-963dc671149c tempest-ProjectReaderTests-1606856988 None] Lock "cinder-28f25a49-b6c3-4f34-976e-c9afc32b94b6-delete_snapshot" released by "delete_snapshot" :: held 1.518s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:44 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-6ef32817-6554-4d71-8d7f-d5ed3381ffd5 tempest-ProjectReaderTests-1606856988 None] Acquiring lock "cinder-086ea88a-df81-45e9-9cd5-5cbea602268d-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:44 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-6ef32817-6554-4d71-8d7f-d5ed3381ffd5 tempest-ProjectReaderTests-1606856988 None] Lock "cinder-086ea88a-df81-45e9-9cd5-5cbea602268d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:44 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-6ef32817-6554-4d71-8d7f-d5ed3381ffd5 tempest-ProjectReaderTests-1606856988 None] Acquiring lock "cinder-quobyte-086ea88a-df81-45e9-9cd5-5cbea602268d" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:44 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-6ef32817-6554-4d71-8d7f-d5ed3381ffd5 tempest-ProjectReaderTests-1606856988 None] Lock "cinder-quobyte-086ea88a-df81-45e9-9cd5-5cbea602268d" acquired by "delete_volume" :: waited 0.015s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:44 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a659eabd-b590-413c-b94d-a389a017abbf]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6ef32817-6554-4d71-8d7f-d5ed3381ffd5 tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-086ea88a-df81-45e9-9cd5-5cbea602268d {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:44 devstack sudo[109631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-086ea88a-df81-45e9-9cd5-5cbea602268d Jul 30 17:10:44 devstack sudo[109631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:45 devstack sudo[109631]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6ef32817-6554-4d71-8d7f-d5ed3381ffd5 tempest-ProjectReaderTests-1606856988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-086ea88a-df81-45e9-9cd5-5cbea602268d" returned: 0 in 0.357s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6ef32817-6554-4d71-8d7f-d5ed3381ffd5 tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-086ea88a-df81-45e9-9cd5-5cbea602268d {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:45 devstack sudo[109636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-086ea88a-df81-45e9-9cd5-5cbea602268d Jul 30 17:10:45 devstack sudo[109636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:45 devstack sudo[109636]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6ef32817-6554-4d71-8d7f-d5ed3381ffd5 tempest-ProjectReaderTests-1606856988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-086ea88a-df81-45e9-9cd5-5cbea602268d" returned: 0 in 0.239s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:45 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-6ef32817-6554-4d71-8d7f-d5ed3381ffd5 tempest-ProjectReaderTests-1606856988 None] Lock "cinder-quobyte-086ea88a-df81-45e9-9cd5-5cbea602268d" released by "delete_volume" :: held 0.651s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:45 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-6ef32817-6554-4d71-8d7f-d5ed3381ffd5 tempest-ProjectReaderTests-1606856988 None] Created reservations ['db8c4fbc-ac12-48a5-8bb3-301922e66095', 'dc6b981e-4099-4698-bfa7-42a2ae55cb61', '6843df1d-726b-45dc-ad5b-54423872f750', '439a73ca-f11d-4081-923b-8ad2de78d8b1'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:10:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-6ef32817-6554-4d71-8d7f-d5ed3381ffd5 tempest-ProjectReaderTests-1606856988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-6ef32817-6554-4d71-8d7f-d5ed3381ffd5 tempest-ProjectReaderTests-1606856988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:45 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-6ef32817-6554-4d71-8d7f-d5ed3381ffd5 tempest-ProjectReaderTests-1606856988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:45 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-6ef32817-6554-4d71-8d7f-d5ed3381ffd5 tempest-ProjectReaderTests-1606856988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-6ef32817-6554-4d71-8d7f-d5ed3381ffd5 tempest-ProjectReaderTests-1606856988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6ef32817-6554-4d71-8d7f-d5ed3381ffd5 tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:45 devstack sudo[109639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:10:45 devstack sudo[109639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:45 devstack sudo[109639]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-6ef32817-6554-4d71-8d7f-d5ed3381ffd5 tempest-ProjectReaderTests-1606856988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.246s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:45 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-6ef32817-6554-4d71-8d7f-d5ed3381ffd5 tempest-ProjectReaderTests-1606856988 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:10:45 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-6ef32817-6554-4d71-8d7f-d5ed3381ffd5 tempest-ProjectReaderTests-1606856988 None] Deleted volume successfully. Jul 30 17:10:45 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-6ef32817-6554-4d71-8d7f-d5ed3381ffd5 tempest-ProjectReaderTests-1606856988 None] Lock "cinder-086ea88a-df81-45e9-9cd5-5cbea602268d-delete_volume" released by "delete_volume" :: held 1.093s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:46 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-f05a107f-9d90-4e95-8fb7-378fcebcb708 tempest-ProjectReaderTests-1606856988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:10:46 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f05a107f-9d90-4e95-8fb7-378fcebcb708 tempest-ProjectReaderTests-1606856988 None] Flow 'volume_create_manager' (1e3ff2f2-03c9-4383-b0f2-e95c2ddc9aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:10:46 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f05a107f-9d90-4e95-8fb7-378fcebcb708 tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd308061-8352-4163-beee-d15adfab26e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:46 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f05a107f-9d90-4e95-8fb7-378fcebcb708 tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd308061-8352-4163-beee-d15adfab26e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1898318841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ff6da86-8e45-4b00-ad7a-10390277f038,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f482a6a4b7864a8285af84b12a4c0ba7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:10:46Z,use_quota=True,user_id='6e6b52d8637b4f35b11882b9c0ef86cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:46 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f05a107f-9d90-4e95-8fb7-378fcebcb708 tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e3dd178-bd1b-4d02-bd91-d0984bb8e336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:46 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f05a107f-9d90-4e95-8fb7-378fcebcb708 tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e3dd178-bd1b-4d02-bd91-d0984bb8e336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:46 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f05a107f-9d90-4e95-8fb7-378fcebcb708 tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50336eff-fe3f-4b77-b13c-7a8e4d3e6122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:46 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f05a107f-9d90-4e95-8fb7-378fcebcb708 tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50336eff-fe3f-4b77-b13c-7a8e4d3e6122) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ff6da86-8e45-4b00-ad7a-10390277f038', 'volume_name': 'volume-8ff6da86-8e45-4b00-ad7a-10390277f038', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:46 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f05a107f-9d90-4e95-8fb7-378fcebcb708 tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (206eac76-d725-4a32-9e25-dd429406dd1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:46 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f05a107f-9d90-4e95-8fb7-378fcebcb708 tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (206eac76-d725-4a32-9e25-dd429406dd1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:46 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f05a107f-9d90-4e95-8fb7-378fcebcb708 tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a587cc6-0ecc-4bcb-9185-92991d49f377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:46 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-f05a107f-9d90-4e95-8fb7-378fcebcb708 tempest-ProjectReaderTests-1606856988 None] Volume 8ff6da86-8e45-4b00-ad7a-10390277f038: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ff6da86-8e45-4b00-ad7a-10390277f038', 'volume_size': 1} Jul 30 17:10:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f05a107f-9d90-4e95-8fb7-378fcebcb708 tempest-ProjectReaderTests-1606856988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f05a107f-9d90-4e95-8fb7-378fcebcb708 tempest-ProjectReaderTests-1606856988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:46 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f05a107f-9d90-4e95-8fb7-378fcebcb708 tempest-ProjectReaderTests-1606856988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1898318841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ff6da86-8e45-4b00-ad7a-10390277f038,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f482a6a4b7864a8285af84b12a4c0ba7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:10:46Z,use_quota=True,user_id='6e6b52d8637b4f35b11882b9c0ef86cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:10:46 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-f05a107f-9d90-4e95-8fb7-378fcebcb708 tempest-ProjectReaderTests-1606856988 None] Creating volume 8ff6da86-8e45-4b00-ad7a-10390277f038 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:10:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f05a107f-9d90-4e95-8fb7-378fcebcb708 tempest-ProjectReaderTests-1606856988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f05a107f-9d90-4e95-8fb7-378fcebcb708 tempest-ProjectReaderTests-1606856988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:46 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f05a107f-9d90-4e95-8fb7-378fcebcb708 tempest-ProjectReaderTests-1606856988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:46 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f05a107f-9d90-4e95-8fb7-378fcebcb708 tempest-ProjectReaderTests-1606856988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f05a107f-9d90-4e95-8fb7-378fcebcb708 tempest-ProjectReaderTests-1606856988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:46 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f05a107f-9d90-4e95-8fb7-378fcebcb708 tempest-ProjectReaderTests-1606856988 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:10:46 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-f05a107f-9d90-4e95-8fb7-378fcebcb708 tempest-ProjectReaderTests-1606856988 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:10:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f05a107f-9d90-4e95-8fb7-378fcebcb708 tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ff6da86-8e45-4b00-ad7a-10390277f038 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:46 devstack sudo[109642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ff6da86-8e45-4b00-ad7a-10390277f038 1073741824 Jul 30 17:10:46 devstack sudo[109642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:46 devstack sudo[109642]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f05a107f-9d90-4e95-8fb7-378fcebcb708 tempest-ProjectReaderTests-1606856988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ff6da86-8e45-4b00-ad7a-10390277f038 1073741824" returned: 0 in 0.407s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:46 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f05a107f-9d90-4e95-8fb7-378fcebcb708 tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ff6da86-8e45-4b00-ad7a-10390277f038 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:46 devstack sudo[109647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ff6da86-8e45-4b00-ad7a-10390277f038 Jul 30 17:10:46 devstack sudo[109647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:47 devstack sudo[109647]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f05a107f-9d90-4e95-8fb7-378fcebcb708 tempest-ProjectReaderTests-1606856988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ff6da86-8e45-4b00-ad7a-10390277f038" returned: 0 in 0.242s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:47 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f05a107f-9d90-4e95-8fb7-378fcebcb708 tempest-ProjectReaderTests-1606856988 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:10:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f05a107f-9d90-4e95-8fb7-378fcebcb708 tempest-ProjectReaderTests-1606856988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f05a107f-9d90-4e95-8fb7-378fcebcb708 tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a587cc6-0ecc-4bcb-9185-92991d49f377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ff6da86-8e45-4b00-ad7a-10390277f038', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f05a107f-9d90-4e95-8fb7-378fcebcb708 tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25f54bb9-54dc-4c76-9dce-a4c4ea80ff31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:47 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-f05a107f-9d90-4e95-8fb7-378fcebcb708 tempest-ProjectReaderTests-1606856988 None] Volume volume-8ff6da86-8e45-4b00-ad7a-10390277f038 (8ff6da86-8e45-4b00-ad7a-10390277f038): created successfully Jul 30 17:10:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f05a107f-9d90-4e95-8fb7-378fcebcb708 tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25f54bb9-54dc-4c76-9dce-a4c4ea80ff31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:47 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f05a107f-9d90-4e95-8fb7-378fcebcb708 tempest-ProjectReaderTests-1606856988 None] Flow 'volume_create_manager' (1e3ff2f2-03c9-4383-b0f2-e95c2ddc9aba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:10:47 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-f05a107f-9d90-4e95-8fb7-378fcebcb708 tempest-ProjectReaderTests-1606856988 None] Created volume successfully. Jul 30 17:10:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-cec83605-ee8e-44ba-b9c1-b7e725229985 tempest-ProjectReaderTests-1606856988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-cec83605-ee8e-44ba-b9c1-b7e725229985 tempest-ProjectReaderTests-1606856988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:47 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-cec83605-ee8e-44ba-b9c1-b7e725229985 tempest-ProjectReaderTests-1606856988 None] Creating offline snapshot 24accf1b-e118-4994-836b-4d4f05daab9e of volume 8ff6da86-8e45-4b00-ad7a-10390277f038 {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:10:47 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[153e6692-db0f-4bdb-a346-f2e63b2fb93d]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cec83605-ee8e-44ba-b9c1-b7e725229985 tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ff6da86-8e45-4b00-ad7a-10390277f038 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:47 devstack sudo[109650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ff6da86-8e45-4b00-ad7a-10390277f038 Jul 30 17:10:47 devstack sudo[109650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:47 devstack sudo[109650]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cec83605-ee8e-44ba-b9c1-b7e725229985 tempest-ProjectReaderTests-1606856988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ff6da86-8e45-4b00-ad7a-10390277f038" returned: 0 in 0.358s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:47 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cec83605-ee8e-44ba-b9c1-b7e725229985 tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ff6da86-8e45-4b00-ad7a-10390277f038,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ff6da86-8e45-4b00-ad7a-10390277f038.24accf1b-e118-4994-836b-4d4f05daab9e 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:47 devstack sudo[109655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ff6da86-8e45-4b00-ad7a-10390277f038,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ff6da86-8e45-4b00-ad7a-10390277f038.24accf1b-e118-4994-836b-4d4f05daab9e 1G Jul 30 17:10:47 devstack sudo[109655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:48 devstack sudo[109655]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cec83605-ee8e-44ba-b9c1-b7e725229985 tempest-ProjectReaderTests-1606856988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ff6da86-8e45-4b00-ad7a-10390277f038,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ff6da86-8e45-4b00-ad7a-10390277f038.24accf1b-e118-4994-836b-4d4f05daab9e 1G" returned: 0 in 0.386s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cec83605-ee8e-44ba-b9c1-b7e725229985 tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ff6da86-8e45-4b00-ad7a-10390277f038 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ff6da86-8e45-4b00-ad7a-10390277f038.24accf1b-e118-4994-836b-4d4f05daab9e {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:48 devstack sudo[109660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ff6da86-8e45-4b00-ad7a-10390277f038 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ff6da86-8e45-4b00-ad7a-10390277f038.24accf1b-e118-4994-836b-4d4f05daab9e Jul 30 17:10:48 devstack sudo[109660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:48 devstack sudo[109660]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cec83605-ee8e-44ba-b9c1-b7e725229985 tempest-ProjectReaderTests-1606856988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ff6da86-8e45-4b00-ad7a-10390277f038 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ff6da86-8e45-4b00-ad7a-10390277f038.24accf1b-e118-4994-836b-4d4f05daab9e" returned: 0 in 0.280s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:48 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-cec83605-ee8e-44ba-b9c1-b7e725229985 tempest-ProjectReaderTests-1606856988 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ff6da86-8e45-4b00-ad7a-10390277f038.24accf1b-e118-4994-836b-4d4f05daab9e is being set with open permissions: ugo+rw Jul 30 17:10:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cec83605-ee8e-44ba-b9c1-b7e725229985 tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ff6da86-8e45-4b00-ad7a-10390277f038.24accf1b-e118-4994-836b-4d4f05daab9e {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:48 devstack sudo[109665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ff6da86-8e45-4b00-ad7a-10390277f038.24accf1b-e118-4994-836b-4d4f05daab9e Jul 30 17:10:48 devstack sudo[109665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:48 devstack sudo[109665]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cec83605-ee8e-44ba-b9c1-b7e725229985 tempest-ProjectReaderTests-1606856988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ff6da86-8e45-4b00-ad7a-10390277f038.24accf1b-e118-4994-836b-4d4f05daab9e" returned: 0 in 0.250s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:48 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cec83605-ee8e-44ba-b9c1-b7e725229985 tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ff6da86-8e45-4b00-ad7a-10390277f038.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:48 devstack sudo[109668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ff6da86-8e45-4b00-ad7a-10390277f038.info Jul 30 17:10:48 devstack sudo[109668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:49 devstack sudo[109668]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cec83605-ee8e-44ba-b9c1-b7e725229985 tempest-ProjectReaderTests-1606856988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ff6da86-8e45-4b00-ad7a-10390277f038.info" returned: 0 in 0.244s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:49 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-cec83605-ee8e-44ba-b9c1-b7e725229985 tempest-ProjectReaderTests-1606856988 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ff6da86-8e45-4b00-ad7a-10390277f038.info is being set with open permissions: ugo+rw Jul 30 17:10:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cec83605-ee8e-44ba-b9c1-b7e725229985 tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ff6da86-8e45-4b00-ad7a-10390277f038.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:49 devstack sudo[109671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ff6da86-8e45-4b00-ad7a-10390277f038.info Jul 30 17:10:49 devstack sudo[109671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:49 devstack sudo[109671]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-cec83605-ee8e-44ba-b9c1-b7e725229985 tempest-ProjectReaderTests-1606856988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ff6da86-8e45-4b00-ad7a-10390277f038.info" returned: 0 in 0.245s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-cec83605-ee8e-44ba-b9c1-b7e725229985 tempest-ProjectReaderTests-1606856988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.837s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:49 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-cec83605-ee8e-44ba-b9c1-b7e725229985 tempest-ProjectReaderTests-1606856988 None] Create snapshot completed successfully Jul 30 17:10:49 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-5d00987d-4c0e-4e46-b199-0dafe82e8036 tempest-ProjectReaderTests-1606856988 None] Acquiring lock "cinder-24accf1b-e118-4994-836b-4d4f05daab9e-delete_snapshot" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:49 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-5d00987d-4c0e-4e46-b199-0dafe82e8036 tempest-ProjectReaderTests-1606856988 None] Lock "cinder-24accf1b-e118-4994-836b-4d4f05daab9e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:49 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-5d00987d-4c0e-4e46-b199-0dafe82e8036 tempest-ProjectReaderTests-1606856988 None] Acquiring lock "cinder-quobyte-8ff6da86-8e45-4b00-ad7a-10390277f038" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:49 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-5d00987d-4c0e-4e46-b199-0dafe82e8036 tempest-ProjectReaderTests-1606856988 None] Lock "cinder-quobyte-8ff6da86-8e45-4b00-ad7a-10390277f038" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:49 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-5d00987d-4c0e-4e46-b199-0dafe82e8036 tempest-ProjectReaderTests-1606856988 None] Acquiring lock "cinder-quobyte-24accf1b-e118-4994-836b-4d4f05daab9e" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:49 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-5d00987d-4c0e-4e46-b199-0dafe82e8036 tempest-ProjectReaderTests-1606856988 None] Lock "cinder-quobyte-24accf1b-e118-4994-836b-4d4f05daab9e" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:49 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-5d00987d-4c0e-4e46-b199-0dafe82e8036 tempest-ProjectReaderTests-1606856988 None] Deleting offline snapshot 24accf1b-e118-4994-836b-4d4f05daab9e of volume 8ff6da86-8e45-4b00-ad7a-10390277f038 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:10:49 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-5d00987d-4c0e-4e46-b199-0dafe82e8036 tempest-ProjectReaderTests-1606856988 None] snapshot_file for this snap is: volume-8ff6da86-8e45-4b00-ad7a-10390277f038.24accf1b-e118-4994-836b-4d4f05daab9e {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:10:49 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf3a47b-6656-4f8a-8248-34b5c2fa3965]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:49 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5d00987d-4c0e-4e46-b199-0dafe82e8036 tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ff6da86-8e45-4b00-ad7a-10390277f038.24accf1b-e118-4994-836b-4d4f05daab9e {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:49 devstack sudo[109674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ff6da86-8e45-4b00-ad7a-10390277f038.24accf1b-e118-4994-836b-4d4f05daab9e Jul 30 17:10:49 devstack sudo[109674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:50 devstack sudo[109674]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5d00987d-4c0e-4e46-b199-0dafe82e8036 tempest-ProjectReaderTests-1606856988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ff6da86-8e45-4b00-ad7a-10390277f038.24accf1b-e118-4994-836b-4d4f05daab9e" returned: 0 in 0.354s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:50 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-5d00987d-4c0e-4e46-b199-0dafe82e8036 tempest-ProjectReaderTests-1606856988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ff6da86-8e45-4b00-ad7a-10390277f038(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:10:50 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[4040b124-d475-4ac8-aca8-ec150891bf6c]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5d00987d-4c0e-4e46-b199-0dafe82e8036 tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ff6da86-8e45-4b00-ad7a-10390277f038 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:50 devstack sudo[109679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ff6da86-8e45-4b00-ad7a-10390277f038 Jul 30 17:10:50 devstack sudo[109679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:50 devstack sudo[109679]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5d00987d-4c0e-4e46-b199-0dafe82e8036 tempest-ProjectReaderTests-1606856988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ff6da86-8e45-4b00-ad7a-10390277f038" returned: 0 in 0.358s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5d00987d-4c0e-4e46-b199-0dafe82e8036 tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ff6da86-8e45-4b00-ad7a-10390277f038.24accf1b-e118-4994-836b-4d4f05daab9e {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:50 devstack sudo[109684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ff6da86-8e45-4b00-ad7a-10390277f038.24accf1b-e118-4994-836b-4d4f05daab9e Jul 30 17:10:50 devstack sudo[109684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:50 devstack sudo[109684]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5d00987d-4c0e-4e46-b199-0dafe82e8036 tempest-ProjectReaderTests-1606856988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ff6da86-8e45-4b00-ad7a-10390277f038.24accf1b-e118-4994-836b-4d4f05daab9e" returned: 0 in 0.329s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5d00987d-4c0e-4e46-b199-0dafe82e8036 tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ff6da86-8e45-4b00-ad7a-10390277f038.24accf1b-e118-4994-836b-4d4f05daab9e {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:50 devstack sudo[109689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ff6da86-8e45-4b00-ad7a-10390277f038.24accf1b-e118-4994-836b-4d4f05daab9e Jul 30 17:10:50 devstack sudo[109689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:50 devstack sudo[109689]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:50 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5d00987d-4c0e-4e46-b199-0dafe82e8036 tempest-ProjectReaderTests-1606856988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ff6da86-8e45-4b00-ad7a-10390277f038.24accf1b-e118-4994-836b-4d4f05daab9e" returned: 0 in 0.234s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:50 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-5d00987d-4c0e-4e46-b199-0dafe82e8036 tempest-ProjectReaderTests-1606856988 None] Lock "cinder-quobyte-24accf1b-e118-4994-836b-4d4f05daab9e" released by "_delete_snapshot" :: held 1.361s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:51 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-5d00987d-4c0e-4e46-b199-0dafe82e8036 tempest-ProjectReaderTests-1606856988 None] Lock "cinder-quobyte-8ff6da86-8e45-4b00-ad7a-10390277f038" released by "delete_snapshot" :: held 1.381s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:51 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-5d00987d-4c0e-4e46-b199-0dafe82e8036 tempest-ProjectReaderTests-1606856988 None] Created reservations ['1933bd81-f542-4416-8502-72b01511a272', 'ffcc50e6-227f-45a1-899b-d15f2841b29d', '89b15442-7bc8-47e4-ba73-7811c4647f4b', '9251ab00-df9f-4ed8-a17b-f2e22a100c2d'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:10:51 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-5d00987d-4c0e-4e46-b199-0dafe82e8036 tempest-ProjectReaderTests-1606856988 None] Delete snapshot completed successfully. Jul 30 17:10:51 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-5d00987d-4c0e-4e46-b199-0dafe82e8036 tempest-ProjectReaderTests-1606856988 None] Lock "cinder-24accf1b-e118-4994-836b-4d4f05daab9e-delete_snapshot" released by "delete_snapshot" :: held 1.517s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:51 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f1cce173-e65d-4a20-bc76-09b22619c023 tempest-ProjectReaderTests-1606856988 None] Acquiring lock "cinder-8ff6da86-8e45-4b00-ad7a-10390277f038-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:51 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f1cce173-e65d-4a20-bc76-09b22619c023 tempest-ProjectReaderTests-1606856988 None] Lock "cinder-8ff6da86-8e45-4b00-ad7a-10390277f038-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:51 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f1cce173-e65d-4a20-bc76-09b22619c023 tempest-ProjectReaderTests-1606856988 None] Acquiring lock "cinder-quobyte-8ff6da86-8e45-4b00-ad7a-10390277f038" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:51 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f1cce173-e65d-4a20-bc76-09b22619c023 tempest-ProjectReaderTests-1606856988 None] Lock "cinder-quobyte-8ff6da86-8e45-4b00-ad7a-10390277f038" acquired by "delete_volume" :: waited 0.014s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:51 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c17fd3-bf4e-4989-9f23-c4d6cf969677]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:51 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f1cce173-e65d-4a20-bc76-09b22619c023 tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ff6da86-8e45-4b00-ad7a-10390277f038 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:51 devstack sudo[109698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ff6da86-8e45-4b00-ad7a-10390277f038 Jul 30 17:10:51 devstack sudo[109698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:52 devstack sudo[109698]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f1cce173-e65d-4a20-bc76-09b22619c023 tempest-ProjectReaderTests-1606856988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ff6da86-8e45-4b00-ad7a-10390277f038" returned: 0 in 0.351s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f1cce173-e65d-4a20-bc76-09b22619c023 tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ff6da86-8e45-4b00-ad7a-10390277f038 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:52 devstack sudo[109703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ff6da86-8e45-4b00-ad7a-10390277f038 Jul 30 17:10:52 devstack sudo[109703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:52 devstack sudo[109703]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f1cce173-e65d-4a20-bc76-09b22619c023 tempest-ProjectReaderTests-1606856988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-8ff6da86-8e45-4b00-ad7a-10390277f038" returned: 0 in 0.240s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:52 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f1cce173-e65d-4a20-bc76-09b22619c023 tempest-ProjectReaderTests-1606856988 None] Lock "cinder-quobyte-8ff6da86-8e45-4b00-ad7a-10390277f038" released by "delete_volume" :: held 0.648s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:52 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-f1cce173-e65d-4a20-bc76-09b22619c023 tempest-ProjectReaderTests-1606856988 None] Created reservations ['cf9c104c-8aaf-43cf-ac82-8ac37e1b1d81', '1f533c8a-86db-42db-b85f-6183fe97d087', '498dae35-cc20-435f-a43b-f15018e23602', '205efbed-ea70-4876-996f-3322ad06149d'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:10:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f1cce173-e65d-4a20-bc76-09b22619c023 tempest-ProjectReaderTests-1606856988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f1cce173-e65d-4a20-bc76-09b22619c023 tempest-ProjectReaderTests-1606856988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:52 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f1cce173-e65d-4a20-bc76-09b22619c023 tempest-ProjectReaderTests-1606856988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:52 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f1cce173-e65d-4a20-bc76-09b22619c023 tempest-ProjectReaderTests-1606856988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f1cce173-e65d-4a20-bc76-09b22619c023 tempest-ProjectReaderTests-1606856988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f1cce173-e65d-4a20-bc76-09b22619c023 tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:52 devstack sudo[109707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:10:52 devstack sudo[109707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:52 devstack sudo[109707]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:52 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f1cce173-e65d-4a20-bc76-09b22619c023 tempest-ProjectReaderTests-1606856988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.248s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:52 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-f1cce173-e65d-4a20-bc76-09b22619c023 tempest-ProjectReaderTests-1606856988 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:10:52 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-f1cce173-e65d-4a20-bc76-09b22619c023 tempest-ProjectReaderTests-1606856988 None] Deleted volume successfully. Jul 30 17:10:52 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-f1cce173-e65d-4a20-bc76-09b22619c023 tempest-ProjectReaderTests-1606856988 None] Lock "cinder-8ff6da86-8e45-4b00-ad7a-10390277f038-delete_volume" released by "delete_volume" :: held 1.080s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:53 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce3cc287-703e-4cec-ae76-2f27c545d775 tempest-ProjectReaderTests-1606856988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:10:53 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ce3cc287-703e-4cec-ae76-2f27c545d775 tempest-ProjectReaderTests-1606856988 None] Flow 'volume_create_manager' (2ad030b2-57b0-496d-9d1a-ce4537c100c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:10:53 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ce3cc287-703e-4cec-ae76-2f27c545d775 tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3851afc-3f99-4848-8331-5255f59c7a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:53 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ce3cc287-703e-4cec-ae76-2f27c545d775 tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3851afc-3f99-4848-8331-5255f59c7a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1956300197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c68278d6-10e7-4b0f-a8cd-4c28847b1d5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f482a6a4b7864a8285af84b12a4c0ba7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:10:53Z,use_quota=True,user_id='6e6b52d8637b4f35b11882b9c0ef86cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:53 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ce3cc287-703e-4cec-ae76-2f27c545d775 tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c01b1f3-cecd-4b12-8dfb-1808de73dbb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:53 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ce3cc287-703e-4cec-ae76-2f27c545d775 tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c01b1f3-cecd-4b12-8dfb-1808de73dbb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:53 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ce3cc287-703e-4cec-ae76-2f27c545d775 tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37212632-65c5-4b04-ac91-38338a793d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:53 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ce3cc287-703e-4cec-ae76-2f27c545d775 tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37212632-65c5-4b04-ac91-38338a793d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c68278d6-10e7-4b0f-a8cd-4c28847b1d5a', 'volume_name': 'volume-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:53 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ce3cc287-703e-4cec-ae76-2f27c545d775 tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f39d44c-e1c7-476d-9a67-1c9ff15df634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:53 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ce3cc287-703e-4cec-ae76-2f27c545d775 tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f39d44c-e1c7-476d-9a67-1c9ff15df634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:53 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ce3cc287-703e-4cec-ae76-2f27c545d775 tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c86eefde-7bb7-4bf2-880f-91ff029c6135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:53 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-ce3cc287-703e-4cec-ae76-2f27c545d775 tempest-ProjectReaderTests-1606856988 None] Volume c68278d6-10e7-4b0f-a8cd-4c28847b1d5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a', 'volume_size': 1} Jul 30 17:10:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ce3cc287-703e-4cec-ae76-2f27c545d775 tempest-ProjectReaderTests-1606856988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ce3cc287-703e-4cec-ae76-2f27c545d775 tempest-ProjectReaderTests-1606856988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:53 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ce3cc287-703e-4cec-ae76-2f27c545d775 tempest-ProjectReaderTests-1606856988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1956300197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c68278d6-10e7-4b0f-a8cd-4c28847b1d5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f482a6a4b7864a8285af84b12a4c0ba7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:10:53Z,use_quota=True,user_id='6e6b52d8637b4f35b11882b9c0ef86cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:10:53 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-ce3cc287-703e-4cec-ae76-2f27c545d775 tempest-ProjectReaderTests-1606856988 None] Creating volume c68278d6-10e7-4b0f-a8cd-4c28847b1d5a {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:10:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ce3cc287-703e-4cec-ae76-2f27c545d775 tempest-ProjectReaderTests-1606856988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ce3cc287-703e-4cec-ae76-2f27c545d775 tempest-ProjectReaderTests-1606856988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:53 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ce3cc287-703e-4cec-ae76-2f27c545d775 tempest-ProjectReaderTests-1606856988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:53 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ce3cc287-703e-4cec-ae76-2f27c545d775 tempest-ProjectReaderTests-1606856988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ce3cc287-703e-4cec-ae76-2f27c545d775 tempest-ProjectReaderTests-1606856988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:53 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ce3cc287-703e-4cec-ae76-2f27c545d775 tempest-ProjectReaderTests-1606856988 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:10:53 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-ce3cc287-703e-4cec-ae76-2f27c545d775 tempest-ProjectReaderTests-1606856988 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:10:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ce3cc287-703e-4cec-ae76-2f27c545d775 tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:53 devstack sudo[109710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a 1073741824 Jul 30 17:10:53 devstack sudo[109710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:53 devstack sudo[109710]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ce3cc287-703e-4cec-ae76-2f27c545d775 tempest-ProjectReaderTests-1606856988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a 1073741824" returned: 0 in 0.391s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:53 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ce3cc287-703e-4cec-ae76-2f27c545d775 tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:53 devstack sudo[109716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a Jul 30 17:10:53 devstack sudo[109716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:54 devstack sudo[109716]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-ce3cc287-703e-4cec-ae76-2f27c545d775 tempest-ProjectReaderTests-1606856988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a" returned: 0 in 0.244s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:54 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-ce3cc287-703e-4cec-ae76-2f27c545d775 tempest-ProjectReaderTests-1606856988 None] <== create_volume: return (675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:10:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-ce3cc287-703e-4cec-ae76-2f27c545d775 tempest-ProjectReaderTests-1606856988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.677s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:54 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ce3cc287-703e-4cec-ae76-2f27c545d775 tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c86eefde-7bb7-4bf2-880f-91ff029c6135) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:54 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ce3cc287-703e-4cec-ae76-2f27c545d775 tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4108537-0d3d-4bb8-b4d1-1dc2c0232602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:10:54 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-ce3cc287-703e-4cec-ae76-2f27c545d775 tempest-ProjectReaderTests-1606856988 None] Volume volume-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a (c68278d6-10e7-4b0f-a8cd-4c28847b1d5a): created successfully Jul 30 17:10:54 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ce3cc287-703e-4cec-ae76-2f27c545d775 tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4108537-0d3d-4bb8-b4d1-1dc2c0232602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:10:54 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-ce3cc287-703e-4cec-ae76-2f27c545d775 tempest-ProjectReaderTests-1606856988 None] Flow 'volume_create_manager' (2ad030b2-57b0-496d-9d1a-ce4537c100c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:10:54 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-ce3cc287-703e-4cec-ae76-2f27c545d775 tempest-ProjectReaderTests-1606856988 None] Created volume successfully. Jul 30 17:10:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-907469ba-2721-49ec-b86c-4620dc8daee2 tempest-ProjectReaderTests-1606856988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-907469ba-2721-49ec-b86c-4620dc8daee2 tempest-ProjectReaderTests-1606856988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:54 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-907469ba-2721-49ec-b86c-4620dc8daee2 tempest-ProjectReaderTests-1606856988 None] Creating offline snapshot cef0dc82-efee-42c2-9c74-53623d720f82 of volume c68278d6-10e7-4b0f-a8cd-4c28847b1d5a {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:10:54 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da0b30c-499f-47c3-875a-0a6ae6eb6824]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-907469ba-2721-49ec-b86c-4620dc8daee2 tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:54 devstack sudo[109719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a Jul 30 17:10:54 devstack sudo[109719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:54 devstack sudo[109719]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-907469ba-2721-49ec-b86c-4620dc8daee2 tempest-ProjectReaderTests-1606856988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a" returned: 0 in 0.373s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:54 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-907469ba-2721-49ec-b86c-4620dc8daee2 tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a.cef0dc82-efee-42c2-9c74-53623d720f82 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:54 devstack sudo[109760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a.cef0dc82-efee-42c2-9c74-53623d720f82 1G Jul 30 17:10:54 devstack sudo[109760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:55 devstack sudo[109760]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-907469ba-2721-49ec-b86c-4620dc8daee2 tempest-ProjectReaderTests-1606856988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a.cef0dc82-efee-42c2-9c74-53623d720f82 1G" returned: 0 in 0.389s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-907469ba-2721-49ec-b86c-4620dc8daee2 tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a.cef0dc82-efee-42c2-9c74-53623d720f82 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:55 devstack sudo[109765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a.cef0dc82-efee-42c2-9c74-53623d720f82 Jul 30 17:10:55 devstack sudo[109765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:55 devstack sudo[109765]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-907469ba-2721-49ec-b86c-4620dc8daee2 tempest-ProjectReaderTests-1606856988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a.cef0dc82-efee-42c2-9c74-53623d720f82" returned: 0 in 0.289s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:55 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-907469ba-2721-49ec-b86c-4620dc8daee2 tempest-ProjectReaderTests-1606856988 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a.cef0dc82-efee-42c2-9c74-53623d720f82 is being set with open permissions: ugo+rw Jul 30 17:10:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-907469ba-2721-49ec-b86c-4620dc8daee2 tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a.cef0dc82-efee-42c2-9c74-53623d720f82 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:55 devstack sudo[109770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a.cef0dc82-efee-42c2-9c74-53623d720f82 Jul 30 17:10:55 devstack sudo[109770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:55 devstack sudo[109770]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-907469ba-2721-49ec-b86c-4620dc8daee2 tempest-ProjectReaderTests-1606856988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a.cef0dc82-efee-42c2-9c74-53623d720f82" returned: 0 in 0.237s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:55 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-907469ba-2721-49ec-b86c-4620dc8daee2 tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:55 devstack sudo[109773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a.info Jul 30 17:10:55 devstack sudo[109773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:56 devstack sudo[109773]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-907469ba-2721-49ec-b86c-4620dc8daee2 tempest-ProjectReaderTests-1606856988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a.info" returned: 0 in 0.245s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:56 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-907469ba-2721-49ec-b86c-4620dc8daee2 tempest-ProjectReaderTests-1606856988 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a.info is being set with open permissions: ugo+rw Jul 30 17:10:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-907469ba-2721-49ec-b86c-4620dc8daee2 tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:56 devstack sudo[109776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a.info Jul 30 17:10:56 devstack sudo[109776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:56 devstack sudo[109776]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-907469ba-2721-49ec-b86c-4620dc8daee2 tempest-ProjectReaderTests-1606856988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a.info" returned: 0 in 0.234s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-907469ba-2721-49ec-b86c-4620dc8daee2 tempest-ProjectReaderTests-1606856988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.842s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:56 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-907469ba-2721-49ec-b86c-4620dc8daee2 tempest-ProjectReaderTests-1606856988 None] Create snapshot completed successfully Jul 30 17:10:56 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9d5a211e-2d35-4118-93a8-3ccc1050219a tempest-ProjectReaderTests-1606856988 None] Acquiring lock "cinder-cef0dc82-efee-42c2-9c74-53623d720f82-delete_snapshot" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:56 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9d5a211e-2d35-4118-93a8-3ccc1050219a tempest-ProjectReaderTests-1606856988 None] Lock "cinder-cef0dc82-efee-42c2-9c74-53623d720f82-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:56 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9d5a211e-2d35-4118-93a8-3ccc1050219a tempest-ProjectReaderTests-1606856988 None] Acquiring lock "cinder-quobyte-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:56 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9d5a211e-2d35-4118-93a8-3ccc1050219a tempest-ProjectReaderTests-1606856988 None] Lock "cinder-quobyte-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:56 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9d5a211e-2d35-4118-93a8-3ccc1050219a tempest-ProjectReaderTests-1606856988 None] Acquiring lock "cinder-quobyte-cef0dc82-efee-42c2-9c74-53623d720f82" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:56 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9d5a211e-2d35-4118-93a8-3ccc1050219a tempest-ProjectReaderTests-1606856988 None] Lock "cinder-quobyte-cef0dc82-efee-42c2-9c74-53623d720f82" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:56 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-9d5a211e-2d35-4118-93a8-3ccc1050219a tempest-ProjectReaderTests-1606856988 None] Deleting offline snapshot cef0dc82-efee-42c2-9c74-53623d720f82 of volume c68278d6-10e7-4b0f-a8cd-4c28847b1d5a {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:10:56 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-9d5a211e-2d35-4118-93a8-3ccc1050219a tempest-ProjectReaderTests-1606856988 None] snapshot_file for this snap is: volume-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a.cef0dc82-efee-42c2-9c74-53623d720f82 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:10:56 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31ee60e-8fe3-429e-9905-fc94140f06ff]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:56 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9d5a211e-2d35-4118-93a8-3ccc1050219a tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a.cef0dc82-efee-42c2-9c74-53623d720f82 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:56 devstack sudo[109779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a.cef0dc82-efee-42c2-9c74-53623d720f82 Jul 30 17:10:56 devstack sudo[109779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:57 devstack sudo[109779]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9d5a211e-2d35-4118-93a8-3ccc1050219a tempest-ProjectReaderTests-1606856988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a.cef0dc82-efee-42c2-9c74-53623d720f82" returned: 0 in 0.357s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:57 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-9d5a211e-2d35-4118-93a8-3ccc1050219a tempest-ProjectReaderTests-1606856988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:10:57 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b1e44b-765c-4298-9162-6a5fbbf8d091]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9d5a211e-2d35-4118-93a8-3ccc1050219a tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:57 devstack sudo[109784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a Jul 30 17:10:57 devstack sudo[109784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:57 devstack sudo[109784]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9d5a211e-2d35-4118-93a8-3ccc1050219a tempest-ProjectReaderTests-1606856988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a" returned: 0 in 0.341s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9d5a211e-2d35-4118-93a8-3ccc1050219a tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a.cef0dc82-efee-42c2-9c74-53623d720f82 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:57 devstack sudo[109789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a.cef0dc82-efee-42c2-9c74-53623d720f82 Jul 30 17:10:57 devstack sudo[109789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:57 devstack sudo[109789]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9d5a211e-2d35-4118-93a8-3ccc1050219a tempest-ProjectReaderTests-1606856988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a.cef0dc82-efee-42c2-9c74-53623d720f82" returned: 0 in 0.330s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9d5a211e-2d35-4118-93a8-3ccc1050219a tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a.cef0dc82-efee-42c2-9c74-53623d720f82 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:57 devstack sudo[109794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a.cef0dc82-efee-42c2-9c74-53623d720f82 Jul 30 17:10:57 devstack sudo[109794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:57 devstack sudo[109794]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:57 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-9d5a211e-2d35-4118-93a8-3ccc1050219a tempest-ProjectReaderTests-1606856988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a.cef0dc82-efee-42c2-9c74-53623d720f82" returned: 0 in 0.232s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:57 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9d5a211e-2d35-4118-93a8-3ccc1050219a tempest-ProjectReaderTests-1606856988 None] Lock "cinder-quobyte-cef0dc82-efee-42c2-9c74-53623d720f82" released by "_delete_snapshot" :: held 1.349s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:58 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9d5a211e-2d35-4118-93a8-3ccc1050219a tempest-ProjectReaderTests-1606856988 None] Lock "cinder-quobyte-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a" released by "delete_snapshot" :: held 1.373s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:58 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-9d5a211e-2d35-4118-93a8-3ccc1050219a tempest-ProjectReaderTests-1606856988 None] Created reservations ['173cf27b-7b07-4320-bca0-cafb25f8e3b4', '02aa6b09-f30a-4ba5-9178-65d93d877a63', '432706d6-f9f1-43e9-92c9-173de2e7d6b7', 'f6d0a6a7-74d5-4d7b-91c6-2cc5d03d065b'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:10:58 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-9d5a211e-2d35-4118-93a8-3ccc1050219a tempest-ProjectReaderTests-1606856988 None] Delete snapshot completed successfully. Jul 30 17:10:58 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-9d5a211e-2d35-4118-93a8-3ccc1050219a tempest-ProjectReaderTests-1606856988 None] Lock "cinder-cef0dc82-efee-42c2-9c74-53623d720f82-delete_snapshot" released by "delete_snapshot" :: held 1.509s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:58 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-88865d45-4e21-46b2-8453-c1042e5d0a7e tempest-ProjectReaderTests-1606856988 None] Acquiring lock "cinder-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:58 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-88865d45-4e21-46b2-8453-c1042e5d0a7e tempest-ProjectReaderTests-1606856988 None] Lock "cinder-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:58 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-88865d45-4e21-46b2-8453-c1042e5d0a7e tempest-ProjectReaderTests-1606856988 None] Acquiring lock "cinder-quobyte-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:10:58 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-88865d45-4e21-46b2-8453-c1042e5d0a7e tempest-ProjectReaderTests-1606856988 None] Lock "cinder-quobyte-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a" acquired by "delete_volume" :: waited 0.014s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:10:58 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f82dfd-9ea7-40f0-b397-43a3edcaa955]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:10:58 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-88865d45-4e21-46b2-8453-c1042e5d0a7e tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:58 devstack sudo[109797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a Jul 30 17:10:58 devstack sudo[109797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:59 devstack sudo[109797]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-88865d45-4e21-46b2-8453-c1042e5d0a7e tempest-ProjectReaderTests-1606856988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a" returned: 0 in 0.353s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-88865d45-4e21-46b2-8453-c1042e5d0a7e tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:59 devstack sudo[109802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a Jul 30 17:10:59 devstack sudo[109802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:59 devstack sudo[109802]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-88865d45-4e21-46b2-8453-c1042e5d0a7e tempest-ProjectReaderTests-1606856988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a" returned: 0 in 0.234s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:59 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-88865d45-4e21-46b2-8453-c1042e5d0a7e tempest-ProjectReaderTests-1606856988 None] Lock "cinder-quobyte-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a" released by "delete_volume" :: held 0.639s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:10:59 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-88865d45-4e21-46b2-8453-c1042e5d0a7e tempest-ProjectReaderTests-1606856988 None] Created reservations ['4b95cdfd-1bf1-4aa6-a088-51004f2b1b1a', '7a7bcb60-0954-4f63-8e45-33d2bf57f936', '2a531071-53a6-4da6-8fe2-08ffbd565b24', 'aca70e44-8077-483f-93b7-7763d518850a'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:10:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-88865d45-4e21-46b2-8453-c1042e5d0a7e tempest-ProjectReaderTests-1606856988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:10:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-88865d45-4e21-46b2-8453-c1042e5d0a7e tempest-ProjectReaderTests-1606856988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:10:59 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-88865d45-4e21-46b2-8453-c1042e5d0a7e tempest-ProjectReaderTests-1606856988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:10:59 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-88865d45-4e21-46b2-8453-c1042e5d0a7e tempest-ProjectReaderTests-1606856988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:10:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-88865d45-4e21-46b2-8453-c1042e5d0a7e tempest-ProjectReaderTests-1606856988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:10:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-88865d45-4e21-46b2-8453-c1042e5d0a7e tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:10:59 devstack sudo[109805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:10:59 devstack sudo[109805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:10:59 devstack sudo[109805]: pam_unix(sudo:session): session closed for user root Jul 30 17:10:59 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-88865d45-4e21-46b2-8453-c1042e5d0a7e tempest-ProjectReaderTests-1606856988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.257s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:10:59 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-88865d45-4e21-46b2-8453-c1042e5d0a7e tempest-ProjectReaderTests-1606856988 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:10:59 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-88865d45-4e21-46b2-8453-c1042e5d0a7e tempest-ProjectReaderTests-1606856988 None] Deleted volume successfully. Jul 30 17:10:59 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-88865d45-4e21-46b2-8453-c1042e5d0a7e tempest-ProjectReaderTests-1606856988 None] Lock "cinder-c68278d6-10e7-4b0f-a8cd-4c28847b1d5a-delete_volume" released by "delete_volume" :: held 1.097s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:00 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e5591a2-fd11-4104-bcc0-a38c5a32eb2b tempest-ProjectReaderTests-1606856988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:11:00 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3e5591a2-fd11-4104-bcc0-a38c5a32eb2b tempest-ProjectReaderTests-1606856988 None] Flow 'volume_create_manager' (73700155-3927-463e-a7fd-12f4fe2b35bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:11:00 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3e5591a2-fd11-4104-bcc0-a38c5a32eb2b tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbfbeb7f-a562-44f0-a11e-9bd09c9ada37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:00 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3e5591a2-fd11-4104-bcc0-a38c5a32eb2b tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbfbeb7f-a562-44f0-a11e-9bd09c9ada37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:11:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-647412065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=459c2b2c-8cde-4275-9111-8f5bef29f052,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f482a6a4b7864a8285af84b12a4c0ba7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:11:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:11:00Z,use_quota=True,user_id='6e6b52d8637b4f35b11882b9c0ef86cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:00 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3e5591a2-fd11-4104-bcc0-a38c5a32eb2b tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d8bd259-0ac7-4e1e-a871-431b493ae698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:00 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3e5591a2-fd11-4104-bcc0-a38c5a32eb2b tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d8bd259-0ac7-4e1e-a871-431b493ae698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:00 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3e5591a2-fd11-4104-bcc0-a38c5a32eb2b tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fa625ca-67ef-44da-a370-37b03860a54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:00 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3e5591a2-fd11-4104-bcc0-a38c5a32eb2b tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fa625ca-67ef-44da-a370-37b03860a54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '459c2b2c-8cde-4275-9111-8f5bef29f052', 'volume_name': 'volume-459c2b2c-8cde-4275-9111-8f5bef29f052', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:00 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3e5591a2-fd11-4104-bcc0-a38c5a32eb2b tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c14b356-825c-4f83-ac9d-7b038c149113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:00 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3e5591a2-fd11-4104-bcc0-a38c5a32eb2b tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c14b356-825c-4f83-ac9d-7b038c149113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:00 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3e5591a2-fd11-4104-bcc0-a38c5a32eb2b tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77fe21f2-bdc1-4ed6-8457-0ade8125763a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:00 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-3e5591a2-fd11-4104-bcc0-a38c5a32eb2b tempest-ProjectReaderTests-1606856988 None] Volume 459c2b2c-8cde-4275-9111-8f5bef29f052: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-459c2b2c-8cde-4275-9111-8f5bef29f052', 'volume_size': 1} Jul 30 17:11:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3e5591a2-fd11-4104-bcc0-a38c5a32eb2b tempest-ProjectReaderTests-1606856988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3e5591a2-fd11-4104-bcc0-a38c5a32eb2b tempest-ProjectReaderTests-1606856988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:00 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-3e5591a2-fd11-4104-bcc0-a38c5a32eb2b tempest-ProjectReaderTests-1606856988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:11:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-647412065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=459c2b2c-8cde-4275-9111-8f5bef29f052,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f482a6a4b7864a8285af84b12a4c0ba7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:11:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:11:00Z,use_quota=True,user_id='6e6b52d8637b4f35b11882b9c0ef86cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:11:00 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-3e5591a2-fd11-4104-bcc0-a38c5a32eb2b tempest-ProjectReaderTests-1606856988 None] Creating volume 459c2b2c-8cde-4275-9111-8f5bef29f052 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:11:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3e5591a2-fd11-4104-bcc0-a38c5a32eb2b tempest-ProjectReaderTests-1606856988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3e5591a2-fd11-4104-bcc0-a38c5a32eb2b tempest-ProjectReaderTests-1606856988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:00 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-3e5591a2-fd11-4104-bcc0-a38c5a32eb2b tempest-ProjectReaderTests-1606856988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:11:00 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-3e5591a2-fd11-4104-bcc0-a38c5a32eb2b tempest-ProjectReaderTests-1606856988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:11:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3e5591a2-fd11-4104-bcc0-a38c5a32eb2b tempest-ProjectReaderTests-1606856988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:00 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-3e5591a2-fd11-4104-bcc0-a38c5a32eb2b tempest-ProjectReaderTests-1606856988 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:11:00 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-3e5591a2-fd11-4104-bcc0-a38c5a32eb2b tempest-ProjectReaderTests-1606856988 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:11:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3e5591a2-fd11-4104-bcc0-a38c5a32eb2b tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-459c2b2c-8cde-4275-9111-8f5bef29f052 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:00 devstack sudo[109808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-459c2b2c-8cde-4275-9111-8f5bef29f052 1073741824 Jul 30 17:11:00 devstack sudo[109808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:00 devstack sudo[109808]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3e5591a2-fd11-4104-bcc0-a38c5a32eb2b tempest-ProjectReaderTests-1606856988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-459c2b2c-8cde-4275-9111-8f5bef29f052 1073741824" returned: 0 in 0.401s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:00 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3e5591a2-fd11-4104-bcc0-a38c5a32eb2b tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-459c2b2c-8cde-4275-9111-8f5bef29f052 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:00 devstack sudo[109813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-459c2b2c-8cde-4275-9111-8f5bef29f052 Jul 30 17:11:00 devstack sudo[109813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:01 devstack sudo[109813]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-3e5591a2-fd11-4104-bcc0-a38c5a32eb2b tempest-ProjectReaderTests-1606856988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-459c2b2c-8cde-4275-9111-8f5bef29f052" returned: 0 in 0.242s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:01 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-3e5591a2-fd11-4104-bcc0-a38c5a32eb2b tempest-ProjectReaderTests-1606856988 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:11:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-3e5591a2-fd11-4104-bcc0-a38c5a32eb2b tempest-ProjectReaderTests-1606856988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3e5591a2-fd11-4104-bcc0-a38c5a32eb2b tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77fe21f2-bdc1-4ed6-8457-0ade8125763a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-459c2b2c-8cde-4275-9111-8f5bef29f052', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3e5591a2-fd11-4104-bcc0-a38c5a32eb2b tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (198ef47f-47b2-47d5-995c-6452248d067b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:01 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-3e5591a2-fd11-4104-bcc0-a38c5a32eb2b tempest-ProjectReaderTests-1606856988 None] Volume volume-459c2b2c-8cde-4275-9111-8f5bef29f052 (459c2b2c-8cde-4275-9111-8f5bef29f052): created successfully Jul 30 17:11:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3e5591a2-fd11-4104-bcc0-a38c5a32eb2b tempest-ProjectReaderTests-1606856988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (198ef47f-47b2-47d5-995c-6452248d067b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:01 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-3e5591a2-fd11-4104-bcc0-a38c5a32eb2b tempest-ProjectReaderTests-1606856988 None] Flow 'volume_create_manager' (73700155-3927-463e-a7fd-12f4fe2b35bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:11:01 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-3e5591a2-fd11-4104-bcc0-a38c5a32eb2b tempest-ProjectReaderTests-1606856988 None] Created volume successfully. Jul 30 17:11:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-e1f088d7-7c7c-4806-b135-87c9258546cc tempest-ProjectReaderTests-1606856988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-e1f088d7-7c7c-4806-b135-87c9258546cc tempest-ProjectReaderTests-1606856988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:01 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-e1f088d7-7c7c-4806-b135-87c9258546cc tempest-ProjectReaderTests-1606856988 None] Creating offline snapshot bced1725-58b7-43ec-8e1a-a51ac0b06c07 of volume 459c2b2c-8cde-4275-9111-8f5bef29f052 {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:11:01 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9cc019-0e27-48ab-b323-e4eb8c5a622f]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e1f088d7-7c7c-4806-b135-87c9258546cc tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-459c2b2c-8cde-4275-9111-8f5bef29f052 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:01 devstack sudo[109816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-459c2b2c-8cde-4275-9111-8f5bef29f052 Jul 30 17:11:01 devstack sudo[109816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:01 devstack sudo[109816]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e1f088d7-7c7c-4806-b135-87c9258546cc tempest-ProjectReaderTests-1606856988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-459c2b2c-8cde-4275-9111-8f5bef29f052" returned: 0 in 0.346s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:01 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e1f088d7-7c7c-4806-b135-87c9258546cc tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-459c2b2c-8cde-4275-9111-8f5bef29f052,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-459c2b2c-8cde-4275-9111-8f5bef29f052.bced1725-58b7-43ec-8e1a-a51ac0b06c07 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:01 devstack sudo[109821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-459c2b2c-8cde-4275-9111-8f5bef29f052,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-459c2b2c-8cde-4275-9111-8f5bef29f052.bced1725-58b7-43ec-8e1a-a51ac0b06c07 1G Jul 30 17:11:01 devstack sudo[109821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:02 devstack sudo[109821]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e1f088d7-7c7c-4806-b135-87c9258546cc tempest-ProjectReaderTests-1606856988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-459c2b2c-8cde-4275-9111-8f5bef29f052,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-459c2b2c-8cde-4275-9111-8f5bef29f052.bced1725-58b7-43ec-8e1a-a51ac0b06c07 1G" returned: 0 in 0.381s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e1f088d7-7c7c-4806-b135-87c9258546cc tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-459c2b2c-8cde-4275-9111-8f5bef29f052 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-459c2b2c-8cde-4275-9111-8f5bef29f052.bced1725-58b7-43ec-8e1a-a51ac0b06c07 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:02 devstack sudo[109827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-459c2b2c-8cde-4275-9111-8f5bef29f052 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-459c2b2c-8cde-4275-9111-8f5bef29f052.bced1725-58b7-43ec-8e1a-a51ac0b06c07 Jul 30 17:11:02 devstack sudo[109827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:02 devstack sudo[109827]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e1f088d7-7c7c-4806-b135-87c9258546cc tempest-ProjectReaderTests-1606856988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-459c2b2c-8cde-4275-9111-8f5bef29f052 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-459c2b2c-8cde-4275-9111-8f5bef29f052.bced1725-58b7-43ec-8e1a-a51ac0b06c07" returned: 0 in 0.290s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:02 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-e1f088d7-7c7c-4806-b135-87c9258546cc tempest-ProjectReaderTests-1606856988 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-459c2b2c-8cde-4275-9111-8f5bef29f052.bced1725-58b7-43ec-8e1a-a51ac0b06c07 is being set with open permissions: ugo+rw Jul 30 17:11:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e1f088d7-7c7c-4806-b135-87c9258546cc tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-459c2b2c-8cde-4275-9111-8f5bef29f052.bced1725-58b7-43ec-8e1a-a51ac0b06c07 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:02 devstack sudo[109833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-459c2b2c-8cde-4275-9111-8f5bef29f052.bced1725-58b7-43ec-8e1a-a51ac0b06c07 Jul 30 17:11:02 devstack sudo[109833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:02 devstack sudo[109833]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e1f088d7-7c7c-4806-b135-87c9258546cc tempest-ProjectReaderTests-1606856988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-459c2b2c-8cde-4275-9111-8f5bef29f052.bced1725-58b7-43ec-8e1a-a51ac0b06c07" returned: 0 in 0.248s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:02 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e1f088d7-7c7c-4806-b135-87c9258546cc tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-459c2b2c-8cde-4275-9111-8f5bef29f052.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:02 devstack sudo[109837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-459c2b2c-8cde-4275-9111-8f5bef29f052.info Jul 30 17:11:02 devstack sudo[109837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:03 devstack sudo[109837]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e1f088d7-7c7c-4806-b135-87c9258546cc tempest-ProjectReaderTests-1606856988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-459c2b2c-8cde-4275-9111-8f5bef29f052.info" returned: 0 in 0.255s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:03 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-e1f088d7-7c7c-4806-b135-87c9258546cc tempest-ProjectReaderTests-1606856988 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-459c2b2c-8cde-4275-9111-8f5bef29f052.info is being set with open permissions: ugo+rw Jul 30 17:11:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e1f088d7-7c7c-4806-b135-87c9258546cc tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-459c2b2c-8cde-4275-9111-8f5bef29f052.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:03 devstack sudo[109840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-459c2b2c-8cde-4275-9111-8f5bef29f052.info Jul 30 17:11:03 devstack sudo[109840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:03 devstack sudo[109840]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e1f088d7-7c7c-4806-b135-87c9258546cc tempest-ProjectReaderTests-1606856988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-459c2b2c-8cde-4275-9111-8f5bef29f052.info" returned: 0 in 0.247s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-e1f088d7-7c7c-4806-b135-87c9258546cc tempest-ProjectReaderTests-1606856988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.850s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:03 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-e1f088d7-7c7c-4806-b135-87c9258546cc tempest-ProjectReaderTests-1606856988 None] Create snapshot completed successfully Jul 30 17:11:03 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7de0992c-a36e-4d98-9cfe-3feaaef02979 tempest-ProjectReaderTests-1606856988 None] Acquiring lock "cinder-bced1725-58b7-43ec-8e1a-a51ac0b06c07-delete_snapshot" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:03 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7de0992c-a36e-4d98-9cfe-3feaaef02979 tempest-ProjectReaderTests-1606856988 None] Lock "cinder-bced1725-58b7-43ec-8e1a-a51ac0b06c07-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:03 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7de0992c-a36e-4d98-9cfe-3feaaef02979 tempest-ProjectReaderTests-1606856988 None] Acquiring lock "cinder-quobyte-459c2b2c-8cde-4275-9111-8f5bef29f052" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:03 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7de0992c-a36e-4d98-9cfe-3feaaef02979 tempest-ProjectReaderTests-1606856988 None] Lock "cinder-quobyte-459c2b2c-8cde-4275-9111-8f5bef29f052" acquired by "delete_snapshot" :: waited 0.013s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:03 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7de0992c-a36e-4d98-9cfe-3feaaef02979 tempest-ProjectReaderTests-1606856988 None] Acquiring lock "cinder-quobyte-bced1725-58b7-43ec-8e1a-a51ac0b06c07" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:03 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7de0992c-a36e-4d98-9cfe-3feaaef02979 tempest-ProjectReaderTests-1606856988 None] Lock "cinder-quobyte-bced1725-58b7-43ec-8e1a-a51ac0b06c07" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:03 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-7de0992c-a36e-4d98-9cfe-3feaaef02979 tempest-ProjectReaderTests-1606856988 None] Deleting offline snapshot bced1725-58b7-43ec-8e1a-a51ac0b06c07 of volume 459c2b2c-8cde-4275-9111-8f5bef29f052 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:11:03 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-7de0992c-a36e-4d98-9cfe-3feaaef02979 tempest-ProjectReaderTests-1606856988 None] snapshot_file for this snap is: volume-459c2b2c-8cde-4275-9111-8f5bef29f052.bced1725-58b7-43ec-8e1a-a51ac0b06c07 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:11:03 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ff86d8-0f70-4319-81d4-8bd1d1157f2c]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:03 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7de0992c-a36e-4d98-9cfe-3feaaef02979 tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-459c2b2c-8cde-4275-9111-8f5bef29f052.bced1725-58b7-43ec-8e1a-a51ac0b06c07 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:03 devstack sudo[109843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-459c2b2c-8cde-4275-9111-8f5bef29f052.bced1725-58b7-43ec-8e1a-a51ac0b06c07 Jul 30 17:11:03 devstack sudo[109843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:04 devstack sudo[109843]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7de0992c-a36e-4d98-9cfe-3feaaef02979 tempest-ProjectReaderTests-1606856988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-459c2b2c-8cde-4275-9111-8f5bef29f052.bced1725-58b7-43ec-8e1a-a51ac0b06c07" returned: 0 in 0.351s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:04 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-7de0992c-a36e-4d98-9cfe-3feaaef02979 tempest-ProjectReaderTests-1606856988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-459c2b2c-8cde-4275-9111-8f5bef29f052(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:11:04 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[c778bf4e-3b31-425f-8d68-a0c3ddd423ad]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7de0992c-a36e-4d98-9cfe-3feaaef02979 tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-459c2b2c-8cde-4275-9111-8f5bef29f052 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:04 devstack sudo[109848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-459c2b2c-8cde-4275-9111-8f5bef29f052 Jul 30 17:11:04 devstack sudo[109848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:04 devstack sudo[109848]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7de0992c-a36e-4d98-9cfe-3feaaef02979 tempest-ProjectReaderTests-1606856988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-459c2b2c-8cde-4275-9111-8f5bef29f052" returned: 0 in 0.341s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7de0992c-a36e-4d98-9cfe-3feaaef02979 tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-459c2b2c-8cde-4275-9111-8f5bef29f052.bced1725-58b7-43ec-8e1a-a51ac0b06c07 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:04 devstack sudo[109853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-459c2b2c-8cde-4275-9111-8f5bef29f052.bced1725-58b7-43ec-8e1a-a51ac0b06c07 Jul 30 17:11:04 devstack sudo[109853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:04 devstack sudo[109853]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7de0992c-a36e-4d98-9cfe-3feaaef02979 tempest-ProjectReaderTests-1606856988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-459c2b2c-8cde-4275-9111-8f5bef29f052.bced1725-58b7-43ec-8e1a-a51ac0b06c07" returned: 0 in 0.330s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:04 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7de0992c-a36e-4d98-9cfe-3feaaef02979 tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-459c2b2c-8cde-4275-9111-8f5bef29f052.bced1725-58b7-43ec-8e1a-a51ac0b06c07 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:04 devstack sudo[109858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-459c2b2c-8cde-4275-9111-8f5bef29f052.bced1725-58b7-43ec-8e1a-a51ac0b06c07 Jul 30 17:11:04 devstack sudo[109858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:05 devstack sudo[109858]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7de0992c-a36e-4d98-9cfe-3feaaef02979 tempest-ProjectReaderTests-1606856988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-459c2b2c-8cde-4275-9111-8f5bef29f052.bced1725-58b7-43ec-8e1a-a51ac0b06c07" returned: 0 in 0.245s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:05 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7de0992c-a36e-4d98-9cfe-3feaaef02979 tempest-ProjectReaderTests-1606856988 None] Lock "cinder-quobyte-bced1725-58b7-43ec-8e1a-a51ac0b06c07" released by "_delete_snapshot" :: held 1.353s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:05 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7de0992c-a36e-4d98-9cfe-3feaaef02979 tempest-ProjectReaderTests-1606856988 None] Lock "cinder-quobyte-459c2b2c-8cde-4275-9111-8f5bef29f052" released by "delete_snapshot" :: held 1.372s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:05 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-7de0992c-a36e-4d98-9cfe-3feaaef02979 tempest-ProjectReaderTests-1606856988 None] Created reservations ['3f0ca69c-32cf-4c70-8d12-3951269373de', 'dbe04e1c-cef0-42ae-821d-641e726343ba', 'b3664938-67f6-4a9c-b8a8-9e5a0e1cb8bd', '4d008aa5-5cbd-47e0-a4f8-d906a641f3a0'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:11:05 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-7de0992c-a36e-4d98-9cfe-3feaaef02979 tempest-ProjectReaderTests-1606856988 None] Delete snapshot completed successfully. Jul 30 17:11:05 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7de0992c-a36e-4d98-9cfe-3feaaef02979 tempest-ProjectReaderTests-1606856988 None] Lock "cinder-bced1725-58b7-43ec-8e1a-a51ac0b06c07-delete_snapshot" released by "delete_snapshot" :: held 1.490s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:05 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7c5f3028-e83b-4ea1-8c6c-4c9dd52bcd44 tempest-ProjectReaderTests-1606856988 None] Acquiring lock "cinder-459c2b2c-8cde-4275-9111-8f5bef29f052-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:05 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7c5f3028-e83b-4ea1-8c6c-4c9dd52bcd44 tempest-ProjectReaderTests-1606856988 None] Lock "cinder-459c2b2c-8cde-4275-9111-8f5bef29f052-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:05 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7c5f3028-e83b-4ea1-8c6c-4c9dd52bcd44 tempest-ProjectReaderTests-1606856988 None] Acquiring lock "cinder-quobyte-459c2b2c-8cde-4275-9111-8f5bef29f052" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:05 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7c5f3028-e83b-4ea1-8c6c-4c9dd52bcd44 tempest-ProjectReaderTests-1606856988 None] Lock "cinder-quobyte-459c2b2c-8cde-4275-9111-8f5bef29f052" acquired by "delete_volume" :: waited 0.020s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:05 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca529848-7ea1-46ea-bfe8-c3f61bc253b4]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:05 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7c5f3028-e83b-4ea1-8c6c-4c9dd52bcd44 tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-459c2b2c-8cde-4275-9111-8f5bef29f052 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:06 devstack sudo[109861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-459c2b2c-8cde-4275-9111-8f5bef29f052 Jul 30 17:11:06 devstack sudo[109861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:06 devstack sudo[109861]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7c5f3028-e83b-4ea1-8c6c-4c9dd52bcd44 tempest-ProjectReaderTests-1606856988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-459c2b2c-8cde-4275-9111-8f5bef29f052" returned: 0 in 0.340s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7c5f3028-e83b-4ea1-8c6c-4c9dd52bcd44 tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-459c2b2c-8cde-4275-9111-8f5bef29f052 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:06 devstack sudo[109866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-459c2b2c-8cde-4275-9111-8f5bef29f052 Jul 30 17:11:06 devstack sudo[109866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:06 devstack sudo[109866]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7c5f3028-e83b-4ea1-8c6c-4c9dd52bcd44 tempest-ProjectReaderTests-1606856988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-459c2b2c-8cde-4275-9111-8f5bef29f052" returned: 0 in 0.241s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:06 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7c5f3028-e83b-4ea1-8c6c-4c9dd52bcd44 tempest-ProjectReaderTests-1606856988 None] Lock "cinder-quobyte-459c2b2c-8cde-4275-9111-8f5bef29f052" released by "delete_volume" :: held 0.633s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:06 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-7c5f3028-e83b-4ea1-8c6c-4c9dd52bcd44 tempest-ProjectReaderTests-1606856988 None] Created reservations ['a3d97e21-3b27-4f00-a210-da6386dc1e04', 'f30c7fee-1dcb-471b-a49b-284505b3155c', '153821ba-72c0-4d9d-9794-2e33fed08ed5', 'fa34f599-f31f-41a7-b75d-6411b832cf4f'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:11:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7c5f3028-e83b-4ea1-8c6c-4c9dd52bcd44 tempest-ProjectReaderTests-1606856988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7c5f3028-e83b-4ea1-8c6c-4c9dd52bcd44 tempest-ProjectReaderTests-1606856988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:06 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7c5f3028-e83b-4ea1-8c6c-4c9dd52bcd44 tempest-ProjectReaderTests-1606856988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:11:06 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-7c5f3028-e83b-4ea1-8c6c-4c9dd52bcd44 tempest-ProjectReaderTests-1606856988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:11:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-7c5f3028-e83b-4ea1-8c6c-4c9dd52bcd44 tempest-ProjectReaderTests-1606856988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7c5f3028-e83b-4ea1-8c6c-4c9dd52bcd44 tempest-ProjectReaderTests-1606856988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:06 devstack sudo[109869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:11:06 devstack sudo[109869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:06 devstack sudo[109869]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-7c5f3028-e83b-4ea1-8c6c-4c9dd52bcd44 tempest-ProjectReaderTests-1606856988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.238s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:06 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-7c5f3028-e83b-4ea1-8c6c-4c9dd52bcd44 tempest-ProjectReaderTests-1606856988 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:11:06 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-7c5f3028-e83b-4ea1-8c6c-4c9dd52bcd44 tempest-ProjectReaderTests-1606856988 None] Deleted volume successfully. Jul 30 17:11:06 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-7c5f3028-e83b-4ea1-8c6c-4c9dd52bcd44 tempest-ProjectReaderTests-1606856988 None] Lock "cinder-459c2b2c-8cde-4275-9111-8f5bef29f052-delete_volume" released by "delete_volume" :: held 1.069s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:12 devstack cinder-volume[88591]: DEBUG oslo_service.periodic_task [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 17:11:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:11:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:11:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:12 devstack sudo[109873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:11:12 devstack sudo[109873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:12 devstack sudo[109873]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.268s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:12 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:11:12 devstack cinder-volume[88591]: DEBUG oslo_service.periodic_task [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running periodic task VolumeManager._thread_info {{(pid=88591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 17:11:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] thread count: 28 {{(pid=88591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 17:11:12 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] thread info: [<_MainThread(MainThread, started 140677178003584)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 17:11:16 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:SELECT=101,cinder:INSERT=37,cinder:UPDATE=138,cinder:DELETE=12 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:11:16 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:SELECT=112,cinder:INSERT=41,cinder:UPDATE=141,cinder:DELETE=10 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:11:17 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc6c6dba-ac57-4f22-b5c1-ccf03cd2dea1 tempest-ProjectReaderTests-447638661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:11:18 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bc6c6dba-ac57-4f22-b5c1-ccf03cd2dea1 tempest-ProjectReaderTests-447638661 None] Flow 'volume_create_manager' (2188ba87-474b-40e8-afa7-75e594246d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:11:18 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bc6c6dba-ac57-4f22-b5c1-ccf03cd2dea1 tempest-ProjectReaderTests-447638661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8b8797b-d137-45a9-a51c-c9151db6dc58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:18 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bc6c6dba-ac57-4f22-b5c1-ccf03cd2dea1 tempest-ProjectReaderTests-447638661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8b8797b-d137-45a9-a51c-c9151db6dc58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-973579075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92e2e668-7a45-49e8-8212-871e415fa14f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5f5b4a69d3a4808a62ea98aeffddc22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:11:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:11:18Z,use_quota=True,user_id='e64758306a6a44c4ae7651a20885b87f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:18 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bc6c6dba-ac57-4f22-b5c1-ccf03cd2dea1 tempest-ProjectReaderTests-447638661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93b6aa0b-f311-4361-8331-aca8aee0bbf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:18 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bc6c6dba-ac57-4f22-b5c1-ccf03cd2dea1 tempest-ProjectReaderTests-447638661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93b6aa0b-f311-4361-8331-aca8aee0bbf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:18 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bc6c6dba-ac57-4f22-b5c1-ccf03cd2dea1 tempest-ProjectReaderTests-447638661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3a38b88-21da-40b3-acee-668bdd3128f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:18 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bc6c6dba-ac57-4f22-b5c1-ccf03cd2dea1 tempest-ProjectReaderTests-447638661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3a38b88-21da-40b3-acee-668bdd3128f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92e2e668-7a45-49e8-8212-871e415fa14f', 'volume_name': 'volume-92e2e668-7a45-49e8-8212-871e415fa14f', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:18 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bc6c6dba-ac57-4f22-b5c1-ccf03cd2dea1 tempest-ProjectReaderTests-447638661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28c69936-d84d-4750-8c34-245e766997a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:18 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bc6c6dba-ac57-4f22-b5c1-ccf03cd2dea1 tempest-ProjectReaderTests-447638661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28c69936-d84d-4750-8c34-245e766997a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:18 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bc6c6dba-ac57-4f22-b5c1-ccf03cd2dea1 tempest-ProjectReaderTests-447638661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f5fdd23-268b-40f2-a9f9-f8b52c683bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:18 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-bc6c6dba-ac57-4f22-b5c1-ccf03cd2dea1 tempest-ProjectReaderTests-447638661 None] Volume 92e2e668-7a45-49e8-8212-871e415fa14f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92e2e668-7a45-49e8-8212-871e415fa14f', 'volume_size': 1} Jul 30 17:11:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-bc6c6dba-ac57-4f22-b5c1-ccf03cd2dea1 tempest-ProjectReaderTests-447638661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-bc6c6dba-ac57-4f22-b5c1-ccf03cd2dea1 tempest-ProjectReaderTests-447638661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:18 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-bc6c6dba-ac57-4f22-b5c1-ccf03cd2dea1 tempest-ProjectReaderTests-447638661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-973579075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92e2e668-7a45-49e8-8212-871e415fa14f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5f5b4a69d3a4808a62ea98aeffddc22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:11:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:11:18Z,use_quota=True,user_id='e64758306a6a44c4ae7651a20885b87f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:11:18 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-bc6c6dba-ac57-4f22-b5c1-ccf03cd2dea1 tempest-ProjectReaderTests-447638661 None] Creating volume 92e2e668-7a45-49e8-8212-871e415fa14f {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:11:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-bc6c6dba-ac57-4f22-b5c1-ccf03cd2dea1 tempest-ProjectReaderTests-447638661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-bc6c6dba-ac57-4f22-b5c1-ccf03cd2dea1 tempest-ProjectReaderTests-447638661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:18 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-bc6c6dba-ac57-4f22-b5c1-ccf03cd2dea1 tempest-ProjectReaderTests-447638661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:11:18 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-bc6c6dba-ac57-4f22-b5c1-ccf03cd2dea1 tempest-ProjectReaderTests-447638661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:11:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-bc6c6dba-ac57-4f22-b5c1-ccf03cd2dea1 tempest-ProjectReaderTests-447638661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:18 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-bc6c6dba-ac57-4f22-b5c1-ccf03cd2dea1 tempest-ProjectReaderTests-447638661 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:11:18 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-bc6c6dba-ac57-4f22-b5c1-ccf03cd2dea1 tempest-ProjectReaderTests-447638661 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:11:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bc6c6dba-ac57-4f22-b5c1-ccf03cd2dea1 tempest-ProjectReaderTests-447638661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-92e2e668-7a45-49e8-8212-871e415fa14f 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:18 devstack sudo[109877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-92e2e668-7a45-49e8-8212-871e415fa14f 1073741824 Jul 30 17:11:18 devstack sudo[109877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:18 devstack sudo[109877]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bc6c6dba-ac57-4f22-b5c1-ccf03cd2dea1 tempest-ProjectReaderTests-447638661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-92e2e668-7a45-49e8-8212-871e415fa14f 1073741824" returned: 0 in 0.410s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bc6c6dba-ac57-4f22-b5c1-ccf03cd2dea1 tempest-ProjectReaderTests-447638661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-92e2e668-7a45-49e8-8212-871e415fa14f {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:18 devstack sudo[109882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-92e2e668-7a45-49e8-8212-871e415fa14f Jul 30 17:11:18 devstack sudo[109882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:18 devstack sudo[109882]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bc6c6dba-ac57-4f22-b5c1-ccf03cd2dea1 tempest-ProjectReaderTests-447638661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-92e2e668-7a45-49e8-8212-871e415fa14f" returned: 0 in 0.243s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:18 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-bc6c6dba-ac57-4f22-b5c1-ccf03cd2dea1 tempest-ProjectReaderTests-447638661 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:11:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-bc6c6dba-ac57-4f22-b5c1-ccf03cd2dea1 tempest-ProjectReaderTests-447638661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:18 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bc6c6dba-ac57-4f22-b5c1-ccf03cd2dea1 tempest-ProjectReaderTests-447638661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f5fdd23-268b-40f2-a9f9-f8b52c683bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92e2e668-7a45-49e8-8212-871e415fa14f', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:18 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bc6c6dba-ac57-4f22-b5c1-ccf03cd2dea1 tempest-ProjectReaderTests-447638661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4215670e-74c0-41bd-96e9-b6620d4a1d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:18 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-bc6c6dba-ac57-4f22-b5c1-ccf03cd2dea1 tempest-ProjectReaderTests-447638661 None] Volume volume-92e2e668-7a45-49e8-8212-871e415fa14f (92e2e668-7a45-49e8-8212-871e415fa14f): created successfully Jul 30 17:11:18 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bc6c6dba-ac57-4f22-b5c1-ccf03cd2dea1 tempest-ProjectReaderTests-447638661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4215670e-74c0-41bd-96e9-b6620d4a1d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:18 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-bc6c6dba-ac57-4f22-b5c1-ccf03cd2dea1 tempest-ProjectReaderTests-447638661 None] Flow 'volume_create_manager' (2188ba87-474b-40e8-afa7-75e594246d5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:11:18 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-bc6c6dba-ac57-4f22-b5c1-ccf03cd2dea1 tempest-ProjectReaderTests-447638661 None] Created volume successfully. Jul 30 17:11:19 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-bf1f27f0-e663-4f99-a9f2-3bfc2661225b tempest-ProjectReaderTests-447638661 None] Acquiring lock "cinder-92e2e668-7a45-49e8-8212-871e415fa14f-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:19 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-bf1f27f0-e663-4f99-a9f2-3bfc2661225b tempest-ProjectReaderTests-447638661 None] Lock "cinder-92e2e668-7a45-49e8-8212-871e415fa14f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:19 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-bf1f27f0-e663-4f99-a9f2-3bfc2661225b tempest-ProjectReaderTests-447638661 None] Acquiring lock "cinder-quobyte-92e2e668-7a45-49e8-8212-871e415fa14f" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:19 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-bf1f27f0-e663-4f99-a9f2-3bfc2661225b tempest-ProjectReaderTests-447638661 None] Lock "cinder-quobyte-92e2e668-7a45-49e8-8212-871e415fa14f" acquired by "delete_volume" :: waited 0.014s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:19 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5e4cab-16f4-4b60-9c66-2660346ca358]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bf1f27f0-e663-4f99-a9f2-3bfc2661225b tempest-ProjectReaderTests-447638661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-92e2e668-7a45-49e8-8212-871e415fa14f {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:19 devstack sudo[109885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-92e2e668-7a45-49e8-8212-871e415fa14f Jul 30 17:11:19 devstack sudo[109885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:19 devstack sudo[109885]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bf1f27f0-e663-4f99-a9f2-3bfc2661225b tempest-ProjectReaderTests-447638661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-92e2e668-7a45-49e8-8212-871e415fa14f" returned: 0 in 0.346s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bf1f27f0-e663-4f99-a9f2-3bfc2661225b tempest-ProjectReaderTests-447638661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-92e2e668-7a45-49e8-8212-871e415fa14f {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:19 devstack sudo[109890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-92e2e668-7a45-49e8-8212-871e415fa14f Jul 30 17:11:19 devstack sudo[109890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:19 devstack sudo[109890]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bf1f27f0-e663-4f99-a9f2-3bfc2661225b tempest-ProjectReaderTests-447638661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-92e2e668-7a45-49e8-8212-871e415fa14f" returned: 0 in 0.256s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:19 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-bf1f27f0-e663-4f99-a9f2-3bfc2661225b tempest-ProjectReaderTests-447638661 None] Lock "cinder-quobyte-92e2e668-7a45-49e8-8212-871e415fa14f" released by "delete_volume" :: held 0.639s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:19 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-bf1f27f0-e663-4f99-a9f2-3bfc2661225b tempest-ProjectReaderTests-447638661 None] Created reservations ['cfb608d2-0a68-4acd-9cca-307e48a11445', '43de6035-4daa-401d-b3f7-7b2291777042', '81960c94-3313-43c0-850f-eb6f7f9aafd8', '90153d4c-7b6a-4746-8a46-16e833342dea'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:11:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-bf1f27f0-e663-4f99-a9f2-3bfc2661225b tempest-ProjectReaderTests-447638661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-bf1f27f0-e663-4f99-a9f2-3bfc2661225b tempest-ProjectReaderTests-447638661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:19 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-bf1f27f0-e663-4f99-a9f2-3bfc2661225b tempest-ProjectReaderTests-447638661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:11:19 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-bf1f27f0-e663-4f99-a9f2-3bfc2661225b tempest-ProjectReaderTests-447638661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:11:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-bf1f27f0-e663-4f99-a9f2-3bfc2661225b tempest-ProjectReaderTests-447638661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bf1f27f0-e663-4f99-a9f2-3bfc2661225b tempest-ProjectReaderTests-447638661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:20 devstack sudo[109893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:11:20 devstack sudo[109893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:20 devstack sudo[109893]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bf1f27f0-e663-4f99-a9f2-3bfc2661225b tempest-ProjectReaderTests-447638661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.231s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:20 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-bf1f27f0-e663-4f99-a9f2-3bfc2661225b tempest-ProjectReaderTests-447638661 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:11:20 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-bf1f27f0-e663-4f99-a9f2-3bfc2661225b tempest-ProjectReaderTests-447638661 None] Deleted volume successfully. Jul 30 17:11:20 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-bf1f27f0-e663-4f99-a9f2-3bfc2661225b tempest-ProjectReaderTests-447638661 None] Lock "cinder-92e2e668-7a45-49e8-8212-871e415fa14f-delete_volume" released by "delete_volume" :: held 1.069s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:20 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-05c424b5-9576-46c3-af4d-385ee3f2ed70 tempest-ProjectReaderTests-447638661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:11:20 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-05c424b5-9576-46c3-af4d-385ee3f2ed70 tempest-ProjectReaderTests-447638661 None] Flow 'volume_create_manager' (7c9718aa-a54d-45fe-b73f-45d4e84cc4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:11:20 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-05c424b5-9576-46c3-af4d-385ee3f2ed70 tempest-ProjectReaderTests-447638661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af31ba8f-a047-435f-9c8d-b890d7bd141d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:20 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-05c424b5-9576-46c3-af4d-385ee3f2ed70 tempest-ProjectReaderTests-447638661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af31ba8f-a047-435f-9c8d-b890d7bd141d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:11:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1555442619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8f6b820-01d8-4c5b-90e1-d932712b627e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5f5b4a69d3a4808a62ea98aeffddc22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:11:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:11:21Z,use_quota=True,user_id='e64758306a6a44c4ae7651a20885b87f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:20 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-05c424b5-9576-46c3-af4d-385ee3f2ed70 tempest-ProjectReaderTests-447638661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09a0753e-e930-4459-bd80-0a2ee626b5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:20 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-05c424b5-9576-46c3-af4d-385ee3f2ed70 tempest-ProjectReaderTests-447638661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09a0753e-e930-4459-bd80-0a2ee626b5e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:20 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-05c424b5-9576-46c3-af4d-385ee3f2ed70 tempest-ProjectReaderTests-447638661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (101c0f2f-84ad-4d16-ab0d-a171ca96b808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:20 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-05c424b5-9576-46c3-af4d-385ee3f2ed70 tempest-ProjectReaderTests-447638661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (101c0f2f-84ad-4d16-ab0d-a171ca96b808) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8f6b820-01d8-4c5b-90e1-d932712b627e', 'volume_name': 'volume-e8f6b820-01d8-4c5b-90e1-d932712b627e', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:20 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-05c424b5-9576-46c3-af4d-385ee3f2ed70 tempest-ProjectReaderTests-447638661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c80de793-78a0-474e-8cf8-03966ff26edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:20 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-05c424b5-9576-46c3-af4d-385ee3f2ed70 tempest-ProjectReaderTests-447638661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c80de793-78a0-474e-8cf8-03966ff26edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:20 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-05c424b5-9576-46c3-af4d-385ee3f2ed70 tempest-ProjectReaderTests-447638661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbd23292-1172-485f-9405-d0fb19163dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:20 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-05c424b5-9576-46c3-af4d-385ee3f2ed70 tempest-ProjectReaderTests-447638661 None] Volume e8f6b820-01d8-4c5b-90e1-d932712b627e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8f6b820-01d8-4c5b-90e1-d932712b627e', 'volume_size': 1} Jul 30 17:11:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-05c424b5-9576-46c3-af4d-385ee3f2ed70 tempest-ProjectReaderTests-447638661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-05c424b5-9576-46c3-af4d-385ee3f2ed70 tempest-ProjectReaderTests-447638661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:20 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-05c424b5-9576-46c3-af4d-385ee3f2ed70 tempest-ProjectReaderTests-447638661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:11:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1555442619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8f6b820-01d8-4c5b-90e1-d932712b627e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5f5b4a69d3a4808a62ea98aeffddc22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:11:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:11:21Z,use_quota=True,user_id='e64758306a6a44c4ae7651a20885b87f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:11:20 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-05c424b5-9576-46c3-af4d-385ee3f2ed70 tempest-ProjectReaderTests-447638661 None] Creating volume e8f6b820-01d8-4c5b-90e1-d932712b627e {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:11:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-05c424b5-9576-46c3-af4d-385ee3f2ed70 tempest-ProjectReaderTests-447638661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-05c424b5-9576-46c3-af4d-385ee3f2ed70 tempest-ProjectReaderTests-447638661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:20 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-05c424b5-9576-46c3-af4d-385ee3f2ed70 tempest-ProjectReaderTests-447638661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:11:20 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-05c424b5-9576-46c3-af4d-385ee3f2ed70 tempest-ProjectReaderTests-447638661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:11:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-05c424b5-9576-46c3-af4d-385ee3f2ed70 tempest-ProjectReaderTests-447638661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:20 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-05c424b5-9576-46c3-af4d-385ee3f2ed70 tempest-ProjectReaderTests-447638661 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:11:20 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-05c424b5-9576-46c3-af4d-385ee3f2ed70 tempest-ProjectReaderTests-447638661 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:11:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-05c424b5-9576-46c3-af4d-385ee3f2ed70 tempest-ProjectReaderTests-447638661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e8f6b820-01d8-4c5b-90e1-d932712b627e 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:20 devstack sudo[109896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e8f6b820-01d8-4c5b-90e1-d932712b627e 1073741824 Jul 30 17:11:20 devstack sudo[109896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:21 devstack sudo[109896]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-05c424b5-9576-46c3-af4d-385ee3f2ed70 tempest-ProjectReaderTests-447638661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e8f6b820-01d8-4c5b-90e1-d932712b627e 1073741824" returned: 0 in 0.418s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-05c424b5-9576-46c3-af4d-385ee3f2ed70 tempest-ProjectReaderTests-447638661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e8f6b820-01d8-4c5b-90e1-d932712b627e {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:21 devstack sudo[109901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e8f6b820-01d8-4c5b-90e1-d932712b627e Jul 30 17:11:21 devstack sudo[109901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:21 devstack sudo[109901]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-05c424b5-9576-46c3-af4d-385ee3f2ed70 tempest-ProjectReaderTests-447638661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e8f6b820-01d8-4c5b-90e1-d932712b627e" returned: 0 in 0.235s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:21 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-05c424b5-9576-46c3-af4d-385ee3f2ed70 tempest-ProjectReaderTests-447638661 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:11:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-05c424b5-9576-46c3-af4d-385ee3f2ed70 tempest-ProjectReaderTests-447638661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-05c424b5-9576-46c3-af4d-385ee3f2ed70 tempest-ProjectReaderTests-447638661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbd23292-1172-485f-9405-d0fb19163dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8f6b820-01d8-4c5b-90e1-d932712b627e', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-05c424b5-9576-46c3-af4d-385ee3f2ed70 tempest-ProjectReaderTests-447638661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (403f4cf9-2751-4684-979f-d7ea0f86d7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:21 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-05c424b5-9576-46c3-af4d-385ee3f2ed70 tempest-ProjectReaderTests-447638661 None] Volume volume-e8f6b820-01d8-4c5b-90e1-d932712b627e (e8f6b820-01d8-4c5b-90e1-d932712b627e): created successfully Jul 30 17:11:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-05c424b5-9576-46c3-af4d-385ee3f2ed70 tempest-ProjectReaderTests-447638661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (403f4cf9-2751-4684-979f-d7ea0f86d7f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:21 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-05c424b5-9576-46c3-af4d-385ee3f2ed70 tempest-ProjectReaderTests-447638661 None] Flow 'volume_create_manager' (7c9718aa-a54d-45fe-b73f-45d4e84cc4a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:11:21 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-05c424b5-9576-46c3-af4d-385ee3f2ed70 tempest-ProjectReaderTests-447638661 None] Created volume successfully. Jul 30 17:11:21 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c0d9bf50-8c7a-418e-8701-641b159ba7ad tempest-ProjectReaderTests-447638661 None] Acquiring lock "cinder-e8f6b820-01d8-4c5b-90e1-d932712b627e-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:21 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c0d9bf50-8c7a-418e-8701-641b159ba7ad tempest-ProjectReaderTests-447638661 None] Lock "cinder-e8f6b820-01d8-4c5b-90e1-d932712b627e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:21 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c0d9bf50-8c7a-418e-8701-641b159ba7ad tempest-ProjectReaderTests-447638661 None] Acquiring lock "cinder-quobyte-e8f6b820-01d8-4c5b-90e1-d932712b627e" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:21 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c0d9bf50-8c7a-418e-8701-641b159ba7ad tempest-ProjectReaderTests-447638661 None] Lock "cinder-quobyte-e8f6b820-01d8-4c5b-90e1-d932712b627e" acquired by "delete_volume" :: waited 0.015s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:21 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[3745450b-7f04-470f-accb-85884efbb3e7]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:21 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c0d9bf50-8c7a-418e-8701-641b159ba7ad tempest-ProjectReaderTests-447638661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e8f6b820-01d8-4c5b-90e1-d932712b627e {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:21 devstack sudo[109905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e8f6b820-01d8-4c5b-90e1-d932712b627e Jul 30 17:11:21 devstack sudo[109905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:22 devstack sudo[109905]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c0d9bf50-8c7a-418e-8701-641b159ba7ad tempest-ProjectReaderTests-447638661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e8f6b820-01d8-4c5b-90e1-d932712b627e" returned: 0 in 0.361s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c0d9bf50-8c7a-418e-8701-641b159ba7ad tempest-ProjectReaderTests-447638661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e8f6b820-01d8-4c5b-90e1-d932712b627e {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:22 devstack sudo[109911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e8f6b820-01d8-4c5b-90e1-d932712b627e Jul 30 17:11:22 devstack sudo[109911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:22 devstack sudo[109911]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c0d9bf50-8c7a-418e-8701-641b159ba7ad tempest-ProjectReaderTests-447638661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-e8f6b820-01d8-4c5b-90e1-d932712b627e" returned: 0 in 0.240s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:22 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c0d9bf50-8c7a-418e-8701-641b159ba7ad tempest-ProjectReaderTests-447638661 None] Lock "cinder-quobyte-e8f6b820-01d8-4c5b-90e1-d932712b627e" released by "delete_volume" :: held 0.640s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:22 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-c0d9bf50-8c7a-418e-8701-641b159ba7ad tempest-ProjectReaderTests-447638661 None] Created reservations ['1b9ecffa-17e6-4f66-9644-49a724a4c206', '3b95c175-3f7f-4ae9-ada2-3cf498679779', '54bbd9e5-fd1a-4cd6-b97e-eb39be57c365', '6dadc4d3-54e0-4fad-8bba-fbc3b32c8e1c'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:11:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c0d9bf50-8c7a-418e-8701-641b159ba7ad tempest-ProjectReaderTests-447638661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c0d9bf50-8c7a-418e-8701-641b159ba7ad tempest-ProjectReaderTests-447638661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:22 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-c0d9bf50-8c7a-418e-8701-641b159ba7ad tempest-ProjectReaderTests-447638661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:11:22 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-c0d9bf50-8c7a-418e-8701-641b159ba7ad tempest-ProjectReaderTests-447638661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:11:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-c0d9bf50-8c7a-418e-8701-641b159ba7ad tempest-ProjectReaderTests-447638661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c0d9bf50-8c7a-418e-8701-641b159ba7ad tempest-ProjectReaderTests-447638661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:22 devstack sudo[109915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:11:22 devstack sudo[109915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:22 devstack sudo[109915]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:22 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-c0d9bf50-8c7a-418e-8701-641b159ba7ad tempest-ProjectReaderTests-447638661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.243s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:22 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-c0d9bf50-8c7a-418e-8701-641b159ba7ad tempest-ProjectReaderTests-447638661 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:11:22 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-c0d9bf50-8c7a-418e-8701-641b159ba7ad tempest-ProjectReaderTests-447638661 None] Deleted volume successfully. Jul 30 17:11:22 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-c0d9bf50-8c7a-418e-8701-641b159ba7ad tempest-ProjectReaderTests-447638661 None] Lock "cinder-e8f6b820-01d8-4c5b-90e1-d932712b627e-delete_volume" released by "delete_volume" :: held 1.066s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:32 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:SELECT=14,cinder:INSERT=6,cinder:UPDATE=24,cinder:DELETE=1 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:11:32 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:SELECT=14,cinder:UPDATE=20,cinder:DELETE=3,cinder:INSERT=4 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:11:35 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-17e520a0-992c-4d92-862b-6ce0c84e90c4 tempest-ProjectReaderTests-476253096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:11:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-17e520a0-992c-4d92-862b-6ce0c84e90c4 tempest-ProjectReaderTests-476253096 None] Flow 'volume_create_manager' (10b457a6-68e1-4154-85ec-c2c63af98485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:11:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-17e520a0-992c-4d92-862b-6ce0c84e90c4 tempest-ProjectReaderTests-476253096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94582e37-d25d-43ba-990c-95428cf726c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-17e520a0-992c-4d92-862b-6ce0c84e90c4 tempest-ProjectReaderTests-476253096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94582e37-d25d-43ba-990c-95428cf726c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:11:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-623633377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af631f37-e610-42c5-8af6-7e086446b4c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32e31e48f3004ac4820737037cc4b894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:11:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:11:35Z,use_quota=True,user_id='92a70241768f43a68196b39ad1cba90a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-17e520a0-992c-4d92-862b-6ce0c84e90c4 tempest-ProjectReaderTests-476253096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d20894c-53f2-455a-ae68-8d53d3b567ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-17e520a0-992c-4d92-862b-6ce0c84e90c4 tempest-ProjectReaderTests-476253096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d20894c-53f2-455a-ae68-8d53d3b567ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-17e520a0-992c-4d92-862b-6ce0c84e90c4 tempest-ProjectReaderTests-476253096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14a547a1-1f0a-4265-9e3d-2e13e624de0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-17e520a0-992c-4d92-862b-6ce0c84e90c4 tempest-ProjectReaderTests-476253096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14a547a1-1f0a-4265-9e3d-2e13e624de0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af631f37-e610-42c5-8af6-7e086446b4c2', 'volume_name': 'volume-af631f37-e610-42c5-8af6-7e086446b4c2', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-17e520a0-992c-4d92-862b-6ce0c84e90c4 tempest-ProjectReaderTests-476253096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1050d22-bf29-4c99-a210-287bce858075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-17e520a0-992c-4d92-862b-6ce0c84e90c4 tempest-ProjectReaderTests-476253096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1050d22-bf29-4c99-a210-287bce858075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-17e520a0-992c-4d92-862b-6ce0c84e90c4 tempest-ProjectReaderTests-476253096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ed0dda8-0557-42c9-a427-569691931d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:35 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-17e520a0-992c-4d92-862b-6ce0c84e90c4 tempest-ProjectReaderTests-476253096 None] Volume af631f37-e610-42c5-8af6-7e086446b4c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af631f37-e610-42c5-8af6-7e086446b4c2', 'volume_size': 1} Jul 30 17:11:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-17e520a0-992c-4d92-862b-6ce0c84e90c4 tempest-ProjectReaderTests-476253096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-17e520a0-992c-4d92-862b-6ce0c84e90c4 tempest-ProjectReaderTests-476253096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:35 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-17e520a0-992c-4d92-862b-6ce0c84e90c4 tempest-ProjectReaderTests-476253096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:11:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-623633377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af631f37-e610-42c5-8af6-7e086446b4c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32e31e48f3004ac4820737037cc4b894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:11:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:11:35Z,use_quota=True,user_id='92a70241768f43a68196b39ad1cba90a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:11:35 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-17e520a0-992c-4d92-862b-6ce0c84e90c4 tempest-ProjectReaderTests-476253096 None] Creating volume af631f37-e610-42c5-8af6-7e086446b4c2 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:11:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-17e520a0-992c-4d92-862b-6ce0c84e90c4 tempest-ProjectReaderTests-476253096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-17e520a0-992c-4d92-862b-6ce0c84e90c4 tempest-ProjectReaderTests-476253096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:35 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-17e520a0-992c-4d92-862b-6ce0c84e90c4 tempest-ProjectReaderTests-476253096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:11:35 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-17e520a0-992c-4d92-862b-6ce0c84e90c4 tempest-ProjectReaderTests-476253096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:11:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-17e520a0-992c-4d92-862b-6ce0c84e90c4 tempest-ProjectReaderTests-476253096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:35 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-17e520a0-992c-4d92-862b-6ce0c84e90c4 tempest-ProjectReaderTests-476253096 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:11:35 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-17e520a0-992c-4d92-862b-6ce0c84e90c4 tempest-ProjectReaderTests-476253096 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:11:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-17e520a0-992c-4d92-862b-6ce0c84e90c4 tempest-ProjectReaderTests-476253096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-af631f37-e610-42c5-8af6-7e086446b4c2 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:35 devstack sudo[109922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-af631f37-e610-42c5-8af6-7e086446b4c2 1073741824 Jul 30 17:11:35 devstack sudo[109922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:35 devstack sudo[109922]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-17e520a0-992c-4d92-862b-6ce0c84e90c4 tempest-ProjectReaderTests-476253096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-af631f37-e610-42c5-8af6-7e086446b4c2 1073741824" returned: 0 in 0.436s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-17e520a0-992c-4d92-862b-6ce0c84e90c4 tempest-ProjectReaderTests-476253096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-af631f37-e610-42c5-8af6-7e086446b4c2 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:35 devstack sudo[109928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-af631f37-e610-42c5-8af6-7e086446b4c2 Jul 30 17:11:35 devstack sudo[109928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:35 devstack sudo[109928]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-17e520a0-992c-4d92-862b-6ce0c84e90c4 tempest-ProjectReaderTests-476253096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-af631f37-e610-42c5-8af6-7e086446b4c2" returned: 0 in 0.236s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:35 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-17e520a0-992c-4d92-862b-6ce0c84e90c4 tempest-ProjectReaderTests-476253096 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:11:35 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-17e520a0-992c-4d92-862b-6ce0c84e90c4 tempest-ProjectReaderTests-476253096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-17e520a0-992c-4d92-862b-6ce0c84e90c4 tempest-ProjectReaderTests-476253096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ed0dda8-0557-42c9-a427-569691931d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af631f37-e610-42c5-8af6-7e086446b4c2', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-17e520a0-992c-4d92-862b-6ce0c84e90c4 tempest-ProjectReaderTests-476253096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd1e7e5f-95b3-43f5-b67a-92ceb33b6c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:35 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-17e520a0-992c-4d92-862b-6ce0c84e90c4 tempest-ProjectReaderTests-476253096 None] Volume volume-af631f37-e610-42c5-8af6-7e086446b4c2 (af631f37-e610-42c5-8af6-7e086446b4c2): created successfully Jul 30 17:11:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-17e520a0-992c-4d92-862b-6ce0c84e90c4 tempest-ProjectReaderTests-476253096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd1e7e5f-95b3-43f5-b67a-92ceb33b6c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:35 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-17e520a0-992c-4d92-862b-6ce0c84e90c4 tempest-ProjectReaderTests-476253096 None] Flow 'volume_create_manager' (10b457a6-68e1-4154-85ec-c2c63af98485) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:11:35 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-17e520a0-992c-4d92-862b-6ce0c84e90c4 tempest-ProjectReaderTests-476253096 None] Created volume successfully. Jul 30 17:11:36 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-5670b02a-0705-459f-9691-4587141aa371 tempest-ProjectReaderTests-476253096 None] Acquiring lock "cinder-af631f37-e610-42c5-8af6-7e086446b4c2-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:36 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-5670b02a-0705-459f-9691-4587141aa371 tempest-ProjectReaderTests-476253096 None] Lock "cinder-af631f37-e610-42c5-8af6-7e086446b4c2-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:36 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-5670b02a-0705-459f-9691-4587141aa371 tempest-ProjectReaderTests-476253096 None] Acquiring lock "cinder-quobyte-af631f37-e610-42c5-8af6-7e086446b4c2" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:36 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-5670b02a-0705-459f-9691-4587141aa371 tempest-ProjectReaderTests-476253096 None] Lock "cinder-quobyte-af631f37-e610-42c5-8af6-7e086446b4c2" acquired by "delete_volume" :: waited 0.016s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:36 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[58175829-95f2-4b76-9ff1-45f679c73bc9]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5670b02a-0705-459f-9691-4587141aa371 tempest-ProjectReaderTests-476253096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-af631f37-e610-42c5-8af6-7e086446b4c2 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:36 devstack sudo[109931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-af631f37-e610-42c5-8af6-7e086446b4c2 Jul 30 17:11:36 devstack sudo[109931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:36 devstack sudo[109931]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5670b02a-0705-459f-9691-4587141aa371 tempest-ProjectReaderTests-476253096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-af631f37-e610-42c5-8af6-7e086446b4c2" returned: 0 in 0.341s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5670b02a-0705-459f-9691-4587141aa371 tempest-ProjectReaderTests-476253096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-af631f37-e610-42c5-8af6-7e086446b4c2 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:36 devstack sudo[109936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-af631f37-e610-42c5-8af6-7e086446b4c2 Jul 30 17:11:36 devstack sudo[109936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:36 devstack sudo[109936]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:36 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5670b02a-0705-459f-9691-4587141aa371 tempest-ProjectReaderTests-476253096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-af631f37-e610-42c5-8af6-7e086446b4c2" returned: 0 in 0.244s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:36 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-5670b02a-0705-459f-9691-4587141aa371 tempest-ProjectReaderTests-476253096 None] Lock "cinder-quobyte-af631f37-e610-42c5-8af6-7e086446b4c2" released by "delete_volume" :: held 0.621s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:36 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-5670b02a-0705-459f-9691-4587141aa371 tempest-ProjectReaderTests-476253096 None] Created reservations ['058ee1c8-5338-482d-982a-367d4f9714d4', '0207cc80-c715-42ca-9a26-577b8d56ae09', '0195d334-5275-4dff-b6b0-61f288c1e58b', '0b6968dc-ddc7-4c4f-adad-1e0b1228d496'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:11:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5670b02a-0705-459f-9691-4587141aa371 tempest-ProjectReaderTests-476253096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5670b02a-0705-459f-9691-4587141aa371 tempest-ProjectReaderTests-476253096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:37 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-5670b02a-0705-459f-9691-4587141aa371 tempest-ProjectReaderTests-476253096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:11:37 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-5670b02a-0705-459f-9691-4587141aa371 tempest-ProjectReaderTests-476253096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:11:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-5670b02a-0705-459f-9691-4587141aa371 tempest-ProjectReaderTests-476253096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5670b02a-0705-459f-9691-4587141aa371 tempest-ProjectReaderTests-476253096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:37 devstack sudo[109939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:11:37 devstack sudo[109939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:37 devstack sudo[109939]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-5670b02a-0705-459f-9691-4587141aa371 tempest-ProjectReaderTests-476253096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.243s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:37 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-5670b02a-0705-459f-9691-4587141aa371 tempest-ProjectReaderTests-476253096 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:11:37 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-5670b02a-0705-459f-9691-4587141aa371 tempest-ProjectReaderTests-476253096 None] Deleted volume successfully. Jul 30 17:11:37 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-5670b02a-0705-459f-9691-4587141aa371 tempest-ProjectReaderTests-476253096 None] Lock "cinder-af631f37-e610-42c5-8af6-7e086446b4c2-delete_volume" released by "delete_volume" :: held 1.048s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:37 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3e33248-c608-4400-baa4-87689fa3a267 tempest-ProjectReaderTests-476253096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:11:37 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-e3e33248-c608-4400-baa4-87689fa3a267 tempest-ProjectReaderTests-476253096 None] Flow 'volume_create_manager' (0cb56e12-3c20-4b24-b1ad-16419a7e1462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:11:37 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-e3e33248-c608-4400-baa4-87689fa3a267 tempest-ProjectReaderTests-476253096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b90da96-8299-416c-bc01-fd487d03dda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:37 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-e3e33248-c608-4400-baa4-87689fa3a267 tempest-ProjectReaderTests-476253096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b90da96-8299-416c-bc01-fd487d03dda0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:11:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1749997375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65af1406-6ea0-48de-be9a-31bd77c50595,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32e31e48f3004ac4820737037cc4b894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:11:38Z,use_quota=True,user_id='92a70241768f43a68196b39ad1cba90a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:37 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-e3e33248-c608-4400-baa4-87689fa3a267 tempest-ProjectReaderTests-476253096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2c3d013-2293-405f-b2b9-a168e11bcd57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:37 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-e3e33248-c608-4400-baa4-87689fa3a267 tempest-ProjectReaderTests-476253096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2c3d013-2293-405f-b2b9-a168e11bcd57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:37 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-e3e33248-c608-4400-baa4-87689fa3a267 tempest-ProjectReaderTests-476253096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0103b576-e642-4958-94e2-79f57de75e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:37 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-e3e33248-c608-4400-baa4-87689fa3a267 tempest-ProjectReaderTests-476253096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0103b576-e642-4958-94e2-79f57de75e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65af1406-6ea0-48de-be9a-31bd77c50595', 'volume_name': 'volume-65af1406-6ea0-48de-be9a-31bd77c50595', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:37 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-e3e33248-c608-4400-baa4-87689fa3a267 tempest-ProjectReaderTests-476253096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71aac612-1b9d-46e3-92ea-bf159b5b1ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:37 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-e3e33248-c608-4400-baa4-87689fa3a267 tempest-ProjectReaderTests-476253096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71aac612-1b9d-46e3-92ea-bf159b5b1ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:37 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-e3e33248-c608-4400-baa4-87689fa3a267 tempest-ProjectReaderTests-476253096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f3517a3-057d-4f3a-957a-91f8c4447d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:37 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-e3e33248-c608-4400-baa4-87689fa3a267 tempest-ProjectReaderTests-476253096 None] Volume 65af1406-6ea0-48de-be9a-31bd77c50595: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65af1406-6ea0-48de-be9a-31bd77c50595', 'volume_size': 1} Jul 30 17:11:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-e3e33248-c608-4400-baa4-87689fa3a267 tempest-ProjectReaderTests-476253096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-e3e33248-c608-4400-baa4-87689fa3a267 tempest-ProjectReaderTests-476253096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:37 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-e3e33248-c608-4400-baa4-87689fa3a267 tempest-ProjectReaderTests-476253096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:11:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1749997375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65af1406-6ea0-48de-be9a-31bd77c50595,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32e31e48f3004ac4820737037cc4b894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:11:38Z,use_quota=True,user_id='92a70241768f43a68196b39ad1cba90a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:11:37 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-e3e33248-c608-4400-baa4-87689fa3a267 tempest-ProjectReaderTests-476253096 None] Creating volume 65af1406-6ea0-48de-be9a-31bd77c50595 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:11:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-e3e33248-c608-4400-baa4-87689fa3a267 tempest-ProjectReaderTests-476253096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-e3e33248-c608-4400-baa4-87689fa3a267 tempest-ProjectReaderTests-476253096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:37 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-e3e33248-c608-4400-baa4-87689fa3a267 tempest-ProjectReaderTests-476253096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:11:37 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-e3e33248-c608-4400-baa4-87689fa3a267 tempest-ProjectReaderTests-476253096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:11:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-e3e33248-c608-4400-baa4-87689fa3a267 tempest-ProjectReaderTests-476253096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:37 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-e3e33248-c608-4400-baa4-87689fa3a267 tempest-ProjectReaderTests-476253096 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:11:37 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-e3e33248-c608-4400-baa4-87689fa3a267 tempest-ProjectReaderTests-476253096 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:11:37 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e3e33248-c608-4400-baa4-87689fa3a267 tempest-ProjectReaderTests-476253096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-65af1406-6ea0-48de-be9a-31bd77c50595 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:37 devstack sudo[109942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-65af1406-6ea0-48de-be9a-31bd77c50595 1073741824 Jul 30 17:11:37 devstack sudo[109942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:38 devstack sudo[109942]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e3e33248-c608-4400-baa4-87689fa3a267 tempest-ProjectReaderTests-476253096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-65af1406-6ea0-48de-be9a-31bd77c50595 1073741824" returned: 0 in 0.419s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e3e33248-c608-4400-baa4-87689fa3a267 tempest-ProjectReaderTests-476253096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-65af1406-6ea0-48de-be9a-31bd77c50595 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:38 devstack sudo[109947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-65af1406-6ea0-48de-be9a-31bd77c50595 Jul 30 17:11:38 devstack sudo[109947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:38 devstack sudo[109947]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e3e33248-c608-4400-baa4-87689fa3a267 tempest-ProjectReaderTests-476253096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-65af1406-6ea0-48de-be9a-31bd77c50595" returned: 0 in 0.236s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:38 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-e3e33248-c608-4400-baa4-87689fa3a267 tempest-ProjectReaderTests-476253096 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:11:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-e3e33248-c608-4400-baa4-87689fa3a267 tempest-ProjectReaderTests-476253096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:38 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-e3e33248-c608-4400-baa4-87689fa3a267 tempest-ProjectReaderTests-476253096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f3517a3-057d-4f3a-957a-91f8c4447d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65af1406-6ea0-48de-be9a-31bd77c50595', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:38 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-e3e33248-c608-4400-baa4-87689fa3a267 tempest-ProjectReaderTests-476253096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d6ac4ba-42a9-4e29-8080-c5d61d3a65ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:38 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-e3e33248-c608-4400-baa4-87689fa3a267 tempest-ProjectReaderTests-476253096 None] Volume volume-65af1406-6ea0-48de-be9a-31bd77c50595 (65af1406-6ea0-48de-be9a-31bd77c50595): created successfully Jul 30 17:11:38 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-e3e33248-c608-4400-baa4-87689fa3a267 tempest-ProjectReaderTests-476253096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d6ac4ba-42a9-4e29-8080-c5d61d3a65ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:38 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-e3e33248-c608-4400-baa4-87689fa3a267 tempest-ProjectReaderTests-476253096 None] Flow 'volume_create_manager' (0cb56e12-3c20-4b24-b1ad-16419a7e1462) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:11:38 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-e3e33248-c608-4400-baa4-87689fa3a267 tempest-ProjectReaderTests-476253096 None] Created volume successfully. Jul 30 17:11:38 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-a097e185-5a30-4fbe-8ae5-ed86b089afb2 tempest-ProjectReaderTests-476253096 None] Acquiring lock "cinder-65af1406-6ea0-48de-be9a-31bd77c50595-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:38 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-a097e185-5a30-4fbe-8ae5-ed86b089afb2 tempest-ProjectReaderTests-476253096 None] Lock "cinder-65af1406-6ea0-48de-be9a-31bd77c50595-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:38 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-a097e185-5a30-4fbe-8ae5-ed86b089afb2 tempest-ProjectReaderTests-476253096 None] Acquiring lock "cinder-quobyte-65af1406-6ea0-48de-be9a-31bd77c50595" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:38 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-a097e185-5a30-4fbe-8ae5-ed86b089afb2 tempest-ProjectReaderTests-476253096 None] Lock "cinder-quobyte-65af1406-6ea0-48de-be9a-31bd77c50595" acquired by "delete_volume" :: waited 0.015s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:38 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd45bb17-e77c-4bdb-9b73-f16f739f003f]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:38 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a097e185-5a30-4fbe-8ae5-ed86b089afb2 tempest-ProjectReaderTests-476253096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-65af1406-6ea0-48de-be9a-31bd77c50595 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:39 devstack sudo[109950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-65af1406-6ea0-48de-be9a-31bd77c50595 Jul 30 17:11:39 devstack sudo[109950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:39 devstack sudo[109950]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a097e185-5a30-4fbe-8ae5-ed86b089afb2 tempest-ProjectReaderTests-476253096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-65af1406-6ea0-48de-be9a-31bd77c50595" returned: 0 in 0.351s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a097e185-5a30-4fbe-8ae5-ed86b089afb2 tempest-ProjectReaderTests-476253096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-65af1406-6ea0-48de-be9a-31bd77c50595 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:39 devstack sudo[109955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-65af1406-6ea0-48de-be9a-31bd77c50595 Jul 30 17:11:39 devstack sudo[109955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:39 devstack sudo[109955]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a097e185-5a30-4fbe-8ae5-ed86b089afb2 tempest-ProjectReaderTests-476253096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-65af1406-6ea0-48de-be9a-31bd77c50595" returned: 0 in 0.242s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:39 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-a097e185-5a30-4fbe-8ae5-ed86b089afb2 tempest-ProjectReaderTests-476253096 None] Lock "cinder-quobyte-65af1406-6ea0-48de-be9a-31bd77c50595" released by "delete_volume" :: held 0.631s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:39 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-a097e185-5a30-4fbe-8ae5-ed86b089afb2 tempest-ProjectReaderTests-476253096 None] Created reservations ['60d6809a-56ed-4e88-8826-479ef2538900', '747b9118-876c-47c3-a74b-2286f1bdfb41', '1edbcb28-0163-4c5d-a72a-1d177fa0af9d', 'f991eaed-f307-4e17-90eb-2dba0ab0abfc'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:11:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a097e185-5a30-4fbe-8ae5-ed86b089afb2 tempest-ProjectReaderTests-476253096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a097e185-5a30-4fbe-8ae5-ed86b089afb2 tempest-ProjectReaderTests-476253096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:39 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a097e185-5a30-4fbe-8ae5-ed86b089afb2 tempest-ProjectReaderTests-476253096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:11:39 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a097e185-5a30-4fbe-8ae5-ed86b089afb2 tempest-ProjectReaderTests-476253096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:11:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a097e185-5a30-4fbe-8ae5-ed86b089afb2 tempest-ProjectReaderTests-476253096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a097e185-5a30-4fbe-8ae5-ed86b089afb2 tempest-ProjectReaderTests-476253096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:39 devstack sudo[109958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:11:39 devstack sudo[109958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:39 devstack sudo[109958]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:39 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a097e185-5a30-4fbe-8ae5-ed86b089afb2 tempest-ProjectReaderTests-476253096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.238s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:39 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-a097e185-5a30-4fbe-8ae5-ed86b089afb2 tempest-ProjectReaderTests-476253096 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:11:39 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-a097e185-5a30-4fbe-8ae5-ed86b089afb2 tempest-ProjectReaderTests-476253096 None] Deleted volume successfully. Jul 30 17:11:39 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-a097e185-5a30-4fbe-8ae5-ed86b089afb2 tempest-ProjectReaderTests-476253096 None] Lock "cinder-65af1406-6ea0-48de-be9a-31bd77c50595-delete_volume" released by "delete_volume" :: held 1.054s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:40 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7eb4c5f-6766-4cfc-b6dd-4f6d95439614 tempest-ProjectReaderTests-476253096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:11:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f7eb4c5f-6766-4cfc-b6dd-4f6d95439614 tempest-ProjectReaderTests-476253096 None] Flow 'volume_create_manager' (d637b386-a08c-4616-9f67-de0a1ac8965a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:11:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f7eb4c5f-6766-4cfc-b6dd-4f6d95439614 tempest-ProjectReaderTests-476253096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9e7f09a-8908-475d-80e2-14f5ed3c5e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f7eb4c5f-6766-4cfc-b6dd-4f6d95439614 tempest-ProjectReaderTests-476253096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9e7f09a-8908-475d-80e2-14f5ed3c5e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:11:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-978767543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa864a0c-f6d6-4ebf-a479-85b3456fa6e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32e31e48f3004ac4820737037cc4b894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:11:40Z,use_quota=True,user_id='92a70241768f43a68196b39ad1cba90a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f7eb4c5f-6766-4cfc-b6dd-4f6d95439614 tempest-ProjectReaderTests-476253096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba463e03-7c7d-4f00-9831-b520881ccb20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f7eb4c5f-6766-4cfc-b6dd-4f6d95439614 tempest-ProjectReaderTests-476253096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba463e03-7c7d-4f00-9831-b520881ccb20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f7eb4c5f-6766-4cfc-b6dd-4f6d95439614 tempest-ProjectReaderTests-476253096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b3bbc3e-d741-46fe-aa5f-514c994d0140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f7eb4c5f-6766-4cfc-b6dd-4f6d95439614 tempest-ProjectReaderTests-476253096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b3bbc3e-d741-46fe-aa5f-514c994d0140) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa864a0c-f6d6-4ebf-a479-85b3456fa6e5', 'volume_name': 'volume-fa864a0c-f6d6-4ebf-a479-85b3456fa6e5', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f7eb4c5f-6766-4cfc-b6dd-4f6d95439614 tempest-ProjectReaderTests-476253096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a302f10-fa95-4d63-9277-e6bc8d46109c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f7eb4c5f-6766-4cfc-b6dd-4f6d95439614 tempest-ProjectReaderTests-476253096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a302f10-fa95-4d63-9277-e6bc8d46109c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:40 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f7eb4c5f-6766-4cfc-b6dd-4f6d95439614 tempest-ProjectReaderTests-476253096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3fa04fd-3f4e-4fad-ba00-44f69cc6541a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:40 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-f7eb4c5f-6766-4cfc-b6dd-4f6d95439614 tempest-ProjectReaderTests-476253096 None] Volume fa864a0c-f6d6-4ebf-a479-85b3456fa6e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa864a0c-f6d6-4ebf-a479-85b3456fa6e5', 'volume_size': 1} Jul 30 17:11:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f7eb4c5f-6766-4cfc-b6dd-4f6d95439614 tempest-ProjectReaderTests-476253096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f7eb4c5f-6766-4cfc-b6dd-4f6d95439614 tempest-ProjectReaderTests-476253096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:40 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f7eb4c5f-6766-4cfc-b6dd-4f6d95439614 tempest-ProjectReaderTests-476253096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:11:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-978767543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa864a0c-f6d6-4ebf-a479-85b3456fa6e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32e31e48f3004ac4820737037cc4b894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:11:40Z,use_quota=True,user_id='92a70241768f43a68196b39ad1cba90a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:11:40 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-f7eb4c5f-6766-4cfc-b6dd-4f6d95439614 tempest-ProjectReaderTests-476253096 None] Creating volume fa864a0c-f6d6-4ebf-a479-85b3456fa6e5 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:11:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f7eb4c5f-6766-4cfc-b6dd-4f6d95439614 tempest-ProjectReaderTests-476253096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f7eb4c5f-6766-4cfc-b6dd-4f6d95439614 tempest-ProjectReaderTests-476253096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:40 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f7eb4c5f-6766-4cfc-b6dd-4f6d95439614 tempest-ProjectReaderTests-476253096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:11:40 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f7eb4c5f-6766-4cfc-b6dd-4f6d95439614 tempest-ProjectReaderTests-476253096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:11:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f7eb4c5f-6766-4cfc-b6dd-4f6d95439614 tempest-ProjectReaderTests-476253096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:40 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f7eb4c5f-6766-4cfc-b6dd-4f6d95439614 tempest-ProjectReaderTests-476253096 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:11:40 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-f7eb4c5f-6766-4cfc-b6dd-4f6d95439614 tempest-ProjectReaderTests-476253096 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:11:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f7eb4c5f-6766-4cfc-b6dd-4f6d95439614 tempest-ProjectReaderTests-476253096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fa864a0c-f6d6-4ebf-a479-85b3456fa6e5 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:40 devstack sudo[109961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fa864a0c-f6d6-4ebf-a479-85b3456fa6e5 1073741824 Jul 30 17:11:40 devstack sudo[109961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:40 devstack sudo[109961]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f7eb4c5f-6766-4cfc-b6dd-4f6d95439614 tempest-ProjectReaderTests-476253096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fa864a0c-f6d6-4ebf-a479-85b3456fa6e5 1073741824" returned: 0 in 0.400s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:40 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f7eb4c5f-6766-4cfc-b6dd-4f6d95439614 tempest-ProjectReaderTests-476253096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fa864a0c-f6d6-4ebf-a479-85b3456fa6e5 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:40 devstack sudo[109966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fa864a0c-f6d6-4ebf-a479-85b3456fa6e5 Jul 30 17:11:40 devstack sudo[109966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:41 devstack sudo[109966]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-f7eb4c5f-6766-4cfc-b6dd-4f6d95439614 tempest-ProjectReaderTests-476253096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fa864a0c-f6d6-4ebf-a479-85b3456fa6e5" returned: 0 in 0.239s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:41 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-f7eb4c5f-6766-4cfc-b6dd-4f6d95439614 tempest-ProjectReaderTests-476253096 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:11:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-f7eb4c5f-6766-4cfc-b6dd-4f6d95439614 tempest-ProjectReaderTests-476253096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:41 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f7eb4c5f-6766-4cfc-b6dd-4f6d95439614 tempest-ProjectReaderTests-476253096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3fa04fd-3f4e-4fad-ba00-44f69cc6541a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa864a0c-f6d6-4ebf-a479-85b3456fa6e5', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:41 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f7eb4c5f-6766-4cfc-b6dd-4f6d95439614 tempest-ProjectReaderTests-476253096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f9f6375-1957-46c7-bf77-52ab18a3a014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:41 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-f7eb4c5f-6766-4cfc-b6dd-4f6d95439614 tempest-ProjectReaderTests-476253096 None] Volume volume-fa864a0c-f6d6-4ebf-a479-85b3456fa6e5 (fa864a0c-f6d6-4ebf-a479-85b3456fa6e5): created successfully Jul 30 17:11:41 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f7eb4c5f-6766-4cfc-b6dd-4f6d95439614 tempest-ProjectReaderTests-476253096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f9f6375-1957-46c7-bf77-52ab18a3a014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:41 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-f7eb4c5f-6766-4cfc-b6dd-4f6d95439614 tempest-ProjectReaderTests-476253096 None] Flow 'volume_create_manager' (d637b386-a08c-4616-9f67-de0a1ac8965a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:11:41 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-f7eb4c5f-6766-4cfc-b6dd-4f6d95439614 tempest-ProjectReaderTests-476253096 None] Created volume successfully. Jul 30 17:11:41 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-a3076813-d4c7-40e3-beb2-e9ddad9cc5b7 tempest-ProjectReaderTests-476253096 None] Acquiring lock "cinder-fa864a0c-f6d6-4ebf-a479-85b3456fa6e5-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:41 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-a3076813-d4c7-40e3-beb2-e9ddad9cc5b7 tempest-ProjectReaderTests-476253096 None] Lock "cinder-fa864a0c-f6d6-4ebf-a479-85b3456fa6e5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:41 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-a3076813-d4c7-40e3-beb2-e9ddad9cc5b7 tempest-ProjectReaderTests-476253096 None] Acquiring lock "cinder-quobyte-fa864a0c-f6d6-4ebf-a479-85b3456fa6e5" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:41 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-a3076813-d4c7-40e3-beb2-e9ddad9cc5b7 tempest-ProjectReaderTests-476253096 None] Lock "cinder-quobyte-fa864a0c-f6d6-4ebf-a479-85b3456fa6e5" acquired by "delete_volume" :: waited 0.022s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:41 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4192818-4f52-4d97-8aa6-b61a93db924d]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a3076813-d4c7-40e3-beb2-e9ddad9cc5b7 tempest-ProjectReaderTests-476253096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fa864a0c-f6d6-4ebf-a479-85b3456fa6e5 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:41 devstack sudo[109969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fa864a0c-f6d6-4ebf-a479-85b3456fa6e5 Jul 30 17:11:41 devstack sudo[109969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:41 devstack sudo[109969]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a3076813-d4c7-40e3-beb2-e9ddad9cc5b7 tempest-ProjectReaderTests-476253096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fa864a0c-f6d6-4ebf-a479-85b3456fa6e5" returned: 0 in 0.347s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:41 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a3076813-d4c7-40e3-beb2-e9ddad9cc5b7 tempest-ProjectReaderTests-476253096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fa864a0c-f6d6-4ebf-a479-85b3456fa6e5 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:41 devstack sudo[109974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fa864a0c-f6d6-4ebf-a479-85b3456fa6e5 Jul 30 17:11:41 devstack sudo[109974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:42 devstack sudo[109974]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a3076813-d4c7-40e3-beb2-e9ddad9cc5b7 tempest-ProjectReaderTests-476253096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-fa864a0c-f6d6-4ebf-a479-85b3456fa6e5" returned: 0 in 0.237s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:42 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-a3076813-d4c7-40e3-beb2-e9ddad9cc5b7 tempest-ProjectReaderTests-476253096 None] Lock "cinder-quobyte-fa864a0c-f6d6-4ebf-a479-85b3456fa6e5" released by "delete_volume" :: held 0.620s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:42 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-a3076813-d4c7-40e3-beb2-e9ddad9cc5b7 tempest-ProjectReaderTests-476253096 None] Created reservations ['2438b950-07ec-460a-92b3-4c7963381b5b', '3d822701-ac36-44c1-8cbf-968665254244', '0e3570b6-9ba5-4d66-be96-dbd5a38d892e', '571187d0-8fa2-43cf-b5e7-f9950b7dc060'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:11:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a3076813-d4c7-40e3-beb2-e9ddad9cc5b7 tempest-ProjectReaderTests-476253096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a3076813-d4c7-40e3-beb2-e9ddad9cc5b7 tempest-ProjectReaderTests-476253096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:42 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a3076813-d4c7-40e3-beb2-e9ddad9cc5b7 tempest-ProjectReaderTests-476253096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:11:42 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-a3076813-d4c7-40e3-beb2-e9ddad9cc5b7 tempest-ProjectReaderTests-476253096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:11:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-a3076813-d4c7-40e3-beb2-e9ddad9cc5b7 tempest-ProjectReaderTests-476253096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a3076813-d4c7-40e3-beb2-e9ddad9cc5b7 tempest-ProjectReaderTests-476253096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:42 devstack sudo[109977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:11:42 devstack sudo[109977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:42 devstack sudo[109977]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:42 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-a3076813-d4c7-40e3-beb2-e9ddad9cc5b7 tempest-ProjectReaderTests-476253096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.244s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:42 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-a3076813-d4c7-40e3-beb2-e9ddad9cc5b7 tempest-ProjectReaderTests-476253096 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:11:42 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-a3076813-d4c7-40e3-beb2-e9ddad9cc5b7 tempest-ProjectReaderTests-476253096 None] Deleted volume successfully. Jul 30 17:11:42 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-a3076813-d4c7-40e3-beb2-e9ddad9cc5b7 tempest-ProjectReaderTests-476253096 None] Lock "cinder-fa864a0c-f6d6-4ebf-a479-85b3456fa6e5-delete_volume" released by "delete_volume" :: held 1.128s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:43 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bd28a8c-ea63-410a-a86f-9fcce9f9bc31 tempest-ProjectReaderTests-476253096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:11:43 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1bd28a8c-ea63-410a-a86f-9fcce9f9bc31 tempest-ProjectReaderTests-476253096 None] Flow 'volume_create_manager' (b3a3f117-8cea-4fa8-90ae-86f231df3008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:11:43 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1bd28a8c-ea63-410a-a86f-9fcce9f9bc31 tempest-ProjectReaderTests-476253096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06cb8f2c-babb-48d1-b487-bed174dae848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:43 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1bd28a8c-ea63-410a-a86f-9fcce9f9bc31 tempest-ProjectReaderTests-476253096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06cb8f2c-babb-48d1-b487-bed174dae848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:11:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1632225861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3caac19d-800b-472b-8c68-0c78565bc880,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32e31e48f3004ac4820737037cc4b894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:11:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:11:43Z,use_quota=True,user_id='92a70241768f43a68196b39ad1cba90a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:43 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1bd28a8c-ea63-410a-a86f-9fcce9f9bc31 tempest-ProjectReaderTests-476253096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec9a45e1-e103-4f4b-ab2c-338fe4f369e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:43 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1bd28a8c-ea63-410a-a86f-9fcce9f9bc31 tempest-ProjectReaderTests-476253096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec9a45e1-e103-4f4b-ab2c-338fe4f369e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:43 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1bd28a8c-ea63-410a-a86f-9fcce9f9bc31 tempest-ProjectReaderTests-476253096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a6d6fe6-3f63-4787-8aab-d4ad5861a76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:43 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1bd28a8c-ea63-410a-a86f-9fcce9f9bc31 tempest-ProjectReaderTests-476253096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a6d6fe6-3f63-4787-8aab-d4ad5861a76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3caac19d-800b-472b-8c68-0c78565bc880', 'volume_name': 'volume-3caac19d-800b-472b-8c68-0c78565bc880', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:43 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1bd28a8c-ea63-410a-a86f-9fcce9f9bc31 tempest-ProjectReaderTests-476253096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eab9b970-8b50-42fb-a12e-955551ca56a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:43 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1bd28a8c-ea63-410a-a86f-9fcce9f9bc31 tempest-ProjectReaderTests-476253096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eab9b970-8b50-42fb-a12e-955551ca56a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:43 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1bd28a8c-ea63-410a-a86f-9fcce9f9bc31 tempest-ProjectReaderTests-476253096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b653fc-f723-4f64-9b3f-cd046ecffd09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:43 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-1bd28a8c-ea63-410a-a86f-9fcce9f9bc31 tempest-ProjectReaderTests-476253096 None] Volume 3caac19d-800b-472b-8c68-0c78565bc880: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3caac19d-800b-472b-8c68-0c78565bc880', 'volume_size': 1} Jul 30 17:11:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1bd28a8c-ea63-410a-a86f-9fcce9f9bc31 tempest-ProjectReaderTests-476253096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1bd28a8c-ea63-410a-a86f-9fcce9f9bc31 tempest-ProjectReaderTests-476253096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:43 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-1bd28a8c-ea63-410a-a86f-9fcce9f9bc31 tempest-ProjectReaderTests-476253096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:11:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1632225861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3caac19d-800b-472b-8c68-0c78565bc880,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32e31e48f3004ac4820737037cc4b894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:11:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:11:43Z,use_quota=True,user_id='92a70241768f43a68196b39ad1cba90a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:11:43 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-1bd28a8c-ea63-410a-a86f-9fcce9f9bc31 tempest-ProjectReaderTests-476253096 None] Creating volume 3caac19d-800b-472b-8c68-0c78565bc880 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:11:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1bd28a8c-ea63-410a-a86f-9fcce9f9bc31 tempest-ProjectReaderTests-476253096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1bd28a8c-ea63-410a-a86f-9fcce9f9bc31 tempest-ProjectReaderTests-476253096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:43 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-1bd28a8c-ea63-410a-a86f-9fcce9f9bc31 tempest-ProjectReaderTests-476253096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:11:43 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-1bd28a8c-ea63-410a-a86f-9fcce9f9bc31 tempest-ProjectReaderTests-476253096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:11:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1bd28a8c-ea63-410a-a86f-9fcce9f9bc31 tempest-ProjectReaderTests-476253096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:43 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-1bd28a8c-ea63-410a-a86f-9fcce9f9bc31 tempest-ProjectReaderTests-476253096 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:11:43 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-1bd28a8c-ea63-410a-a86f-9fcce9f9bc31 tempest-ProjectReaderTests-476253096 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:11:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1bd28a8c-ea63-410a-a86f-9fcce9f9bc31 tempest-ProjectReaderTests-476253096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3caac19d-800b-472b-8c68-0c78565bc880 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:43 devstack sudo[109981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3caac19d-800b-472b-8c68-0c78565bc880 1073741824 Jul 30 17:11:43 devstack sudo[109981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:43 devstack sudo[109981]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1bd28a8c-ea63-410a-a86f-9fcce9f9bc31 tempest-ProjectReaderTests-476253096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3caac19d-800b-472b-8c68-0c78565bc880 1073741824" returned: 0 in 0.404s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1bd28a8c-ea63-410a-a86f-9fcce9f9bc31 tempest-ProjectReaderTests-476253096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3caac19d-800b-472b-8c68-0c78565bc880 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:43 devstack sudo[109986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3caac19d-800b-472b-8c68-0c78565bc880 Jul 30 17:11:43 devstack sudo[109986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:43 devstack sudo[109986]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1bd28a8c-ea63-410a-a86f-9fcce9f9bc31 tempest-ProjectReaderTests-476253096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3caac19d-800b-472b-8c68-0c78565bc880" returned: 0 in 0.245s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:43 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-1bd28a8c-ea63-410a-a86f-9fcce9f9bc31 tempest-ProjectReaderTests-476253096 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:11:43 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1bd28a8c-ea63-410a-a86f-9fcce9f9bc31 tempest-ProjectReaderTests-476253096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:43 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1bd28a8c-ea63-410a-a86f-9fcce9f9bc31 tempest-ProjectReaderTests-476253096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b653fc-f723-4f64-9b3f-cd046ecffd09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3caac19d-800b-472b-8c68-0c78565bc880', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:43 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1bd28a8c-ea63-410a-a86f-9fcce9f9bc31 tempest-ProjectReaderTests-476253096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98f94bad-7fc4-42d0-863d-13df22547a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:11:43 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-1bd28a8c-ea63-410a-a86f-9fcce9f9bc31 tempest-ProjectReaderTests-476253096 None] Volume volume-3caac19d-800b-472b-8c68-0c78565bc880 (3caac19d-800b-472b-8c68-0c78565bc880): created successfully Jul 30 17:11:43 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1bd28a8c-ea63-410a-a86f-9fcce9f9bc31 tempest-ProjectReaderTests-476253096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98f94bad-7fc4-42d0-863d-13df22547a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:11:43 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1bd28a8c-ea63-410a-a86f-9fcce9f9bc31 tempest-ProjectReaderTests-476253096 None] Flow 'volume_create_manager' (b3a3f117-8cea-4fa8-90ae-86f231df3008) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:11:43 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-1bd28a8c-ea63-410a-a86f-9fcce9f9bc31 tempest-ProjectReaderTests-476253096 None] Created volume successfully. Jul 30 17:11:44 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-e9e2de63-3042-4de3-92e5-53def2665b43 tempest-ProjectReaderTests-476253096 None] Acquiring lock "cinder-3caac19d-800b-472b-8c68-0c78565bc880-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:44 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-e9e2de63-3042-4de3-92e5-53def2665b43 tempest-ProjectReaderTests-476253096 None] Lock "cinder-3caac19d-800b-472b-8c68-0c78565bc880-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:44 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-e9e2de63-3042-4de3-92e5-53def2665b43 tempest-ProjectReaderTests-476253096 None] Acquiring lock "cinder-quobyte-3caac19d-800b-472b-8c68-0c78565bc880" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:11:44 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-e9e2de63-3042-4de3-92e5-53def2665b43 tempest-ProjectReaderTests-476253096 None] Lock "cinder-quobyte-3caac19d-800b-472b-8c68-0c78565bc880" acquired by "delete_volume" :: waited 0.014s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:11:44 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf37191-f5ae-4f5c-a507-e885c4137931]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:11:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e9e2de63-3042-4de3-92e5-53def2665b43 tempest-ProjectReaderTests-476253096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3caac19d-800b-472b-8c68-0c78565bc880 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:44 devstack sudo[109989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3caac19d-800b-472b-8c68-0c78565bc880 Jul 30 17:11:44 devstack sudo[109989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:44 devstack sudo[109989]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e9e2de63-3042-4de3-92e5-53def2665b43 tempest-ProjectReaderTests-476253096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3caac19d-800b-472b-8c68-0c78565bc880" returned: 0 in 0.349s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e9e2de63-3042-4de3-92e5-53def2665b43 tempest-ProjectReaderTests-476253096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3caac19d-800b-472b-8c68-0c78565bc880 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:44 devstack sudo[109994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3caac19d-800b-472b-8c68-0c78565bc880 Jul 30 17:11:44 devstack sudo[109994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:44 devstack sudo[109994]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e9e2de63-3042-4de3-92e5-53def2665b43 tempest-ProjectReaderTests-476253096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-3caac19d-800b-472b-8c68-0c78565bc880" returned: 0 in 0.242s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:44 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-e9e2de63-3042-4de3-92e5-53def2665b43 tempest-ProjectReaderTests-476253096 None] Lock "cinder-quobyte-3caac19d-800b-472b-8c68-0c78565bc880" released by "delete_volume" :: held 0.627s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:44 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-e9e2de63-3042-4de3-92e5-53def2665b43 tempest-ProjectReaderTests-476253096 None] Created reservations ['520a11ef-463d-42ff-9705-eb8fe8a2135d', 'c6c4ec36-7a31-4c3f-b6cc-226ae883b497', 'c7df4d8c-a088-4c84-b565-378a1b8c551d', 'cbaf2458-3377-4c30-a99a-2713a785ba2d'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:11:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-e9e2de63-3042-4de3-92e5-53def2665b43 tempest-ProjectReaderTests-476253096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:11:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-e9e2de63-3042-4de3-92e5-53def2665b43 tempest-ProjectReaderTests-476253096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:11:44 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-e9e2de63-3042-4de3-92e5-53def2665b43 tempest-ProjectReaderTests-476253096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:11:44 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-e9e2de63-3042-4de3-92e5-53def2665b43 tempest-ProjectReaderTests-476253096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:11:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-e9e2de63-3042-4de3-92e5-53def2665b43 tempest-ProjectReaderTests-476253096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:11:44 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e9e2de63-3042-4de3-92e5-53def2665b43 tempest-ProjectReaderTests-476253096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:11:44 devstack sudo[109997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:11:44 devstack sudo[109997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:11:45 devstack sudo[109997]: pam_unix(sudo:session): session closed for user root Jul 30 17:11:45 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-e9e2de63-3042-4de3-92e5-53def2665b43 tempest-ProjectReaderTests-476253096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.238s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:11:45 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-e9e2de63-3042-4de3-92e5-53def2665b43 tempest-ProjectReaderTests-476253096 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:11:45 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-e9e2de63-3042-4de3-92e5-53def2665b43 tempest-ProjectReaderTests-476253096 None] Deleted volume successfully. Jul 30 17:11:45 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-e9e2de63-3042-4de3-92e5-53def2665b43 tempest-ProjectReaderTests-476253096 None] Lock "cinder-3caac19d-800b-472b-8c68-0c78565bc880-delete_volume" released by "delete_volume" :: held 1.048s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:11:58 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:SELECT=24,cinder:UPDATE=49,cinder:INSERT=13,cinder:DELETE=4 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:11:58 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:SELECT=33,cinder:UPDATE=40,cinder:INSERT=7,cinder:DELETE=4 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:12:06 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c92d56b-3aee-4ec8-a92e-d3e461afb28d tempest-SnapshotDependencyTests-2096073139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:12:06 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1c92d56b-3aee-4ec8-a92e-d3e461afb28d tempest-SnapshotDependencyTests-2096073139 None] Flow 'volume_create_manager' (df91dd5a-03a2-444d-81c5-c844a0fa9bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:12:06 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1c92d56b-3aee-4ec8-a92e-d3e461afb28d tempest-SnapshotDependencyTests-2096073139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeb8af12-3e35-443c-af70-8c330ba677aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:12:06 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1c92d56b-3aee-4ec8-a92e-d3e461afb28d tempest-SnapshotDependencyTests-2096073139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeb8af12-3e35-443c-af70-8c330ba677aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:12:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-40281921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=639327d6-a02d-4c21-9100-3cdb901697e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='014eff7353684a4da0d2d27f0f563609',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:12:06Z,use_quota=True,user_id='399da4b084344be7b6d05e333ffa4832',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:12:06 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1c92d56b-3aee-4ec8-a92e-d3e461afb28d tempest-SnapshotDependencyTests-2096073139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b005239-0d93-4af2-b25d-7796bd0be7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:12:06 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1c92d56b-3aee-4ec8-a92e-d3e461afb28d tempest-SnapshotDependencyTests-2096073139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b005239-0d93-4af2-b25d-7796bd0be7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:12:06 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1c92d56b-3aee-4ec8-a92e-d3e461afb28d tempest-SnapshotDependencyTests-2096073139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (884de747-98ff-43c6-8f9b-98a069a4f252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:12:06 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1c92d56b-3aee-4ec8-a92e-d3e461afb28d tempest-SnapshotDependencyTests-2096073139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (884de747-98ff-43c6-8f9b-98a069a4f252) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '639327d6-a02d-4c21-9100-3cdb901697e3', 'volume_name': 'volume-639327d6-a02d-4c21-9100-3cdb901697e3', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:12:06 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1c92d56b-3aee-4ec8-a92e-d3e461afb28d tempest-SnapshotDependencyTests-2096073139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0be8068d-e08c-498e-be9f-a8df3ffee80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:12:06 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1c92d56b-3aee-4ec8-a92e-d3e461afb28d tempest-SnapshotDependencyTests-2096073139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0be8068d-e08c-498e-be9f-a8df3ffee80d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:12:06 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1c92d56b-3aee-4ec8-a92e-d3e461afb28d tempest-SnapshotDependencyTests-2096073139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9772cd13-916e-4b06-9ffe-24d071cf7744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:12:06 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-1c92d56b-3aee-4ec8-a92e-d3e461afb28d tempest-SnapshotDependencyTests-2096073139 None] Volume 639327d6-a02d-4c21-9100-3cdb901697e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-639327d6-a02d-4c21-9100-3cdb901697e3', 'volume_size': 1} Jul 30 17:12:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1c92d56b-3aee-4ec8-a92e-d3e461afb28d tempest-SnapshotDependencyTests-2096073139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:12:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1c92d56b-3aee-4ec8-a92e-d3e461afb28d tempest-SnapshotDependencyTests-2096073139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:12:06 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-1c92d56b-3aee-4ec8-a92e-d3e461afb28d tempest-SnapshotDependencyTests-2096073139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:12:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-40281921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=639327d6-a02d-4c21-9100-3cdb901697e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='014eff7353684a4da0d2d27f0f563609',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:12:06Z,use_quota=True,user_id='399da4b084344be7b6d05e333ffa4832',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)}" {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 17:12:06 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-1c92d56b-3aee-4ec8-a92e-d3e461afb28d tempest-SnapshotDependencyTests-2096073139 None] Creating volume 639327d6-a02d-4c21-9100-3cdb901697e3 {{(pid=88591) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 17:12:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1c92d56b-3aee-4ec8-a92e-d3e461afb28d tempest-SnapshotDependencyTests-2096073139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:12:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1c92d56b-3aee-4ec8-a92e-d3e461afb28d tempest-SnapshotDependencyTests-2096073139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:12:06 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-1c92d56b-3aee-4ec8-a92e-d3e461afb28d tempest-SnapshotDependencyTests-2096073139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:12:06 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-1c92d56b-3aee-4ec8-a92e-d3e461afb28d tempest-SnapshotDependencyTests-2096073139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:12:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1c92d56b-3aee-4ec8-a92e-d3e461afb28d tempest-SnapshotDependencyTests-2096073139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:12:06 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-1c92d56b-3aee-4ec8-a92e-d3e461afb28d tempest-SnapshotDependencyTests-2096073139 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:12:06 devstack cinder-volume[88591]: INFO cinder.volume.drivers.remotefs [None req-1c92d56b-3aee-4ec8-a92e-d3e461afb28d tempest-SnapshotDependencyTests-2096073139 None] casted to osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 Jul 30 17:12:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1c92d56b-3aee-4ec8-a92e-d3e461afb28d tempest-SnapshotDependencyTests-2096073139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-639327d6-a02d-4c21-9100-3cdb901697e3 1073741824 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:06 devstack sudo[110046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-639327d6-a02d-4c21-9100-3cdb901697e3 1073741824 Jul 30 17:12:06 devstack sudo[110046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:06 devstack sudo[110046]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1c92d56b-3aee-4ec8-a92e-d3e461afb28d tempest-SnapshotDependencyTests-2096073139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-639327d6-a02d-4c21-9100-3cdb901697e3 1073741824" returned: 0 in 0.405s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:06 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1c92d56b-3aee-4ec8-a92e-d3e461afb28d tempest-SnapshotDependencyTests-2096073139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-639327d6-a02d-4c21-9100-3cdb901697e3 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:06 devstack sudo[110052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-639327d6-a02d-4c21-9100-3cdb901697e3 Jul 30 17:12:06 devstack sudo[110052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:07 devstack sudo[110052]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-1c92d56b-3aee-4ec8-a92e-d3e461afb28d tempest-SnapshotDependencyTests-2096073139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-639327d6-a02d-4c21-9100-3cdb901697e3" returned: 0 in 0.236s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:07 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-1c92d56b-3aee-4ec8-a92e-d3e461afb28d tempest-SnapshotDependencyTests-2096073139 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'} {{(pid=88591) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 17:12:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-1c92d56b-3aee-4ec8-a92e-d3e461afb28d tempest-SnapshotDependencyTests-2096073139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:12:07 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1c92d56b-3aee-4ec8-a92e-d3e461afb28d tempest-SnapshotDependencyTests-2096073139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9772cd13-916e-4b06-9ffe-24d071cf7744) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-639327d6-a02d-4c21-9100-3cdb901697e3', 'volume_size': 1}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:12:07 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1c92d56b-3aee-4ec8-a92e-d3e461afb28d tempest-SnapshotDependencyTests-2096073139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a86528e3-5a7b-42da-a980-bb73b10743ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:12:07 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-1c92d56b-3aee-4ec8-a92e-d3e461afb28d tempest-SnapshotDependencyTests-2096073139 None] Volume volume-639327d6-a02d-4c21-9100-3cdb901697e3 (639327d6-a02d-4c21-9100-3cdb901697e3): created successfully Jul 30 17:12:07 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1c92d56b-3aee-4ec8-a92e-d3e461afb28d tempest-SnapshotDependencyTests-2096073139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a86528e3-5a7b-42da-a980-bb73b10743ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:12:07 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-1c92d56b-3aee-4ec8-a92e-d3e461afb28d tempest-SnapshotDependencyTests-2096073139 None] Flow 'volume_create_manager' (df91dd5a-03a2-444d-81c5-c844a0fa9bf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:12:07 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-1c92d56b-3aee-4ec8-a92e-d3e461afb28d tempest-SnapshotDependencyTests-2096073139 None] Created volume successfully. Jul 30 17:12:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-610283e1-b7fa-4c8a-bd7b-9112dea796d9 tempest-SnapshotDependencyTests-2096073139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:12:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-610283e1-b7fa-4c8a-bd7b-9112dea796d9 tempest-SnapshotDependencyTests-2096073139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:12:07 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-610283e1-b7fa-4c8a-bd7b-9112dea796d9 tempest-SnapshotDependencyTests-2096073139 None] Creating offline snapshot 78f94d60-d377-4ff0-8d0c-5d908b0bf27e of volume 639327d6-a02d-4c21-9100-3cdb901697e3 {{(pid=88591) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 17:12:07 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[6001ddee-501f-405b-8c86-dc47198e5c42]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:12:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-610283e1-b7fa-4c8a-bd7b-9112dea796d9 tempest-SnapshotDependencyTests-2096073139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-639327d6-a02d-4c21-9100-3cdb901697e3 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:07 devstack sudo[110055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-639327d6-a02d-4c21-9100-3cdb901697e3 Jul 30 17:12:07 devstack sudo[110055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:07 devstack sudo[110055]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-610283e1-b7fa-4c8a-bd7b-9112dea796d9 tempest-SnapshotDependencyTests-2096073139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-639327d6-a02d-4c21-9100-3cdb901697e3" returned: 0 in 0.338s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:07 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-610283e1-b7fa-4c8a-bd7b-9112dea796d9 tempest-SnapshotDependencyTests-2096073139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-639327d6-a02d-4c21-9100-3cdb901697e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-639327d6-a02d-4c21-9100-3cdb901697e3.78f94d60-d377-4ff0-8d0c-5d908b0bf27e 1G {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:07 devstack sudo[110061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-639327d6-a02d-4c21-9100-3cdb901697e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-639327d6-a02d-4c21-9100-3cdb901697e3.78f94d60-d377-4ff0-8d0c-5d908b0bf27e 1G Jul 30 17:12:07 devstack sudo[110061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:08 devstack sudo[110061]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-610283e1-b7fa-4c8a-bd7b-9112dea796d9 tempest-SnapshotDependencyTests-2096073139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-639327d6-a02d-4c21-9100-3cdb901697e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-639327d6-a02d-4c21-9100-3cdb901697e3.78f94d60-d377-4ff0-8d0c-5d908b0bf27e 1G" returned: 0 in 0.383s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-610283e1-b7fa-4c8a-bd7b-9112dea796d9 tempest-SnapshotDependencyTests-2096073139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-639327d6-a02d-4c21-9100-3cdb901697e3 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-639327d6-a02d-4c21-9100-3cdb901697e3.78f94d60-d377-4ff0-8d0c-5d908b0bf27e {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:08 devstack sudo[110066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-639327d6-a02d-4c21-9100-3cdb901697e3 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-639327d6-a02d-4c21-9100-3cdb901697e3.78f94d60-d377-4ff0-8d0c-5d908b0bf27e Jul 30 17:12:08 devstack sudo[110066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:08 devstack sudo[110066]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-610283e1-b7fa-4c8a-bd7b-9112dea796d9 tempest-SnapshotDependencyTests-2096073139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-639327d6-a02d-4c21-9100-3cdb901697e3 -F qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-639327d6-a02d-4c21-9100-3cdb901697e3.78f94d60-d377-4ff0-8d0c-5d908b0bf27e" returned: 0 in 0.294s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:08 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-610283e1-b7fa-4c8a-bd7b-9112dea796d9 tempest-SnapshotDependencyTests-2096073139 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-639327d6-a02d-4c21-9100-3cdb901697e3.78f94d60-d377-4ff0-8d0c-5d908b0bf27e is being set with open permissions: ugo+rw Jul 30 17:12:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-610283e1-b7fa-4c8a-bd7b-9112dea796d9 tempest-SnapshotDependencyTests-2096073139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-639327d6-a02d-4c21-9100-3cdb901697e3.78f94d60-d377-4ff0-8d0c-5d908b0bf27e {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:08 devstack sudo[110071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-639327d6-a02d-4c21-9100-3cdb901697e3.78f94d60-d377-4ff0-8d0c-5d908b0bf27e Jul 30 17:12:08 devstack sudo[110071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:08 devstack sudo[110071]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-610283e1-b7fa-4c8a-bd7b-9112dea796d9 tempest-SnapshotDependencyTests-2096073139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-639327d6-a02d-4c21-9100-3cdb901697e3.78f94d60-d377-4ff0-8d0c-5d908b0bf27e" returned: 0 in 0.237s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:08 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-610283e1-b7fa-4c8a-bd7b-9112dea796d9 tempest-SnapshotDependencyTests-2096073139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-639327d6-a02d-4c21-9100-3cdb901697e3.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:08 devstack sudo[110074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-639327d6-a02d-4c21-9100-3cdb901697e3.info Jul 30 17:12:08 devstack sudo[110074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:09 devstack sudo[110074]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-610283e1-b7fa-4c8a-bd7b-9112dea796d9 tempest-SnapshotDependencyTests-2096073139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-639327d6-a02d-4c21-9100-3cdb901697e3.info" returned: 0 in 0.239s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:09 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-610283e1-b7fa-4c8a-bd7b-9112dea796d9 tempest-SnapshotDependencyTests-2096073139 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-639327d6-a02d-4c21-9100-3cdb901697e3.info is being set with open permissions: ugo+rw Jul 30 17:12:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-610283e1-b7fa-4c8a-bd7b-9112dea796d9 tempest-SnapshotDependencyTests-2096073139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-639327d6-a02d-4c21-9100-3cdb901697e3.info {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:09 devstack sudo[110077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-639327d6-a02d-4c21-9100-3cdb901697e3.info Jul 30 17:12:09 devstack sudo[110077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:09 devstack sudo[110077]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-610283e1-b7fa-4c8a-bd7b-9112dea796d9 tempest-SnapshotDependencyTests-2096073139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-639327d6-a02d-4c21-9100-3cdb901697e3.info" returned: 0 in 0.238s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:09 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-610283e1-b7fa-4c8a-bd7b-9112dea796d9 tempest-SnapshotDependencyTests-2096073139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.852s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:12:09 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-610283e1-b7fa-4c8a-bd7b-9112dea796d9 tempest-SnapshotDependencyTests-2096073139 None] Create snapshot completed successfully Jul 30 17:12:10 devstack cinder-volume[88591]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5c40623-2b67-4933-836a-27ea29ea7767 tempest-SnapshotDependencyTests-2096073139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88591) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 17:12:10 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d5c40623-2b67-4933-836a-27ea29ea7767 tempest-SnapshotDependencyTests-2096073139 None] Flow 'volume_create_manager' (bad0dd8e-806e-4704-93a2-fa10c20e75e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:12:10 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d5c40623-2b67-4933-836a-27ea29ea7767 tempest-SnapshotDependencyTests-2096073139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05305c67-1e54-429e-aa43-9c23f30f017a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:12:10 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d5c40623-2b67-4933-836a-27ea29ea7767 tempest-SnapshotDependencyTests-2096073139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05305c67-1e54-429e-aa43-9c23f30f017a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T15:12:10Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e657043-7bdf-4bfe-83ef-02c7eb6fbe76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='014eff7353684a4da0d2d27f0f563609',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T15:12:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=78f94d60-d377-4ff0-8d0c-5d908b0bf27e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T15:12:10Z,use_quota=True,user_id='399da4b084344be7b6d05e333ffa4832',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7085d58-8da9-4c9e-9d2d-9c715fff8970),volume_type_id=f7085d58-8da9-4c9e-9d2d-9c715fff8970)' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:12:10 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d5c40623-2b67-4933-836a-27ea29ea7767 tempest-SnapshotDependencyTests-2096073139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34b9619b-2a88-4bcb-9d7a-82478447541d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:12:10 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d5c40623-2b67-4933-836a-27ea29ea7767 tempest-SnapshotDependencyTests-2096073139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34b9619b-2a88-4bcb-9d7a-82478447541d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:12:10 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d5c40623-2b67-4933-836a-27ea29ea7767 tempest-SnapshotDependencyTests-2096073139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f35e8bdb-307d-4a9a-8e27-ec50b3da95fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:12:10 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d5c40623-2b67-4933-836a-27ea29ea7767 tempest-SnapshotDependencyTests-2096073139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f35e8bdb-307d-4a9a-8e27-ec50b3da95fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0e657043-7bdf-4bfe-83ef-02c7eb6fbe76', 'volume_name': 'volume-0e657043-7bdf-4bfe-83ef-02c7eb6fbe76', 'volume_size': 1, 'snapshot_id': '78f94d60-d377-4ff0-8d0c-5d908b0bf27e'}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:12:10 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d5c40623-2b67-4933-836a-27ea29ea7767 tempest-SnapshotDependencyTests-2096073139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db90144d-4dbf-454d-85e1-31ac7c3c700c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:12:10 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d5c40623-2b67-4933-836a-27ea29ea7767 tempest-SnapshotDependencyTests-2096073139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db90144d-4dbf-454d-85e1-31ac7c3c700c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:12:10 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d5c40623-2b67-4933-836a-27ea29ea7767 tempest-SnapshotDependencyTests-2096073139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (709e80a6-4908-40d3-bfd4-42606a1ccb95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:12:10 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-d5c40623-2b67-4933-836a-27ea29ea7767 tempest-SnapshotDependencyTests-2096073139 None] Volume 0e657043-7bdf-4bfe-83ef-02c7eb6fbe76: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0e657043-7bdf-4bfe-83ef-02c7eb6fbe76', 'volume_size': 1, 'snapshot_id': '78f94d60-d377-4ff0-8d0c-5d908b0bf27e'} Jul 30 17:12:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d5c40623-2b67-4933-836a-27ea29ea7767 tempest-SnapshotDependencyTests-2096073139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:12:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d5c40623-2b67-4933-836a-27ea29ea7767 tempest-SnapshotDependencyTests-2096073139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:12:10 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d5c40623-2b67-4933-836a-27ea29ea7767 tempest-SnapshotDependencyTests-2096073139 None] Acquiring lock "cinder-quobyte-78f94d60-d377-4ff0-8d0c-5d908b0bf27e-0e657043-7bdf-4bfe-83ef-02c7eb6fbe76" by "_create_volume_from_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:12:10 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d5c40623-2b67-4933-836a-27ea29ea7767 tempest-SnapshotDependencyTests-2096073139 None] Lock "cinder-quobyte-78f94d60-d377-4ff0-8d0c-5d908b0bf27e-0e657043-7bdf-4bfe-83ef-02c7eb6fbe76" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:12:10 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d5c40623-2b67-4933-836a-27ea29ea7767 tempest-SnapshotDependencyTests-2096073139 None] Creating volume 0e657043-7bdf-4bfe-83ef-02c7eb6fbe76 from snapshot 78f94d60-d377-4ff0-8d0c-5d908b0bf27e {{(pid=88591) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 30 17:12:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d5c40623-2b67-4933-836a-27ea29ea7767 tempest-SnapshotDependencyTests-2096073139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:12:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d5c40623-2b67-4933-836a-27ea29ea7767 tempest-SnapshotDependencyTests-2096073139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:12:10 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d5c40623-2b67-4933-836a-27ea29ea7767 tempest-SnapshotDependencyTests-2096073139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:12:10 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d5c40623-2b67-4933-836a-27ea29ea7767 tempest-SnapshotDependencyTests-2096073139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:12:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d5c40623-2b67-4933-836a-27ea29ea7767 tempest-SnapshotDependencyTests-2096073139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:12:10 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d5c40623-2b67-4933-836a-27ea29ea7767 tempest-SnapshotDependencyTests-2096073139 None] Selected osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202 as target Quobyte volume. {{(pid=88591) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 17:12:10 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d5c40623-2b67-4933-836a-27ea29ea7767 tempest-SnapshotDependencyTests-2096073139 None] Acquiring lock "cinder-quobyte-0e657043-7bdf-4bfe-83ef-02c7eb6fbe76" by "_copy_volume_from_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:12:10 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d5c40623-2b67-4933-836a-27ea29ea7767 tempest-SnapshotDependencyTests-2096073139 None] Lock "cinder-quobyte-0e657043-7bdf-4bfe-83ef-02c7eb6fbe76" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:12:10 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d5c40623-2b67-4933-836a-27ea29ea7767 tempest-SnapshotDependencyTests-2096073139 None] snapshot: 78f94d60-d377-4ff0-8d0c-5d908b0bf27e, volume: 0e657043-7bdf-4bfe-83ef-02c7eb6fbe76, {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 17:12:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d5c40623-2b67-4933-836a-27ea29ea7767 tempest-SnapshotDependencyTests-2096073139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:12:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d5c40623-2b67-4933-836a-27ea29ea7767 tempest-SnapshotDependencyTests-2096073139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:12:10 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d5c40623-2b67-4933-836a-27ea29ea7767 tempest-SnapshotDependencyTests-2096073139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:12:10 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d5c40623-2b67-4933-836a-27ea29ea7767 tempest-SnapshotDependencyTests-2096073139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:12:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d5c40623-2b67-4933-836a-27ea29ea7767 tempest-SnapshotDependencyTests-2096073139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:12:10 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2965d5-59d7-4770-96bf-80523561519b]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:12:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d5c40623-2b67-4933-836a-27ea29ea7767 tempest-SnapshotDependencyTests-2096073139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-639327d6-a02d-4c21-9100-3cdb901697e3.78f94d60-d377-4ff0-8d0c-5d908b0bf27e {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:10 devstack sudo[110080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-639327d6-a02d-4c21-9100-3cdb901697e3.78f94d60-d377-4ff0-8d0c-5d908b0bf27e Jul 30 17:12:10 devstack sudo[110080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:10 devstack sudo[110080]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d5c40623-2b67-4933-836a-27ea29ea7767 tempest-SnapshotDependencyTests-2096073139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-639327d6-a02d-4c21-9100-3cdb901697e3.78f94d60-d377-4ff0-8d0c-5d908b0bf27e" returned: 0 in 0.352s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:10 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-d5c40623-2b67-4933-836a-27ea29ea7767 tempest-SnapshotDependencyTests-2096073139 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-639327d6-a02d-4c21-9100-3cdb901697e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:12:10 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6ca44e-afc8-4cde-aaf3-bc0feb6a8c43]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:12:10 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d5c40623-2b67-4933-836a-27ea29ea7767 tempest-SnapshotDependencyTests-2096073139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-639327d6-a02d-4c21-9100-3cdb901697e3 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:10 devstack sudo[110085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-639327d6-a02d-4c21-9100-3cdb901697e3 Jul 30 17:12:10 devstack sudo[110085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:11 devstack sudo[110085]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d5c40623-2b67-4933-836a-27ea29ea7767 tempest-SnapshotDependencyTests-2096073139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-639327d6-a02d-4c21-9100-3cdb901697e3" returned: 0 in 0.342s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:11 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d5c40623-2b67-4933-836a-27ea29ea7767 tempest-SnapshotDependencyTests-2096073139 None] will copy from snapshot at /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-639327d6-a02d-4c21-9100-3cdb901697e3 {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 17:12:11 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-d5c40623-2b67-4933-836a-27ea29ea7767 tempest-SnapshotDependencyTests-2096073139 None] Creating direct copy from snapshot {{(pid=88591) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 17:12:11 devstack cinder-volume[88591]: DEBUG cinder.utils [None req-d5c40623-2b67-4933-836a-27ea29ea7767 tempest-SnapshotDependencyTests-2096073139 None] Path /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e657043-7bdf-4bfe-83ef-02c7eb6fbe76 not found in is_blk_device check {{(pid=88591) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 17:12:11 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d5c40623-2b67-4933-836a-27ea29ea7767 tempest-SnapshotDependencyTests-2096073139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-639327d6-a02d-4c21-9100-3cdb901697e3 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e657043-7bdf-4bfe-83ef-02c7eb6fbe76 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:11 devstack sudo[110090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-639327d6-a02d-4c21-9100-3cdb901697e3 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e657043-7bdf-4bfe-83ef-02c7eb6fbe76 Jul 30 17:12:11 devstack sudo[110090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:12 devstack cinder-volume[88591]: DEBUG oslo_service.periodic_task [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 17:12:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:12:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:12:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:12:12 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:12:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:12:12 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:12 devstack sudo[110104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:12:12 devstack sudo[110104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:13 devstack sudo[110104]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:13 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.555s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:13 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:12:13 devstack cinder-volume[88591]: DEBUG oslo_service.periodic_task [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] Running periodic task VolumeManager._thread_info {{(pid=88591) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 17:12:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] thread count: 28 {{(pid=88591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 17:12:13 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-34935930-d6bb-4c02-a7b7-554ee8f10ebf None None] thread info: [<_MainThread(MainThread, started 140677178003584)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88591) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 17:12:15 devstack sudo[110090]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d5c40623-2b67-4933-836a-27ea29ea7767 tempest-SnapshotDependencyTests-2096073139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-639327d6-a02d-4c21-9100-3cdb901697e3 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e657043-7bdf-4bfe-83ef-02c7eb6fbe76" returned: 0 in 3.997s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:15 devstack cinder-volume[88591]: DEBUG cinder.image.image_utils [None req-d5c40623-2b67-4933-836a-27ea29ea7767 tempest-SnapshotDependencyTests-2096073139 None] Image conversion details: src /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-639327d6-a02d-4c21-9100-3cdb901697e3, size 1024.00 MB, duration 4.00 sec, destination /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e657043-7bdf-4bfe-83ef-02c7eb6fbe76 {{(pid=88591) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 17:12:15 devstack cinder-volume[88591]: INFO cinder.image.image_utils [None req-d5c40623-2b67-4933-836a-27ea29ea7767 tempest-SnapshotDependencyTests-2096073139 None] Converted 1024.00 MB image at 256.14 MB/s Jul 30 17:12:15 devstack cinder-volume[88591]: WARNING cinder.volume.drivers.remotefs [None req-d5c40623-2b67-4933-836a-27ea29ea7767 tempest-SnapshotDependencyTests-2096073139 None] /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e657043-7bdf-4bfe-83ef-02c7eb6fbe76 is being set with open permissions: ugo+rw Jul 30 17:12:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d5c40623-2b67-4933-836a-27ea29ea7767 tempest-SnapshotDependencyTests-2096073139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e657043-7bdf-4bfe-83ef-02c7eb6fbe76 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:15 devstack sudo[110107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e657043-7bdf-4bfe-83ef-02c7eb6fbe76 Jul 30 17:12:15 devstack sudo[110107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:15 devstack sudo[110107]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-d5c40623-2b67-4933-836a-27ea29ea7767 tempest-SnapshotDependencyTests-2096073139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e657043-7bdf-4bfe-83ef-02c7eb6fbe76" returned: 0 in 0.234s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:15 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d5c40623-2b67-4933-836a-27ea29ea7767 tempest-SnapshotDependencyTests-2096073139 None] Lock "cinder-quobyte-0e657043-7bdf-4bfe-83ef-02c7eb6fbe76" released by "_copy_volume_from_snapshot" :: held 5.001s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:12:15 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-d5c40623-2b67-4933-836a-27ea29ea7767 tempest-SnapshotDependencyTests-2096073139 None] Lock "cinder-quobyte-78f94d60-d377-4ff0-8d0c-5d908b0bf27e-0e657043-7bdf-4bfe-83ef-02c7eb6fbe76" released by "_create_volume_from_snapshot" :: held 5.061s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:12:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-d5c40623-2b67-4933-836a-27ea29ea7767 tempest-SnapshotDependencyTests-2096073139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.074s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:12:15 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d5c40623-2b67-4933-836a-27ea29ea7767 tempest-SnapshotDependencyTests-2096073139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (709e80a6-4908-40d3-bfd4-42606a1ccb95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e657043-7bdf-4bfe-83ef-02c7eb6fbe76', 'volume_size': 1, 'snapshot_id': '78f94d60-d377-4ff0-8d0c-5d908b0bf27e'}' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:12:15 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d5c40623-2b67-4933-836a-27ea29ea7767 tempest-SnapshotDependencyTests-2096073139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a28c0d4e-4e6e-419e-9167-bff1266abf37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 17:12:15 devstack cinder-volume[88591]: INFO cinder.volume.flows.manager.create_volume [None req-d5c40623-2b67-4933-836a-27ea29ea7767 tempest-SnapshotDependencyTests-2096073139 None] Volume volume-0e657043-7bdf-4bfe-83ef-02c7eb6fbe76 (0e657043-7bdf-4bfe-83ef-02c7eb6fbe76): created successfully Jul 30 17:12:15 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d5c40623-2b67-4933-836a-27ea29ea7767 tempest-SnapshotDependencyTests-2096073139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a28c0d4e-4e6e-419e-9167-bff1266abf37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88591) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 17:12:15 devstack cinder-volume[88591]: DEBUG cinder.volume.manager [None req-d5c40623-2b67-4933-836a-27ea29ea7767 tempest-SnapshotDependencyTests-2096073139 None] Flow 'volume_create_manager' (bad0dd8e-806e-4704-93a2-fa10c20e75e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88591) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 17:12:15 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-d5c40623-2b67-4933-836a-27ea29ea7767 tempest-SnapshotDependencyTests-2096073139 None] Created volume successfully. Jul 30 17:12:15 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-47638658-8ca9-4cd9-a907-c96b394eb039 tempest-SnapshotDependencyTests-2096073139 None] Acquiring lock "cinder-78f94d60-d377-4ff0-8d0c-5d908b0bf27e-delete_snapshot" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:12:15 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-47638658-8ca9-4cd9-a907-c96b394eb039 tempest-SnapshotDependencyTests-2096073139 None] Lock "cinder-78f94d60-d377-4ff0-8d0c-5d908b0bf27e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:12:15 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-47638658-8ca9-4cd9-a907-c96b394eb039 tempest-SnapshotDependencyTests-2096073139 None] Acquiring lock "cinder-quobyte-639327d6-a02d-4c21-9100-3cdb901697e3" by "delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:12:15 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-47638658-8ca9-4cd9-a907-c96b394eb039 tempest-SnapshotDependencyTests-2096073139 None] Lock "cinder-quobyte-639327d6-a02d-4c21-9100-3cdb901697e3" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:12:15 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-47638658-8ca9-4cd9-a907-c96b394eb039 tempest-SnapshotDependencyTests-2096073139 None] Acquiring lock "cinder-quobyte-78f94d60-d377-4ff0-8d0c-5d908b0bf27e" by "_delete_snapshot" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:12:15 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-47638658-8ca9-4cd9-a907-c96b394eb039 tempest-SnapshotDependencyTests-2096073139 None] Lock "cinder-quobyte-78f94d60-d377-4ff0-8d0c-5d908b0bf27e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:12:15 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-47638658-8ca9-4cd9-a907-c96b394eb039 tempest-SnapshotDependencyTests-2096073139 None] Deleting offline snapshot 78f94d60-d377-4ff0-8d0c-5d908b0bf27e of volume 639327d6-a02d-4c21-9100-3cdb901697e3 {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 17:12:15 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-47638658-8ca9-4cd9-a907-c96b394eb039 tempest-SnapshotDependencyTests-2096073139 None] snapshot_file for this snap is: volume-639327d6-a02d-4c21-9100-3cdb901697e3.78f94d60-d377-4ff0-8d0c-5d908b0bf27e {{(pid=88591) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 17:12:15 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[156e19bd-23e7-4ab3-97f6-ee36840b62a9]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:12:15 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-47638658-8ca9-4cd9-a907-c96b394eb039 tempest-SnapshotDependencyTests-2096073139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-639327d6-a02d-4c21-9100-3cdb901697e3.78f94d60-d377-4ff0-8d0c-5d908b0bf27e {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:15 devstack sudo[110110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-639327d6-a02d-4c21-9100-3cdb901697e3.78f94d60-d377-4ff0-8d0c-5d908b0bf27e Jul 30 17:12:15 devstack sudo[110110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:16 devstack sudo[110110]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:16 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-47638658-8ca9-4cd9-a907-c96b394eb039 tempest-SnapshotDependencyTests-2096073139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-639327d6-a02d-4c21-9100-3cdb901697e3.78f94d60-d377-4ff0-8d0c-5d908b0bf27e" returned: 0 in 0.350s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:16 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.remotefs [None req-47638658-8ca9-4cd9-a907-c96b394eb039 tempest-SnapshotDependencyTests-2096073139 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-639327d6-a02d-4c21-9100-3cdb901697e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88591) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 17:12:16 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea766b46-5b27-4cd6-a6c2-4af091d1dfbb]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:12:16 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-47638658-8ca9-4cd9-a907-c96b394eb039 tempest-SnapshotDependencyTests-2096073139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-639327d6-a02d-4c21-9100-3cdb901697e3 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:16 devstack sudo[110115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-639327d6-a02d-4c21-9100-3cdb901697e3 Jul 30 17:12:16 devstack sudo[110115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:16 devstack sudo[110115]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:16 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-47638658-8ca9-4cd9-a907-c96b394eb039 tempest-SnapshotDependencyTests-2096073139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-639327d6-a02d-4c21-9100-3cdb901697e3" returned: 0 in 0.526s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:16 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-47638658-8ca9-4cd9-a907-c96b394eb039 tempest-SnapshotDependencyTests-2096073139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-639327d6-a02d-4c21-9100-3cdb901697e3.78f94d60-d377-4ff0-8d0c-5d908b0bf27e {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:16 devstack sudo[110120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-639327d6-a02d-4c21-9100-3cdb901697e3.78f94d60-d377-4ff0-8d0c-5d908b0bf27e Jul 30 17:12:16 devstack sudo[110120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:17 devstack sudo[110120]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-47638658-8ca9-4cd9-a907-c96b394eb039 tempest-SnapshotDependencyTests-2096073139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-639327d6-a02d-4c21-9100-3cdb901697e3.78f94d60-d377-4ff0-8d0c-5d908b0bf27e" returned: 0 in 0.326s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-47638658-8ca9-4cd9-a907-c96b394eb039 tempest-SnapshotDependencyTests-2096073139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-639327d6-a02d-4c21-9100-3cdb901697e3.78f94d60-d377-4ff0-8d0c-5d908b0bf27e {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:17 devstack sudo[110126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-639327d6-a02d-4c21-9100-3cdb901697e3.78f94d60-d377-4ff0-8d0c-5d908b0bf27e Jul 30 17:12:17 devstack sudo[110126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:17 devstack sudo[110126]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-47638658-8ca9-4cd9-a907-c96b394eb039 tempest-SnapshotDependencyTests-2096073139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-639327d6-a02d-4c21-9100-3cdb901697e3.78f94d60-d377-4ff0-8d0c-5d908b0bf27e" returned: 0 in 0.246s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:17 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-47638658-8ca9-4cd9-a907-c96b394eb039 tempest-SnapshotDependencyTests-2096073139 None] Lock "cinder-quobyte-78f94d60-d377-4ff0-8d0c-5d908b0bf27e" released by "_delete_snapshot" :: held 1.536s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:12:17 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-47638658-8ca9-4cd9-a907-c96b394eb039 tempest-SnapshotDependencyTests-2096073139 None] Lock "cinder-quobyte-639327d6-a02d-4c21-9100-3cdb901697e3" released by "delete_snapshot" :: held 1.557s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:12:17 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-47638658-8ca9-4cd9-a907-c96b394eb039 tempest-SnapshotDependencyTests-2096073139 None] Created reservations ['030fd949-4c25-40aa-a93d-e0f4d39bbce1', '47a7d687-4bc5-4750-a55d-dec8d6382a56', '5a53e11a-e264-4132-af45-49ebb0ddaf9e', 'edb3b56b-1ddc-408c-988b-e3402cce8cbe'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:12:17 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-47638658-8ca9-4cd9-a907-c96b394eb039 tempest-SnapshotDependencyTests-2096073139 None] Delete snapshot completed successfully. Jul 30 17:12:17 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-47638658-8ca9-4cd9-a907-c96b394eb039 tempest-SnapshotDependencyTests-2096073139 None] Lock "cinder-78f94d60-d377-4ff0-8d0c-5d908b0bf27e-delete_snapshot" released by "delete_snapshot" :: held 1.676s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:12:17 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-8ea71cf8-8951-4472-86ad-a46d8a84432a tempest-SnapshotDependencyTests-2096073139 None] Acquiring lock "cinder-639327d6-a02d-4c21-9100-3cdb901697e3-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:12:17 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-8ea71cf8-8951-4472-86ad-a46d8a84432a tempest-SnapshotDependencyTests-2096073139 None] Lock "cinder-639327d6-a02d-4c21-9100-3cdb901697e3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:12:17 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-8ea71cf8-8951-4472-86ad-a46d8a84432a tempest-SnapshotDependencyTests-2096073139 None] Acquiring lock "cinder-quobyte-639327d6-a02d-4c21-9100-3cdb901697e3" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:12:17 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-8ea71cf8-8951-4472-86ad-a46d8a84432a tempest-SnapshotDependencyTests-2096073139 None] Lock "cinder-quobyte-639327d6-a02d-4c21-9100-3cdb901697e3" acquired by "delete_volume" :: waited 0.016s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:12:17 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b773aa4-021c-432b-b906-7b3f4d92bef4]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:12:17 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8ea71cf8-8951-4472-86ad-a46d8a84432a tempest-SnapshotDependencyTests-2096073139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-639327d6-a02d-4c21-9100-3cdb901697e3 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:18 devstack sudo[110129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-639327d6-a02d-4c21-9100-3cdb901697e3 Jul 30 17:12:18 devstack sudo[110129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:18 devstack sudo[110129]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8ea71cf8-8951-4472-86ad-a46d8a84432a tempest-SnapshotDependencyTests-2096073139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-639327d6-a02d-4c21-9100-3cdb901697e3" returned: 0 in 0.368s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8ea71cf8-8951-4472-86ad-a46d8a84432a tempest-SnapshotDependencyTests-2096073139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-639327d6-a02d-4c21-9100-3cdb901697e3 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:18 devstack sudo[110134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-639327d6-a02d-4c21-9100-3cdb901697e3 Jul 30 17:12:18 devstack sudo[110134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:18 devstack sudo[110134]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8ea71cf8-8951-4472-86ad-a46d8a84432a tempest-SnapshotDependencyTests-2096073139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-639327d6-a02d-4c21-9100-3cdb901697e3" returned: 0 in 0.256s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:18 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-8ea71cf8-8951-4472-86ad-a46d8a84432a tempest-SnapshotDependencyTests-2096073139 None] Lock "cinder-quobyte-639327d6-a02d-4c21-9100-3cdb901697e3" released by "delete_volume" :: held 0.685s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:12:18 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-8ea71cf8-8951-4472-86ad-a46d8a84432a tempest-SnapshotDependencyTests-2096073139 None] Created reservations ['4db6e8c2-e09d-41b9-a986-1368beaa5d53', 'd4508b92-2208-45ab-9263-56ef03157aca', 'e04d409a-8862-414b-b623-ae021182a6d2', '4fca274a-157e-44bf-bf7c-362d95140fab'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:12:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8ea71cf8-8951-4472-86ad-a46d8a84432a tempest-SnapshotDependencyTests-2096073139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:12:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8ea71cf8-8951-4472-86ad-a46d8a84432a tempest-SnapshotDependencyTests-2096073139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:12:18 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-8ea71cf8-8951-4472-86ad-a46d8a84432a tempest-SnapshotDependencyTests-2096073139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:12:18 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-8ea71cf8-8951-4472-86ad-a46d8a84432a tempest-SnapshotDependencyTests-2096073139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:12:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-8ea71cf8-8951-4472-86ad-a46d8a84432a tempest-SnapshotDependencyTests-2096073139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:12:18 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8ea71cf8-8951-4472-86ad-a46d8a84432a tempest-SnapshotDependencyTests-2096073139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:18 devstack sudo[110137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:12:18 devstack sudo[110137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:19 devstack sudo[110137]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-8ea71cf8-8951-4472-86ad-a46d8a84432a tempest-SnapshotDependencyTests-2096073139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.251s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:19 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-8ea71cf8-8951-4472-86ad-a46d8a84432a tempest-SnapshotDependencyTests-2096073139 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:12:19 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-8ea71cf8-8951-4472-86ad-a46d8a84432a tempest-SnapshotDependencyTests-2096073139 None] Deleted volume successfully. Jul 30 17:12:19 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-8ea71cf8-8951-4472-86ad-a46d8a84432a tempest-SnapshotDependencyTests-2096073139 None] Lock "cinder-639327d6-a02d-4c21-9100-3cdb901697e3-delete_volume" released by "delete_volume" :: held 1.136s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:12:19 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-bc5389bc-7199-4632-bb1a-23c9fa01c038 tempest-SnapshotDependencyTests-2096073139 None] Acquiring lock "cinder-0e657043-7bdf-4bfe-83ef-02c7eb6fbe76-delete_volume" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:12:19 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-bc5389bc-7199-4632-bb1a-23c9fa01c038 tempest-SnapshotDependencyTests-2096073139 None] Lock "cinder-0e657043-7bdf-4bfe-83ef-02c7eb6fbe76-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:12:19 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-bc5389bc-7199-4632-bb1a-23c9fa01c038 tempest-SnapshotDependencyTests-2096073139 None] Acquiring lock "cinder-quobyte-0e657043-7bdf-4bfe-83ef-02c7eb6fbe76" by "delete_volume" {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 17:12:19 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-bc5389bc-7199-4632-bb1a-23c9fa01c038 tempest-SnapshotDependencyTests-2096073139 None] Lock "cinder-quobyte-0e657043-7bdf-4bfe-83ef-02c7eb6fbe76" acquired by "delete_volume" :: waited 0.017s {{(pid=88591) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 17:12:19 devstack cinder-volume[88591]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a092461-3def-477c-9791-6b1b096a2c58]: (4, 'qcow2') {{(pid=90400) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 17:12:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bc5389bc-7199-4632-bb1a-23c9fa01c038 tempest-SnapshotDependencyTests-2096073139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e657043-7bdf-4bfe-83ef-02c7eb6fbe76 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:19 devstack sudo[110140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e657043-7bdf-4bfe-83ef-02c7eb6fbe76 Jul 30 17:12:19 devstack sudo[110140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:19 devstack sudo[110140]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bc5389bc-7199-4632-bb1a-23c9fa01c038 tempest-SnapshotDependencyTests-2096073139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e657043-7bdf-4bfe-83ef-02c7eb6fbe76" returned: 0 in 0.367s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bc5389bc-7199-4632-bb1a-23c9fa01c038 tempest-SnapshotDependencyTests-2096073139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e657043-7bdf-4bfe-83ef-02c7eb6fbe76 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:19 devstack sudo[110145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e657043-7bdf-4bfe-83ef-02c7eb6fbe76 Jul 30 17:12:19 devstack sudo[110145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:19 devstack sudo[110145]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bc5389bc-7199-4632-bb1a-23c9fa01c038 tempest-SnapshotDependencyTests-2096073139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8/volume-0e657043-7bdf-4bfe-83ef-02c7eb6fbe76" returned: 0 in 0.243s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:19 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-bc5389bc-7199-4632-bb1a-23c9fa01c038 tempest-SnapshotDependencyTests-2096073139 None] Lock "cinder-quobyte-0e657043-7bdf-4bfe-83ef-02c7eb6fbe76" released by "delete_volume" :: held 0.649s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:12:19 devstack cinder-volume[88591]: DEBUG cinder.quota [None req-bc5389bc-7199-4632-bb1a-23c9fa01c038 tempest-SnapshotDependencyTests-2096073139 None] Created reservations ['759809bc-9bb1-4247-8151-29ef518d6ad7', 'f06580c6-03ba-467c-8761-fe52296c9c9a', '0efc49f4-8cf9-43e6-9994-4a30a98abaa4', '014d4af2-ae0a-4277-8cd1-c34c25370f41'] {{(pid=88591) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 17:12:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-bc5389bc-7199-4632-bb1a-23c9fa01c038 tempest-SnapshotDependencyTests-2096073139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 17:12:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-bc5389bc-7199-4632-bb1a-23c9fa01c038 tempest-SnapshotDependencyTests-2096073139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 17:12:19 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-bc5389bc-7199-4632-bb1a-23c9fa01c038 tempest-SnapshotDependencyTests-2096073139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202': None} {{(pid=88591) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 17:12:19 devstack cinder-volume[88591]: DEBUG cinder.volume.drivers.quobyte [None req-bc5389bc-7199-4632-bb1a-23c9fa01c038 tempest-SnapshotDependencyTests-2096073139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ec8d8bc0-0354-4f63-bf80-b54c5b9cb202'] {{(pid=88591) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 17:12:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.lockutils [None req-bc5389bc-7199-4632-bb1a-23c9fa01c038 tempest-SnapshotDependencyTests-2096073139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88591) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 17:12:19 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bc5389bc-7199-4632-bb1a-23c9fa01c038 tempest-SnapshotDependencyTests-2096073139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 17:12:19 devstack sudo[110148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8 Jul 30 17:12:19 devstack sudo[110148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 17:12:20 devstack sudo[110148]: pam_unix(sudo:session): session closed for user root Jul 30 17:12:20 devstack cinder-volume[88591]: DEBUG oslo_concurrency.processutils [None req-bc5389bc-7199-4632-bb1a-23c9fa01c038 tempest-SnapshotDependencyTests-2096073139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/883341a715e5bbfae3fd7772469571d8" returned: 0 in 0.248s {{(pid=88591) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 17:12:20 devstack cinder-volume[88591]: DEBUG cinder.manager [None req-bc5389bc-7199-4632-bb1a-23c9fa01c038 tempest-SnapshotDependencyTests-2096073139 None] Notifying Schedulers of capabilities ... {{(pid=88591) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 17:12:20 devstack cinder-volume[88591]: INFO cinder.volume.manager [None req-bc5389bc-7199-4632-bb1a-23c9fa01c038 tempest-SnapshotDependencyTests-2096073139 None] Deleted volume successfully. Jul 30 17:12:20 devstack cinder-volume[88591]: DEBUG cinder.coordination [None req-bc5389bc-7199-4632-bb1a-23c9fa01c038 tempest-SnapshotDependencyTests-2096073139 None] Lock "cinder-0e657043-7bdf-4bfe-83ef-02c7eb6fbe76-delete_volume" released by "delete_volume" :: held 1.086s {{(pid=88591) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 17:12:29 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:UPDATE=27,cinder:SELECT=24,cinder:DELETE=3,cinder:INSERT=8 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 17:12:30 devstack cinder-volume[88591]: DEBUG dbcounter [-] [88591] Writing DB stats cinder:SELECT=25,cinder:INSERT=7,cinder:UPDATE=31,cinder:DELETE=2 {{(pid=88591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}